Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-09-25T01:49:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-09-25T01:49:37Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260925 01:49:37.116041 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.254:40913
--webserver_interface=127.10.159.254
--webserver_port=0
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260925 01:49:37.466373 10887 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:37.466739 10887 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:37.466912 10887 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:37.475958 10887 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 01:49:37.476065 10887 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:37.476163 10887 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 01:49:37.476240 10887 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260925 01:49:37.486899 10887 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.254:40913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.159.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:37.488657 10887 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:37.490614 10887 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260925 01:49:37.500186 10892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:37.500505 10893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:37.500470 10895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:37.501438 10887 server_base.cc:1061] running on GCE node
I20260925 01:49:37.502319 10887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:49:37.503789 10887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:37.505012 10887 hybrid_clock.cc:648] HybridClock initialized: now 1790300977504945 us; error 49 us; skew 500 ppm
I20260925 01:49:37.505530 10887 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:49:37.508039 10887 webserver.cc:533] Webserver started at http://127.10.159.254:33981/ using document root <none> and password file <none>
I20260925 01:49:37.508858 10887 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:37.508960 10887 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:37.509368 10887 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 01:49:37.512019 10887 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/instance:
uuid: "17a1694989f748dfa9cdb2c10f3f1de5"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:49:37.512869 10887 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal/instance:
uuid: "17a1694989f748dfa9cdb2c10f3f1de5"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:49:37.519140 10887 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.006s
I20260925 01:49:37.523015 10901 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:37.524555 10887 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260925 01:49:37.524760 10887 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
uuid: "17a1694989f748dfa9cdb2c10f3f1de5"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:49:37.525004 10887 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:37.550805 10887 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:37.551785 10887 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:37.552139 10887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:37.574298 10887 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.254:40913
I20260925 01:49:37.574318 10953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.254:40913 every 8 connection(s)
I20260925 01:49:37.575991 10887 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/info.pb
I20260925 01:49:37.580785 10954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:37.585953 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 10887
I20260925 01:49:37.586318 10879 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal/instance
I20260925 01:49:37.587076 10954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } has no permanent_uuid. Determining permanent_uuid...
I20260925 01:49:37.589035 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.253:42889
--webserver_interface=127.10.159.253
--webserver_port=0
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 01:49:37.611948 10954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } has no permanent_uuid. Determining permanent_uuid...
W20260925 01:49:37.613240 10905 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111)
W20260925 01:49:37.615115 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.253:42889: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111)
I20260925 01:49:37.664510 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } attempt: 1
W20260925 01:49:37.666692 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.253:42889: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111)
I20260925 01:49:37.735041 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } attempt: 2
W20260925 01:49:37.737186 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.253:42889: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111)
I20260925 01:49:37.828497 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } attempt: 3
W20260925 01:49:37.830914 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.253:42889: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111)
W20260925 01:49:37.946765 10958 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:37.947129 10958 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:37.947268 10958 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:37.956091 10958 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 01:49:37.956202 10958 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:37.956291 10958 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 01:49:37.956386 10958 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260925 01:49:37.967689 10958 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.253:42889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.159.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:37.969647 10958 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:37.971625 10958 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260925 01:49:37.974215 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } attempt: 4
W20260925 01:49:37.976310 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.253:42889: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111)
W20260925 01:49:37.980914 10964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:37.980953 10965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:37.981698 10967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:37.982398 10958 server_base.cc:1061] running on GCE node
I20260925 01:49:37.983232 10958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:49:37.984689 10958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:37.985920 10958 hybrid_clock.cc:648] HybridClock initialized: now 1790300977985866 us; error 49 us; skew 500 ppm
I20260925 01:49:37.986325 10958 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:49:37.988626 10958 webserver.cc:533] Webserver started at http://127.10.159.253:34593/ using document root <none> and password file <none>
I20260925 01:49:37.989457 10958 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:37.989594 10958 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:37.989969 10958 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 01:49:37.992422 10958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/instance:
uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:49:37.993191 10958 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal/instance:
uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:49:37.998823 10958 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260925 01:49:38.002686 10973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:38.004150 10958 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260925 01:49:38.004339 10958 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:49:38.004575 10958 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:38.031381 10958 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:38.032327 10958 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:38.032661 10958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:38.054212 10958 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.253:42889
I20260925 01:49:38.054231 11025 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.253:42889 every 8 connection(s)
I20260925 01:49:38.055963 10958 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/info.pb
I20260925 01:49:38.060376 11026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:38.060838 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 10958
I20260925 01:49:38.061103 10879 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal/instance
I20260925 01:49:38.062275 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.252:44823
--webserver_interface=127.10.159.252
--webserver_port=0
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 01:49:38.066617 11026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } has no permanent_uuid. Determining permanent_uuid...
I20260925 01:49:38.082083 11026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } has no permanent_uuid. Determining permanent_uuid...
I20260925 01:49:38.092741 11026 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } has no permanent_uuid. Determining permanent_uuid...
W20260925 01:49:38.093968 10974 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
W20260925 01:49:38.095777 11026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:38.145112 11026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 1
W20260925 01:49:38.147333 11026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:38.215595 11026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 2
W20260925 01:49:38.218021 11026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:38.275606 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } attempt: 5
I20260925 01:49:38.282583 10954 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } has no permanent_uuid. Determining permanent_uuid...
W20260925 01:49:38.284621 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:38.309397 11026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 3
W20260925 01:49:38.311712 11026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:38.335940 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 1
W20260925 01:49:38.338482 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:38.406785 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 2
W20260925 01:49:38.409552 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
W20260925 01:49:38.423820 11028 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:38.424160 11028 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:38.424238 11028 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:38.432914 11028 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 01:49:38.433019 11028 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:38.433077 11028 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 01:49:38.433117 11028 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260925 01:49:38.443666 11028 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.252:44823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.159.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:38.445359 11028 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:38.447225 11028 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260925 01:49:38.454965 11026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 4
W20260925 01:49:38.455351 11036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:38.456655 11037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:38.457465 11026 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
W20260925 01:49:38.457646 11039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:38.458204 11028 server_base.cc:1061] running on GCE node
I20260925 01:49:38.459131 11028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:49:38.460755 11028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:38.462052 11028 hybrid_clock.cc:648] HybridClock initialized: now 1790300978461964 us; error 81 us; skew 500 ppm
I20260925 01:49:38.462487 11028 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:49:38.464982 11028 webserver.cc:533] Webserver started at http://127.10.159.252:38543/ using document root <none> and password file <none>
I20260925 01:49:38.465799 11028 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:38.465956 11028 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:38.466403 11028 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 01:49:38.469028 11028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/instance:
uuid: "ca2cee7752c249f68a372ef5c6a18bff"
format_stamp: "Formatted at 2026-09-25 01:49:38 on dist-test-slave-xxxl"
I20260925 01:49:38.469857 11028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal/instance:
uuid: "ca2cee7752c249f68a372ef5c6a18bff"
format_stamp: "Formatted at 2026-09-25 01:49:38 on dist-test-slave-xxxl"
I20260925 01:49:38.475683 11028 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260925 01:49:38.479406 11045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:38.480830 11028 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260925 01:49:38.481048 11028 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
uuid: "ca2cee7752c249f68a372ef5c6a18bff"
format_stamp: "Formatted at 2026-09-25 01:49:38 on dist-test-slave-xxxl"
I20260925 01:49:38.481276 11028 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:38.515825 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 3
W20260925 01:49:38.518030 10954 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.159.252:44823: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:38.525295 11028 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:38.526325 11028 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:38.526624 11028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:38.548135 11028 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.252:44823
I20260925 01:49:38.548111 11096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.252:44823 every 8 connection(s)
I20260925 01:49:38.549746 11028 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/info.pb
I20260925 01:49:38.551945 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 11028
I20260925 01:49:38.552175 10879 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal/instance
I20260925 01:49:38.554404 11097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:38.562177 11097 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } has no permanent_uuid. Determining permanent_uuid...
I20260925 01:49:38.578023 11097 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } has no permanent_uuid. Determining permanent_uuid...
I20260925 01:49:38.586498 11097 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } has no permanent_uuid. Determining permanent_uuid...
I20260925 01:49:38.598726 11097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Bootstrap starting.
I20260925 01:49:38.602639 11097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:38.603874 11097 log.cc:826] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Log is configured to *not* fsync() on all Append() calls
I20260925 01:49:38.606598 11097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: No bootstrap required, opened a new log
I20260925 01:49:38.612471 11097 raft_consensus.cc:359] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.612766 11097 raft_consensus.cc:385] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:38.612915 11097 raft_consensus.cc:740] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca2cee7752c249f68a372ef5c6a18bff, State: Initialized, Role: FOLLOWER
I20260925 01:49:38.613641 11097 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.614781 11106 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.615199 11106 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:38.616063 11097 sys_catalog.cc:565] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: configured and running, proceeding with master startup.
W20260925 01:49:38.627514 11117 catalog_manager.cc:1607] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260925 01:49:38.627647 11117 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260925 01:49:38.625378 11028 master_runner.cc:187] Error getting master registration for 127.10.159.254:40913: OK, instance_id { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" instance_seqno: 1790300977568264 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260925 01:49:38.630910 11028 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260925 01:49:38.695335 10954 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 4
I20260925 01:49:38.709578 10954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Bootstrap starting.
I20260925 01:49:38.713690 10954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:38.715343 10954 log.cc:826] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Log is configured to *not* fsync() on all Append() calls
I20260925 01:49:38.718255 10954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: No bootstrap required, opened a new log
I20260925 01:49:38.723692 10954 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.724004 10954 raft_consensus.cc:385] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:38.724154 10954 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a1694989f748dfa9cdb2c10f3f1de5, State: Initialized, Role: FOLLOWER
I20260925 01:49:38.724752 10954 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.725764 11120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.726096 11120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:38.727007 10954 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: configured and running, proceeding with master startup.
W20260925 01:49:38.739035 11131 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260925 01:49:38.739245 11131 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260925 01:49:38.737130 10887 master_runner.cc:187] Error getting master registration for 127.10.159.253:42889: OK, instance_id { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" instance_seqno: 1790300978048378 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260925 01:49:38.744148 10887 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260925 01:49:38.756704 11026 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } attempt: 5
I20260925 01:49:38.769039 11106 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:38.769351 11106 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.771459 11106 leader_election.cc:290] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889)
I20260925 01:49:38.770323 11026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Bootstrap starting.
I20260925 01:49:38.773079 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:49:38.773679 10929 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca2cee7752c249f68a372ef5c6a18bff in term 0.
I20260925 01:49:38.776757 11046 leader_election.cc:304] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff; no voters:
I20260925 01:49:38.778141 11026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:38.778224 11106 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:38.778396 11106 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:38.778496 11106 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:38.778857 11051 tablet.cc:2433] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 01:49:38.779721 11026 log.cc:826] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Log is configured to *not* fsync() on all Append() calls
I20260925 01:49:38.788357 11026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: No bootstrap required, opened a new log
I20260925 01:49:38.790179 11106 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.792228 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5"
I20260925 01:49:38.792464 10929 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:38.796239 11106 leader_election.cc:290] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 1 election: Requested vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889)
I20260925 01:49:38.798715 11026 raft_consensus.cc:359] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.799103 11026 raft_consensus.cc:385] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:38.799258 11026 raft_consensus.cc:740] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec2f98d6295c4f8ead68b46f01e73d37, State: Initialized, Role: FOLLOWER
I20260925 01:49:38.800570 11026 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
W20260925 01:49:38.805791 10907 tablet.cc:2433] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 01:49:38.808964 11135 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.810322 10929 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca2cee7752c249f68a372ef5c6a18bff in term 1.
I20260925 01:49:38.812582 11135 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:38.812383 11026 sys_catalog.cc:565] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 01:49:38.813189 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
I20260925 01:49:38.813791 10999 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:38.814529 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" is_pre_election: true
I20260925 01:49:38.817291 11046 leader_election.cc:304] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff; no voters:
I20260925 01:49:38.817783 11106 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:38.827031 11106 raft_consensus.cc:697] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 1 LEADER]: Becoming Leader. State: Replica: ca2cee7752c249f68a372ef5c6a18bff, State: Running, Role: LEADER
I20260925 01:49:38.827849 11106 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:38.832484 10999 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca2cee7752c249f68a372ef5c6a18bff in term 1.
I20260925 01:49:38.856707 11136 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca2cee7752c249f68a372ef5c6a18bff. Latest consensus state: current_term: 1 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.857111 11136 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:38.862661 11144 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260925 01:49:38.864737 11144 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260925 01:49:38.884956 10999 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 1 FOLLOWER]: Refusing update from remote peer ca2cee7752c249f68a372ef5c6a18bff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:38.887136 10929 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 1 FOLLOWER]: Refusing update from remote peer ca2cee7752c249f68a372ef5c6a18bff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:38.888494 11106 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:38.889780 11106 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:38.915337 11135 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca2cee7752c249f68a372ef5c6a18bff. Latest consensus state: current_term: 1 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.915652 11135 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:38.920578 11147 mvcc.cc:204] Tried to move back new op lower bound from 7333072809481658368 to 7333072809286176768. Current Snapshot: MvccSnapshot[applied={T|T < 7333072809481658368}]
I20260925 01:49:38.921720 11120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca2cee7752c249f68a372ef5c6a18bff. Latest consensus state: current_term: 1 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.922098 11120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:38.932924 11120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.933226 11120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: FOLLOWER
W20260925 01:49:38.943693 11150 catalog_manager.cc:1607] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260925 01:49:38.943961 11150 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260925 01:49:38.949751 11135 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.950007 11135 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:38.952557 11144 catalog_manager.cc:1396] Generated new cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:38.952688 11144 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260925 01:49:38.963897 11136 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.964318 11136 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:38.964670 11106 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:38.965011 11106 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:38.980485 11144 catalog_manager.cc:1419] Generated new certificate authority record
I20260925 01:49:38.982446 11144 catalog_manager.cc:1553] Loading token signing keys...
I20260925 01:49:39.023257 11144 catalog_manager.cc:6219] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Generated new TSK 0
I20260925 01:49:39.024600 11144 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260925 01:49:39.056269 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.159.193:0
--local_ip_for_outbound_sockets=127.10.159.193
--webserver_interface=127.10.159.193
--webserver_port=0
--tserver_master_addrs=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260925 01:49:39.522222 11160 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:39.522620 11160 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:39.522764 11160 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:39.532219 11160 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:39.532469 11160 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.159.193
I20260925 01:49:39.543195 11160 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.159.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.159.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.159.193
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:39.544981 11160 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:39.546972 11160 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260925 01:49:39.560317 11165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:39.562484 11166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:39.571480 11168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:39.572196 11160 server_base.cc:1061] running on GCE node
I20260925 01:49:39.572965 11160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:49:39.580618 11160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:39.581898 11160 hybrid_clock.cc:648] HybridClock initialized: now 1790300979581794 us; error 102 us; skew 500 ppm
I20260925 01:49:39.582371 11160 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:49:39.585390 11160 webserver.cc:533] Webserver started at http://127.10.159.193:43067/ using document root <none> and password file <none>
I20260925 01:49:39.586514 11160 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:39.586645 11160 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:39.587045 11160 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 01:49:39.590641 11160 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data/instance:
uuid: "b93565e796c94a3699eb1824383bbaeb"
format_stamp: "Formatted at 2026-09-25 01:49:39 on dist-test-slave-xxxl"
I20260925 01:49:39.591624 11160 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/instance:
uuid: "b93565e796c94a3699eb1824383bbaeb"
format_stamp: "Formatted at 2026-09-25 01:49:39 on dist-test-slave-xxxl"
I20260925 01:49:39.598851 11160 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260925 01:49:39.603211 11174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:39.604853 11160 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260925 01:49:39.605118 11160 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal
uuid: "b93565e796c94a3699eb1824383bbaeb"
format_stamp: "Formatted at 2026-09-25 01:49:39 on dist-test-slave-xxxl"
I20260925 01:49:39.605350 11160 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:39.623147 11160 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:39.624125 11160 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:39.624468 11160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:39.625952 11160 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260925 01:49:39.633260 11160 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 01:49:39.633420 11160 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:39.633543 11160 ts_tablet_manager.cc:616] Registered 0 tablets
I20260925 01:49:39.633621 11160 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:39.691112 11160 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.193:44813
I20260925 01:49:39.691201 11287 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.193:44813 every 8 connection(s)
I20260925 01:49:39.692638 11160 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/data/info.pb
I20260925 01:49:39.695120 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 11160
I20260925 01:49:39.695366 10879 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/instance
I20260925 01:49:39.700912 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.159.194:0
--local_ip_for_outbound_sockets=127.10.159.194
--webserver_interface=127.10.159.194
--webserver_port=0
--tserver_master_addrs=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260925 01:49:39.721305 11289 heartbeater.cc:344] Connected to a master server at 127.10.159.254:40913
I20260925 01:49:39.721743 11289 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:39.723150 11289 heartbeater.cc:507] Master 127.10.159.254:40913 requested a full tablet report, sending...
I20260925 01:49:39.725299 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:49:39.725422 11290 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:39.725858 11290 heartbeater.cc:507] Master 127.10.159.253:42889 requested a full tablet report, sending...
I20260925 01:49:39.726464 10919 ts_manager.cc:194] Registered new tserver with Master: b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:39.727641 10990 ts_manager.cc:194] Registered new tserver with Master: b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:39.728673 11288 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:39.728859 11288 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:39.729559 11288 heartbeater.cc:507] Master 127.10.159.252:44823 requested a full tablet report, sending...
I20260925 01:49:39.731195 11062 ts_manager.cc:194] Registered new tserver with Master: b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:39.733081 11062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.159.193:39693
I20260925 01:49:39.741814 11131 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:39.741995 11131 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: loading cluster ID for follower catalog manager: success
I20260925 01:49:39.745471 11131 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: acquiring CA information for follower catalog manager: success
I20260925 01:49:39.747915 11131 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 01:49:39.946143 11150 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:39.946252 11150 catalog_manager.cc:1601] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: loading cluster ID for follower catalog manager: success
I20260925 01:49:39.949115 11150 catalog_manager.cc:1623] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: acquiring CA information for follower catalog manager: success
I20260925 01:49:39.951113 11150 catalog_manager.cc:1651] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260925 01:49:40.080102 11298 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:40.080531 11298 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:40.080700 11298 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:40.089946 11298 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:40.090240 11298 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.159.194
I20260925 01:49:40.101207 11298 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.159.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.159.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.159.194
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:40.103215 11298 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:40.105247 11298 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260925 01:49:40.116133 11303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:40.116106 11304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:40.118788 11298 server_base.cc:1061] running on GCE node
W20260925 01:49:40.119457 11306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:40.120285 11298 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:49:40.121320 11298 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:40.122537 11298 hybrid_clock.cc:648] HybridClock initialized: now 1790300980122471 us; error 55 us; skew 500 ppm
I20260925 01:49:40.122848 11298 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:49:40.125181 11298 webserver.cc:533] Webserver started at http://127.10.159.194:45333/ using document root <none> and password file <none>
I20260925 01:49:40.125953 11298 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:40.126132 11298 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:40.126463 11298 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 01:49:40.129005 11298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data/instance:
uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
format_stamp: "Formatted at 2026-09-25 01:49:40 on dist-test-slave-xxxl"
I20260925 01:49:40.129792 11298 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/instance:
uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
format_stamp: "Formatted at 2026-09-25 01:49:40 on dist-test-slave-xxxl"
I20260925 01:49:40.135540 11298 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260925 01:49:40.139570 11312 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:40.141271 11298 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260925 01:49:40.141438 11298 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal
uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
format_stamp: "Formatted at 2026-09-25 01:49:40 on dist-test-slave-xxxl"
I20260925 01:49:40.141635 11298 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:40.161945 11298 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:40.162875 11298 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:40.163117 11298 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:40.164057 11298 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260925 01:49:40.165750 11298 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 01:49:40.165838 11298 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:40.165912 11298 ts_tablet_manager.cc:616] Registered 0 tablets
I20260925 01:49:40.165967 11298 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:40.205075 11298 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.194:35027
I20260925 01:49:40.205274 11424 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.194:35027 every 8 connection(s)
I20260925 01:49:40.207175 11298 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/data/info.pb
I20260925 01:49:40.209723 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 11298
I20260925 01:49:40.210001 10879 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/instance
I20260925 01:49:40.217201 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.159.195:0
--local_ip_for_outbound_sockets=127.10.159.195
--webserver_interface=127.10.159.195
--webserver_port=0
--tserver_master_addrs=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260925 01:49:40.235817 11288 heartbeater.cc:499] Master 127.10.159.252:44823 was elected leader, sending a full tablet report...
I20260925 01:49:40.241998 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:49:40.242491 11427 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:40.243848 11427 heartbeater.cc:507] Master 127.10.159.253:42889 requested a full tablet report, sending...
I20260925 01:49:40.246706 10990 ts_manager.cc:194] Registered new tserver with Master: aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:40.250238 11425 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:40.250411 11425 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:40.250654 11426 heartbeater.cc:344] Connected to a master server at 127.10.159.254:40913
I20260925 01:49:40.250864 11426 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:40.251277 11425 heartbeater.cc:507] Master 127.10.159.252:44823 requested a full tablet report, sending...
I20260925 01:49:40.251416 11426 heartbeater.cc:507] Master 127.10.159.254:40913 requested a full tablet report, sending...
I20260925 01:49:40.252565 11062 ts_manager.cc:194] Registered new tserver with Master: aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:40.252599 10919 ts_manager.cc:194] Registered new tserver with Master: aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:40.253726 11062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.159.194:44203
I20260925 01:49:40.362600 11434 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca2cee7752c249f68a372ef5c6a18bff)
I20260925 01:49:40.362883 11434 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:40.364182 11434 leader_election.cc:290] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:49:40.364982 10929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:49:40.365082 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:49:40.365909 10974 leader_election.cc:304] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:49:40.366338 11434 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:40.373186 11435 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ca2cee7752c249f68a372ef5c6a18bff)
I20260925 01:49:40.373397 11435 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:40.374863 11435 leader_election.cc:290] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:49:40.375527 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:49:40.375542 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" is_pre_election: true
I20260925 01:49:40.375771 10999 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a1694989f748dfa9cdb2c10f3f1de5 in term 1.
I20260925 01:49:40.376294 10905 leader_election.cc:304] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a1694989f748dfa9cdb2c10f3f1de5, ec2f98d6295c4f8ead68b46f01e73d37; no voters: ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:49:40.376693 11435 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:40.376827 11435 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ca2cee7752c249f68a372ef5c6a18bff)
I20260925 01:49:40.376959 11435 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:40.379150 11435 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:40.379855 11435 leader_election.cc:290] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 2 election: Requested vote from peers ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:49:40.380419 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff"
I20260925 01:49:40.380399 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
I20260925 01:49:40.380636 10999 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:40.384020 10999 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a1694989f748dfa9cdb2c10f3f1de5 in term 2.
I20260925 01:49:40.384514 11000 raft_consensus.cc:1240] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 2 FOLLOWER]: Rejecting Update request from peer ca2cee7752c249f68a372ef5c6a18bff for earlier term 1. Current term is 2. Ops: []
I20260925 01:49:40.384570 10905 leader_election.cc:304] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17a1694989f748dfa9cdb2c10f3f1de5, ec2f98d6295c4f8ead68b46f01e73d37; no voters: ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:49:40.385059 11435 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 01:49:40.385583 11435 raft_consensus.cc:697] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 LEADER]: Becoming Leader. State: Replica: 17a1694989f748dfa9cdb2c10f3f1de5, State: Running, Role: LEADER
I20260925 01:49:40.385579 11436 consensus_queue.cc:1059] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 01:49:40.386150 11435 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:40.386435 11438 raft_consensus.cc:3055] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 1 LEADER]: Stepping down as leader of term 1
I20260925 01:49:40.386562 11438 raft_consensus.cc:740] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ca2cee7752c249f68a372ef5c6a18bff, State: Running, Role: LEADER
I20260925 01:49:40.387001 11438 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:40.387530 11438 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:40.388242 11437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1694989f748dfa9cdb2c10f3f1de5. Latest consensus state: current_term: 2 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:40.388549 11437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:40.389334 11440 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260925 01:49:40.391765 11440 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260925 01:49:40.392597 11440 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:40.392668 11440 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260925 01:49:40.393824 11440 catalog_manager.cc:1553] Loading token signing keys...
I20260925 01:49:40.394708 11440 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Loaded TSK: 0
I20260925 01:49:40.395565 11440 catalog_manager.cc:1563] Initializing in-progress tserver states...
W20260925 01:49:40.609673 11431 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:40.610095 11431 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:40.610251 11431 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:40.619021 11431 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:40.619252 11431 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.159.195
I20260925 01:49:40.629354 11431 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.159.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.159.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.159.195
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:40.631383 11431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:40.633371 11117 catalog_manager.cc:1651] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 01:49:40.633826 11431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260925 01:49:40.645151 11446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:40.645179 11445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:40.645933 11448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:40.647966 11431 server_base.cc:1061] running on GCE node
I20260925 01:49:40.648602 11431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:49:40.649595 11431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:40.650825 11431 hybrid_clock.cc:648] HybridClock initialized: now 1790300980650782 us; error 63 us; skew 500 ppm
I20260925 01:49:40.651182 11431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:49:40.653357 11431 webserver.cc:533] Webserver started at http://127.10.159.195:40811/ using document root <none> and password file <none>
I20260925 01:49:40.654215 11431 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:40.654357 11431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:40.654735 11431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 01:49:40.657243 11431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data/instance:
uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
format_stamp: "Formatted at 2026-09-25 01:49:40 on dist-test-slave-xxxl"
I20260925 01:49:40.658037 11431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/instance:
uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
format_stamp: "Formatted at 2026-09-25 01:49:40 on dist-test-slave-xxxl"
I20260925 01:49:40.663506 11431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260925 01:49:40.667197 11454 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:40.668758 11431 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260925 01:49:40.668962 11431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal
uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
format_stamp: "Formatted at 2026-09-25 01:49:40 on dist-test-slave-xxxl"
I20260925 01:49:40.669189 11431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:40.691123 11431 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:40.692126 11431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:40.692416 11431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:40.693462 11431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260925 01:49:40.695261 11431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 01:49:40.695392 11431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:40.695523 11431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260925 01:49:40.695608 11431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:40.733289 11431 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.195:45589
I20260925 01:49:40.733345 11568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.195:45589 every 8 connection(s)
I20260925 01:49:40.734997 11431 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/data/info.pb
I20260925 01:49:40.743161 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 11431
I20260925 01:49:40.743402 10879 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/instance
I20260925 01:49:40.755540 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:49:40.755785 11570 heartbeater.cc:344] Connected to a master server at 127.10.159.254:40913
I20260925 01:49:40.755972 11570 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:40.755978 11571 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:40.756107 11425 heartbeater.cc:499] Master 127.10.159.252:44823 was elected leader, sending a full tablet report...
I20260925 01:49:40.757164 11571 heartbeater.cc:507] Master 127.10.159.253:42889 requested a full tablet report, sending...
I20260925 01:49:40.758001 11569 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:40.758188 11569 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:40.758616 11570 heartbeater.cc:507] Master 127.10.159.254:40913 requested a full tablet report, sending...
I20260925 01:49:40.758800 11569 heartbeater.cc:507] Master 127.10.159.252:44823 requested a full tablet report, sending...
I20260925 01:49:40.759209 10990 ts_manager.cc:194] Registered new tserver with Master: 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:40.759840 10918 ts_manager.cc:194] Registered new tserver with Master: 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:40.761225 10918 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.10.159.195:51833
I20260925 01:49:40.762333 11062 ts_manager.cc:194] Registered new tserver with Master: 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:40.780754 10879 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260925 01:49:40.817814 10918 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_fcf0ad41be3f4cf0bec1c1232482a0d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:40.817669 10916 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_11e017cb9d974161828f12b912b86015"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:40.819279 10919 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_f753f432c5264d9399607b334195d845"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:40.820488 10914 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_d4e9b5f0793b49f98a0f7b40a32e1a3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:40.820812 10916 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11e017cb9d974161828f12b912b86015 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:40.821071 10919 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f753f432c5264d9399607b334195d845 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:40.821439 10914 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4e9b5f0793b49f98a0f7b40a32e1a3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:40.820813 10918 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcf0ad41be3f4cf0bec1c1232482a0d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:40.821877 10913 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_740c58ebe5d44423a2bc68ccede38272"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:40.824733 10913 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_740c58ebe5d44423a2bc68ccede38272 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:40.821847 10917 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_385efc7a6717414e9ba0e1ec7e7382b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:40.827239 10915 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_03dc5f4623ad4030b29563d81f49e14d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:40.828681 10915 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03dc5f4623ad4030b29563d81f49e14d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:40.830377 10909 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_71172e0180b64f14a6f7c6f39f26a447"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:40.831178 10909 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71172e0180b64f14a6f7c6f39f26a447 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:40.833971 10917 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:40.833055 10910 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_c7551c285d614e408f7784bdb7535702"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:40.836514 10910 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7551c285d614e408f7784bdb7535702 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:40.835757 10912 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59896:
name: "default.Table_e04f8a75de294166807ae892ada52d44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:40.838904 10912 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e04f8a75de294166807ae892ada52d44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:40.844513 11072 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 2 FOLLOWER]: Refusing update from remote peer 17a1694989f748dfa9cdb2c10f3f1de5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260925 01:49:40.845593 11437 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 01:49:40.847759 11000 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 2 FOLLOWER]: Refusing update from remote peer 17a1694989f748dfa9cdb2c10f3f1de5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20260925 01:49:40.849121 11435 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 01:49:40.854588 11434 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1694989f748dfa9cdb2c10f3f1de5. Latest consensus state: current_term: 2 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:40.854867 11434 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:40.858913 11609 mvcc.cc:204] Tried to move back new op lower bound from 7333072817513992192 to 7333072815666221056. Current Snapshot: MvccSnapshot[applied={T|T < 7333072817513992192}]
I20260925 01:49:40.861483 11438 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1694989f748dfa9cdb2c10f3f1de5. Latest consensus state: current_term: 2 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:40.861732 11438 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:40.874315 11438 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:40.874555 11438 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:40.874801 11434 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:40.875003 11434 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:40.882428 10914 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59896:
table { table_name: "default.Table_fcf0ad41be3f4cf0bec1c1232482a0d3" } new_table_name: "default.Table_fc17121a61824d04b8430e1c61d48de9" modify_external_catalogs: true
I20260925 01:49:40.885087 11437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:40.885916 11437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:40.887184 10918 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59896:
table { table_name: "default.Table_d4e9b5f0793b49f98a0f7b40a32e1a3a" } new_table_name: "default.Table_4ed532a0734c4f35949fe170b6a3d36c" modify_external_catalogs: true
I20260925 01:49:40.889700 11437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:40.889982 11437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:40.890966 11607 mvcc.cc:204] Tried to move back new op lower bound from 7333072817552695296 to 7333072815666221056. Current Snapshot: MvccSnapshot[applied={T|T < 7333072817552695296}]
I20260925 01:49:40.891780 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 10887
I20260925 01:49:40.893435 10949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 01:49:41.012405 10915 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59896:
table { table_name: "default.Table_03dc5f4623ad4030b29563d81f49e14d" } new_table_name: "default.Table_fbdf63c5c7d641c58cb07c1933e7212d" modify_external_catalogs: true
I20260925 01:49:41.014812 10879 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAIg11R/build/asan/bin/kudu with pid 10887
W20260925 01:49:41.040103 11047 connection.cc:573] server connection from 127.0.0.1:55078 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:49:41.040740 10975 connection.cc:573] server connection from 127.0.0.1:38288 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:49:41.041015 11576 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.159.254:40913)
W20260925 01:49:41.041735 11576 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.159.254:40913)
I20260925 01:49:41.235414 11289 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
W20260925 01:49:41.237074 11289 heartbeater.cc:646] Failed to heartbeat to 127.10.159.254:40913 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.159.254:40913: connect: Connection refused (error 111)
I20260925 01:49:41.255254 11426 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
W20260925 01:49:41.257014 11426 heartbeater.cc:646] Failed to heartbeat to 127.10.159.254:40913 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.159.254:40913: connect: Connection refused (error 111)
I20260925 01:49:41.264055 11570 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
W20260925 01:49:41.265530 11570 heartbeater.cc:646] Failed to heartbeat to 127.10.159.254:40913 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.159.254:40913: connect: Connection refused (error 111)
I20260925 01:49:41.513123 11631 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:49:41.513408 11631 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:41.514297 11631 leader_election.cc:290] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889)
I20260925 01:49:41.514961 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 3 candidate_status { last_received { term: 2 index: 15 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" is_pre_election: true
I20260925 01:49:41.515231 11000 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca2cee7752c249f68a372ef5c6a18bff in term 2.
W20260925 01:49:41.515513 11046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.159.254:40913: connect: Connection refused (error 111)
I20260925 01:49:41.515954 11049 leader_election.cc:304] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca2cee7752c249f68a372ef5c6a18bff, ec2f98d6295c4f8ead68b46f01e73d37; no voters:
I20260925 01:49:41.516338 11631 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 01:49:41.517374 11631 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:49:41.517522 11631 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 2 FOLLOWER]: Advancing to term 3
W20260925 01:49:41.518031 11046 leader_election.cc:336] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913): Network error: Client connection negotiation failed: client connection to 127.10.159.254:40913: connect: Connection refused (error 111)
I20260925 01:49:41.519994 11631 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:41.520618 11631 leader_election.cc:290] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 3 election: Requested vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889)
I20260925 01:49:41.521189 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 3 candidate_status { last_received { term: 2 index: 15 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
I20260925 01:49:41.521435 11000 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 2 FOLLOWER]: Advancing to term 3
W20260925 01:49:41.522096 11046 leader_election.cc:336] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913): Network error: Client connection negotiation failed: client connection to 127.10.159.254:40913: connect: Connection refused (error 111)
I20260925 01:49:41.523710 11000 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca2cee7752c249f68a372ef5c6a18bff in term 3.
I20260925 01:49:41.524164 11049 leader_election.cc:304] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ca2cee7752c249f68a372ef5c6a18bff, ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5
I20260925 01:49:41.524499 11631 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 3 FOLLOWER]: Leader election won for term 3
I20260925 01:49:41.524852 11631 raft_consensus.cc:697] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 3 LEADER]: Becoming Leader. State: Replica: ca2cee7752c249f68a372ef5c6a18bff, State: Running, Role: LEADER
I20260925 01:49:41.525174 11631 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.15, Last appended by leader: 15, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:41.526240 11634 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca2cee7752c249f68a372ef5c6a18bff. Latest consensus state: current_term: 3 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:41.526464 11634 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:41.571445 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.254:40913
--webserver_interface=127.10.159.254
--webserver_port=33981
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260925 01:49:41.925859 11636 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:41.926292 11636 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:41.926470 11636 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:41.935664 11636 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 01:49:41.935791 11636 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:41.935889 11636 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 01:49:41.935971 11636 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260925 01:49:41.940696 11000 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 3 FOLLOWER]: Refusing update from remote peer ca2cee7752c249f68a372ef5c6a18bff: Log matching property violated. Preceding OpId in replica: term: 2 index: 15. Preceding OpId from leader: term: 3 index: 16. (index mismatch)
I20260925 01:49:41.941560 11634 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 01:49:41.943638 11643 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca2cee7752c249f68a372ef5c6a18bff. Latest consensus state: current_term: 3 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:41.943915 11643 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:41.950599 11636 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.254:40913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.159.254
--webserver_port=33981
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:41.952955 11636 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:41.953612 11643 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:41.953796 11643 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:41.955526 11636 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260925 01:49:41.955626 11634 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:41.956084 11634 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: LEADER
W20260925 01:49:41.957214 11046 consensus_peers.cc:597] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff -> Peer 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913): Couldn't send request to peer 17a1694989f748dfa9cdb2c10f3f1de5. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.254:40913: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:41.964107 11654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:41.964154 11655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:49:41.965368 11657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:41.965705 11636 server_base.cc:1061] running on GCE node
I20260925 01:49:41.966434 11636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:49:41.967732 11636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:41.968966 11636 hybrid_clock.cc:648] HybridClock initialized: now 1790300981968918 us; error 37 us; skew 500 ppm
I20260925 01:49:41.969324 11636 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:49:41.972075 11636 webserver.cc:533] Webserver started at http://127.10.159.254:33981/ using document root <none> and password file <none>
I20260925 01:49:41.972815 11636 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:41.972976 11636 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:41.978569 11636 fs_manager.cc:714] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260925 01:49:41.981441 11663 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:41.982976 11636 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:41.983186 11636 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
uuid: "17a1694989f748dfa9cdb2c10f3f1de5"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:49:41.983914 11636 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:41.999358 11636 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:42.000218 11636 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:42.000520 11636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:42.023304 11636 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.254:40913
I20260925 01:49:42.023304 11715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.254:40913 every 8 connection(s)
I20260925 01:49:42.024957 11636 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-0/data/info.pb
I20260925 01:49:42.032132 11716 sys_catalog.cc:263] Verifying existing consensus state
I20260925 01:49:42.032428 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 11636
I20260925 01:49:42.036513 11716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Bootstrap starting.
I20260925 01:49:42.043740 11635 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260925 01:49:42.046612 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_d4e9b5f0793b49f98a0f7b40a32e1a3a [id=0974d15f11e64c96987f3a0a03dd2561]
I20260925 01:49:42.047199 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]
I20260925 01:49:42.047642 11716 log.cc:826] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Log is configured to *not* fsync() on all Append() calls
I20260925 01:49:42.047719 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_c7551c285d614e408f7784bdb7535702 [id=4fb54256e58245988a5cc88ce6565832]
I20260925 01:49:42.048143 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_f753f432c5264d9399607b334195d845 [id=5bd8ff335261411fba51131e4dde1ea7]
I20260925 01:49:42.048556 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_03dc5f4623ad4030b29563d81f49e14d [id=65e9375237aa43ee950d4883b6028392]
I20260925 01:49:42.048931 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]
I20260925 01:49:42.049275 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_fcf0ad41be3f4cf0bec1c1232482a0d3 [id=c168421652804e92b137fe7114d3055c]
I20260925 01:49:42.049630 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]
I20260925 01:49:42.049959 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]
I20260925 01:49:42.050336 11635 catalog_manager.cc:692] Loaded metadata for table default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]
I20260925 01:49:42.051753 11635 tablet_loader.cc:96] loaded metadata for tablet 437bbb14fd264180887c0f5aa2ce80ea (table default.Table_c7551c285d614e408f7784bdb7535702 [id=4fb54256e58245988a5cc88ce6565832])
I20260925 01:49:42.052098 11635 tablet_loader.cc:96] loaded metadata for tablet 7900db92b35048aaa200ed3183031d6b (table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38])
I20260925 01:49:42.052378 11635 tablet_loader.cc:96] loaded metadata for tablet 81c7e15700f64a92b87a6901950c5412 (table default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd])
I20260925 01:49:42.052642 11635 tablet_loader.cc:96] loaded metadata for tablet 9884d7af60324a24ad06d6fa5db358b2 (table default.Table_03dc5f4623ad4030b29563d81f49e14d [id=65e9375237aa43ee950d4883b6028392])
I20260925 01:49:42.052901 11635 tablet_loader.cc:96] loaded metadata for tablet a26b7ec7373d42668f40c7c89084be47 (table default.Table_d4e9b5f0793b49f98a0f7b40a32e1a3a [id=0974d15f11e64c96987f3a0a03dd2561])
I20260925 01:49:42.053151 11635 tablet_loader.cc:96] loaded metadata for tablet ae497a92e49746a79cbbfe3c82b2b544 (table default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b])
I20260925 01:49:42.053426 11635 tablet_loader.cc:96] loaded metadata for tablet b96b272afb8341dd9bfff9702c433026 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219])
I20260925 01:49:42.053670 11635 tablet_loader.cc:96] loaded metadata for tablet bfd9645cd6644a55997eb7745c7b29f2 (table default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0])
I20260925 01:49:42.053978 11635 tablet_loader.cc:96] loaded metadata for tablet e4683df170284c228a08df5422e37d16 (table default.Table_f753f432c5264d9399607b334195d845 [id=5bd8ff335261411fba51131e4dde1ea7])
I20260925 01:49:42.054324 11635 tablet_loader.cc:96] loaded metadata for tablet e506eeed137e42e18e4d0e340d148aa8 (table default.Table_fcf0ad41be3f4cf0bec1c1232482a0d3 [id=c168421652804e92b137fe7114d3055c])
I20260925 01:49:42.054574 11635 catalog_manager.cc:1533] Initializing Kudu cluster ID...
I20260925 01:49:42.055789 11635 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:42.055948 11635 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260925 01:49:42.057512 11635 catalog_manager.cc:1553] Loading token signing keys...
I20260925 01:49:42.062685 11635 catalog_manager.cc:6230] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Loaded TSK: 0
I20260925 01:49:42.063493 11635 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260925 01:49:42.066447 11716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=10 ignored=0} inserts{seen=13 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 7 replicates
I20260925 01:49:42.067183 11716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Bootstrap complete.
I20260925 01:49:42.072685 11716 raft_consensus.cc:359] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 FOLLOWER]: Replica starting. Triggering 7 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:42.076287 11716 raft_consensus.cc:740] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a1694989f748dfa9cdb2c10f3f1de5, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.077128 11716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 2.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:42.078119 11722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:42.078420 11722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:42.079332 11716 sys_catalog.cc:565] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 01:49:42.089636 11733 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:42.089766 11733 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: loading cluster ID for follower catalog manager: success
I20260925 01:49:42.094198 11733 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: acquiring CA information for follower catalog manager: success
I20260925 01:49:42.097105 11733 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 01:49:42.116551 11062 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_03dc5f4623ad4030b29563d81f49e14d" } new_table_name: "default.Table_fbdf63c5c7d641c58cb07c1933e7212d" modify_external_catalogs: true
I20260925 01:49:42.117503 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_f753f432c5264d9399607b334195d845"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.118130 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_385efc7a6717414e9ba0e1ec7e7382b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.118603 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_740c58ebe5d44423a2bc68ccede38272"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.118881 11053 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_11e017cb9d974161828f12b912b86015"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.119624 11053 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11e017cb9d974161828f12b912b86015 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.119923 11057 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_e04f8a75de294166807ae892ada52d44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.120517 11053 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_dd472a545fa145b599c65f1b20b2f3c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.120620 11057 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e04f8a75de294166807ae892ada52d44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.120980 11053 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd472a545fa145b599c65f1b20b2f3c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.121147 11057 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_1a5715b7bd804e7aad63efef52e55956"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.121577 11057 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a5715b7bd804e7aad63efef52e55956 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.122367 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_71172e0180b64f14a6f7c6f39f26a447"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.122956 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71172e0180b64f14a6f7c6f39f26a447 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.123416 11054 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.123507 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_18f5a52dafd04314a7e789c9949e8adb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.123930 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18f5a52dafd04314a7e789c9949e8adb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.119647 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_740c58ebe5d44423a2bc68ccede38272 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.124636 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_a9aeb9619da84a399199c8b13f36a3b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.125077 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9aeb9619da84a399199c8b13f36a3b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.125371 11060 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_fcf0ad41be3f4cf0bec1c1232482a0d3" } new_table_name: "default.Table_fc17121a61824d04b8430e1c61d48de9" modify_external_catalogs: true
I20260925 01:49:42.126906 11061 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_d4e9b5f0793b49f98a0f7b40a32e1a3a" } new_table_name: "default.Table_4ed532a0734c4f35949fe170b6a3d36c" modify_external_catalogs: true
I20260925 01:49:42.128752 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_c7551c285d614e408f7784bdb7535702"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.129412 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7551c285d614e408f7784bdb7535702 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.131608 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f753f432c5264d9399607b334195d845 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.123957 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_d76ece082b4743ed8fac6623dcaf6bd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.133046 11054 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d76ece082b4743ed8fac6623dcaf6bd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.134356 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_9ef5c3e705a5472e95916b5b9e5a6700"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.134788 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ef5c3e705a5472e95916b5b9e5a6700 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.135658 11062 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9884d7af60324a24ad06d6fa5db358b2 has no consensus state
I20260925 01:49:42.136154 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_dfdbd4d77293412d8acb6101d0b62ca6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.136600 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfdbd4d77293412d8acb6101d0b62ca6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.142148 11060 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e506eeed137e42e18e4d0e340d148aa8 has no consensus state
I20260925 01:49:42.148833 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_cd496f8fcb914871b803c090201fccaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.149492 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd496f8fcb914871b803c090201fccaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.149652 11061 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a26b7ec7373d42668f40c7c89084be47 has no consensus state
I20260925 01:49:42.150233 11061 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_18f5a52dafd04314a7e789c9949e8adb" } modify_external_catalogs: true
I20260925 01:49:42.150429 11061 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_18f5a52dafd04314a7e789c9949e8adb" } modify_external_catalogs: true
I20260925 01:49:42.150403 11053 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_341225ca03144c9e9075e5939566ceae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.150840 11053 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_341225ca03144c9e9075e5939566ceae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.151713 11060 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_fc17121a61824d04b8430e1c61d48de9" } modify_external_catalogs: true
I20260925 01:49:42.151878 11060 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_fc17121a61824d04b8430e1c61d48de9" } modify_external_catalogs: true
I20260925 01:49:42.152791 11062 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_dd472a545fa145b599c65f1b20b2f3c2" } new_table_name: "default.Table_a6b26d6f652748f68b7f3da24bd2c126" modify_external_catalogs: true
I20260925 01:49:42.153136 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_91898e72d7854ba2b9c085048d7e0b95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.153695 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91898e72d7854ba2b9c085048d7e0b95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.159557 11057 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_a9aeb9619da84a399199c8b13f36a3b2" } new_table_name: "default.Table_8855b825d776480aaf4e160d16693e45" modify_external_catalogs: true
I20260925 01:49:42.160626 11054 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_fbdf63c5c7d641c58cb07c1933e7212d" } modify_external_catalogs: true
I20260925 01:49:42.160821 11054 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_fbdf63c5c7d641c58cb07c1933e7212d" } modify_external_catalogs: true
I20260925 01:49:42.162442 11055 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_4ed532a0734c4f35949fe170b6a3d36c" } modify_external_catalogs: true
I20260925 01:49:42.162631 11055 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_4ed532a0734c4f35949fe170b6a3d36c" } modify_external_catalogs: true
I20260925 01:49:42.169476 11058 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_1a5715b7bd804e7aad63efef52e55956" } modify_external_catalogs: true
I20260925 01:49:42.169679 11058 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_1a5715b7bd804e7aad63efef52e55956" } modify_external_catalogs: true
I20260925 01:49:42.171049 11061 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 07739fef9eb2479e97467f55eb400f64
W20260925 01:49:42.179167 11062 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f07f754fa5b748a1a25d43e6011c5460 has no consensus state
W20260925 01:49:42.179623 11057 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6837562b484242e5bf2b4eb085de7ac4 has no consensus state
W20260925 01:49:42.181468 11049 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet a26b7ec7373d42668f40c7c89084be47 (table default.Table_4ed532a0734c4f35949fe170b6a3d36c [id=0974d15f11e64c96987f3a0a03dd2561], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a26b7ec7373d42668f40c7c89084be47 consensus state has no leader
I20260925 01:49:42.200169 11054 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 9884d7af60324a24ad06d6fa5db358b2
I20260925 01:49:42.203725 11058 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet ca996d19167647a2ba67f81207452a68
I20260925 01:49:42.204145 11055 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet a26b7ec7373d42668f40c7c89084be47
I20260925 01:49:42.205026 11060 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:42.214650 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.217312 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.217682 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet e506eeed137e42e18e4d0e340d148aa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.217000 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 7900db92b35048aaa200ed3183031d6b (DEFAULT_TABLE table=default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.218009 11498 tablet_service.cc:1511] Processing CreateTablet for tablet a26b7ec7373d42668f40c7c89084be47 (DEFAULT_TABLE table=default.Table_4ed532a0734c4f35949fe170b6a3d36c [id=0974d15f11e64c96987f3a0a03dd2561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.218523 11503 tablet_service.cc:1511] Processing CreateTablet for tablet bfd9645cd6644a55997eb7745c7b29f2 (DEFAULT_TABLE table=default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.219202 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a26b7ec7373d42668f40c7c89084be47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.219340 11501 tablet_service.cc:1511] Processing CreateTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 (DEFAULT_TABLE table=default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.220072 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae497a92e49746a79cbbfe3c82b2b544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.221207 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 (DEFAULT_TABLE table=default.Table_fbdf63c5c7d641c58cb07c1933e7212d [id=65e9375237aa43ee950d4883b6028392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.221719 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9884d7af60324a24ad06d6fa5db358b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.222352 11497 tablet_service.cc:1511] Processing CreateTablet for tablet e4683df170284c228a08df5422e37d16 (DEFAULT_TABLE table=default.Table_f753f432c5264d9399607b334195d845 [id=5bd8ff335261411fba51131e4dde1ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.222847 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4683df170284c228a08df5422e37d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.223553 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd9645cd6644a55997eb7745c7b29f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.223573 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 437bbb14fd264180887c0f5aa2ce80ea (DEFAULT_TABLE table=default.Table_c7551c285d614e408f7784bdb7535702 [id=4fb54256e58245988a5cc88ce6565832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.224201 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437bbb14fd264180887c0f5aa2ce80ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.217093 11502 tablet_service.cc:1511] Processing CreateTablet for tablet b96b272afb8341dd9bfff9702c433026 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.224762 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b96b272afb8341dd9bfff9702c433026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.223555 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 81c7e15700f64a92b87a6901950c5412 (DEFAULT_TABLE table=default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.225407 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7900db92b35048aaa200ed3183031d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.225677 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c7e15700f64a92b87a6901950c5412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.226464 11500 tablet_service.cc:1511] Processing CreateTablet for tablet e506eeed137e42e18e4d0e340d148aa8 (DEFAULT_TABLE table=default.Table_fc17121a61824d04b8430e1c61d48de9 [id=c168421652804e92b137fe7114d3055c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.227054 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e506eeed137e42e18e4d0e340d148aa8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:42.231959 11047 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a26b7ec7373d42668f40c7c89084be47 because the tablet was not found. No further retry: Not found: Tablet not found: a26b7ec7373d42668f40c7c89084be47
W20260925 01:49:42.232328 11047 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9884d7af60324a24ad06d6fa5db358b2 because the tablet was not found. No further retry: Not found: Tablet not found: 9884d7af60324a24ad06d6fa5db358b2
W20260925 01:49:42.232498 11047 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e506eeed137e42e18e4d0e340d148aa8 because the tablet was not found. No further retry: Not found: Tablet not found: e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:42.235960 11492 tablet_service.cc:1511] Processing CreateTablet for tablet bb82b7b398f040da8d14725d74eafd64 (DEFAULT_TABLE table=default.Table_91898e72d7854ba2b9c085048d7e0b95 [id=fb4d1c608ffb4982afe923ea6e8103af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.236545 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb82b7b398f040da8d14725d74eafd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.243088 11491 tablet_service.cc:1511] Processing CreateTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 (DEFAULT_TABLE table=default.Table_cd496f8fcb914871b803c090201fccaf [id=3437d40bf64c4d299fea4ecb2b8c776e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.243858 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac03ebbd455f4fad88e875b69a049bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.253301 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet e506eeed137e42e18e4d0e340d148aa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.255538 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.257432 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 437bbb14fd264180887c0f5aa2ce80ea (DEFAULT_TABLE table=default.Table_c7551c285d614e408f7784bdb7535702 [id=4fb54256e58245988a5cc88ce6565832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.258343 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.258855 11354 tablet_service.cc:1511] Processing CreateTablet for tablet e4683df170284c228a08df5422e37d16 (DEFAULT_TABLE table=default.Table_f753f432c5264d9399607b334195d845 [id=5bd8ff335261411fba51131e4dde1ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.259372 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437bbb14fd264180887c0f5aa2ce80ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.259423 11359 tablet_service.cc:1511] Processing CreateTablet for tablet b96b272afb8341dd9bfff9702c433026 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.259958 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b96b272afb8341dd9bfff9702c433026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.260607 11347 tablet_service.cc:1511] Processing CreateTablet for tablet c96165d1a85d4ee99748563078ae2a3e (DEFAULT_TABLE table=default.Table_9ef5c3e705a5472e95916b5b9e5a6700 [id=ca8c84b0f3fd4aac9fb747b21cfec090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.260766 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 81c7e15700f64a92b87a6901950c5412 (DEFAULT_TABLE table=default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.261278 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96165d1a85d4ee99748563078ae2a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.261510 11358 tablet_service.cc:1511] Processing CreateTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 (DEFAULT_TABLE table=default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.262123 11357 tablet_service.cc:1511] Processing CreateTablet for tablet e506eeed137e42e18e4d0e340d148aa8 (DEFAULT_TABLE table=default.Table_fc17121a61824d04b8430e1c61d48de9 [id=c168421652804e92b137fe7114d3055c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.262244 11348 tablet_service.cc:1511] Processing CreateTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 (DEFAULT_TABLE table=default.Table_cd496f8fcb914871b803c090201fccaf [id=3437d40bf64c4d299fea4ecb2b8c776e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.262601 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e506eeed137e42e18e4d0e340d148aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.262665 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 7900db92b35048aaa200ed3183031d6b (DEFAULT_TABLE table=default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.263171 11494 tablet_service.cc:1511] Processing CreateTablet for tablet c96165d1a85d4ee99748563078ae2a3e (DEFAULT_TABLE table=default.Table_9ef5c3e705a5472e95916b5b9e5a6700 [id=ca8c84b0f3fd4aac9fb747b21cfec090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.263199 11350 tablet_service.cc:1511] Processing CreateTablet for tablet bb82b7b398f040da8d14725d74eafd64 (DEFAULT_TABLE table=default.Table_91898e72d7854ba2b9c085048d7e0b95 [id=fb4d1c608ffb4982afe923ea6e8103af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.263629 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96165d1a85d4ee99748563078ae2a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.257897 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 (DEFAULT_TABLE table=default.Table_fbdf63c5c7d641c58cb07c1933e7212d [id=65e9375237aa43ee950d4883b6028392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.264514 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4683df170284c228a08df5422e37d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.265344 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c7e15700f64a92b87a6901950c5412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.265887 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae497a92e49746a79cbbfe3c82b2b544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.266253 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet e506eeed137e42e18e4d0e340d148aa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.267280 11490 tablet_service.cc:1511] Processing CreateTablet for tablet da74fa4b6fa841b7aebb81302cab2885 (DEFAULT_TABLE table=default.Table_d76ece082b4743ed8fac6623dcaf6bd2 [id=dc9445c2dde34bba98e731c1cdf445d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.267721 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da74fa4b6fa841b7aebb81302cab2885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.269793 11489 tablet_service.cc:1511] Processing CreateTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 (DEFAULT_TABLE table=default.Table_341225ca03144c9e9075e5939566ceae [id=55b54d01f7634e9583dd4f3e1f1776fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.270365 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6058cd7c17b4544a565a5aacfb9df92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.271347 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.271903 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.274859 11208 tablet_service.cc:1511] Processing CreateTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 (DEFAULT_TABLE table=default.Table_cd496f8fcb914871b803c090201fccaf [id=3437d40bf64c4d299fea4ecb2b8c776e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.276738 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac03ebbd455f4fad88e875b69a049bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.277450 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 (DEFAULT_TABLE table=default.Table_8855b825d776480aaf4e160d16693e45 [id=f9b577b7907e4fae8cb2e498a2f59035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.277969 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6837562b484242e5bf2b4eb085de7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.278208 11216 tablet_service.cc:1511] Processing CreateTablet for tablet e4683df170284c228a08df5422e37d16 (DEFAULT_TABLE table=default.Table_f753f432c5264d9399607b334195d845 [id=5bd8ff335261411fba51131e4dde1ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.278697 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4683df170284c228a08df5422e37d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.281234 11219 tablet_service.cc:1511] Processing CreateTablet for tablet e506eeed137e42e18e4d0e340d148aa8 (DEFAULT_TABLE table=default.Table_fc17121a61824d04b8430e1c61d48de9 [id=c168421652804e92b137fe7114d3055c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.281762 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e506eeed137e42e18e4d0e340d148aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.282233 11207 tablet_service.cc:1511] Processing CreateTablet for tablet c96165d1a85d4ee99748563078ae2a3e (DEFAULT_TABLE table=default.Table_9ef5c3e705a5472e95916b5b9e5a6700 [id=ca8c84b0f3fd4aac9fb747b21cfec090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.282821 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c96165d1a85d4ee99748563078ae2a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.285238 11487 tablet_service.cc:1511] Processing CreateTablet for tablet f07f754fa5b748a1a25d43e6011c5460 (DEFAULT_TABLE table=default.Table_a6b26d6f652748f68b7f3da24bd2c126 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.285849 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07f754fa5b748a1a25d43e6011c5460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.285796 11209 tablet_service.cc:1511] Processing CreateTablet for tablet bb82b7b398f040da8d14725d74eafd64 (DEFAULT_TABLE table=default.Table_91898e72d7854ba2b9c085048d7e0b95 [id=fb4d1c608ffb4982afe923ea6e8103af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.286345 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb82b7b398f040da8d14725d74eafd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.288447 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 81c7e15700f64a92b87a6901950c5412 (DEFAULT_TABLE table=default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.288920 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c7e15700f64a92b87a6901950c5412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.293321 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (DEFAULT_TABLE table=default.Table_dfdbd4d77293412d8acb6101d0b62ca6 [id=f14bcaf842ad44929f252de69d2c40a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.293846 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef1b5f18d074016a6dea82da8e2d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.294270 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 7900db92b35048aaa200ed3183031d6b (DEFAULT_TABLE table=default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.294771 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7900db92b35048aaa200ed3183031d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.298259 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 (DEFAULT_TABLE table=default.Table_fbdf63c5c7d641c58cb07c1933e7212d [id=65e9375237aa43ee950d4883b6028392]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.298907 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9884d7af60324a24ad06d6fa5db358b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.302284 11222 tablet_service.cc:1511] Processing CreateTablet for tablet bfd9645cd6644a55997eb7745c7b29f2 (DEFAULT_TABLE table=default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.302861 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd9645cd6644a55997eb7745c7b29f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.307034 11220 tablet_service.cc:1511] Processing CreateTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 (DEFAULT_TABLE table=default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.307878 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae497a92e49746a79cbbfe3c82b2b544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.306982 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 437bbb14fd264180887c0f5aa2ce80ea (DEFAULT_TABLE table=default.Table_c7551c285d614e408f7784bdb7535702 [id=4fb54256e58245988a5cc88ce6565832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.310040 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437bbb14fd264180887c0f5aa2ce80ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.313097 11221 tablet_service.cc:1511] Processing CreateTablet for tablet b96b272afb8341dd9bfff9702c433026 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.313671 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b96b272afb8341dd9bfff9702c433026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.317870 11355 tablet_service.cc:1511] Processing CreateTablet for tablet a26b7ec7373d42668f40c7c89084be47 (DEFAULT_TABLE table=default.Table_4ed532a0734c4f35949fe170b6a3d36c [id=0974d15f11e64c96987f3a0a03dd2561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.323181 11360 tablet_service.cc:1511] Processing CreateTablet for tablet bfd9645cd6644a55997eb7745c7b29f2 (DEFAULT_TABLE table=default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.274781 11217 tablet_service.cc:1511] Processing CreateTablet for tablet a26b7ec7373d42668f40c7c89084be47 (DEFAULT_TABLE table=default.Table_4ed532a0734c4f35949fe170b6a3d36c [id=0974d15f11e64c96987f3a0a03dd2561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.327445 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a26b7ec7373d42668f40c7c89084be47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.336581 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac03ebbd455f4fad88e875b69a049bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.345842 11060 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_e25d501e9e454462828e4dcdb99c8c92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.345901 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_27810a101f1848a1b8319368749cf79a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.346627 11060 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e25d501e9e454462828e4dcdb99c8c92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.346719 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27810a101f1848a1b8319368749cf79a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.348345 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_ba17d67b0999413dbf51440ca53e6853"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.348914 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba17d67b0999413dbf51440ca53e6853 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.350162 11054 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_cd496f8fcb914871b803c090201fccaf" } new_table_name: "default.Table_b775943c54c743268de0fee47941a7e9" modify_external_catalogs: true
I20260925 01:49:42.350668 11057 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_341225ca03144c9e9075e5939566ceae" } new_table_name: "default.Table_2ba2a8cd4c204308b6bd353a094dafe4" modify_external_catalogs: true
I20260925 01:49:42.353363 11062 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_dfdbd4d77293412d8acb6101d0b62ca6" } new_table_name: "default.Table_4be0241c731440cbbcf5b535939ff384" modify_external_catalogs: true
I20260925 01:49:42.357971 11212 tablet_service.cc:1511] Processing CreateTablet for tablet da74fa4b6fa841b7aebb81302cab2885 (DEFAULT_TABLE table=default.Table_d76ece082b4743ed8fac6623dcaf6bd2 [id=dc9445c2dde34bba98e731c1cdf445d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.358731 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da74fa4b6fa841b7aebb81302cab2885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.362484 11213 tablet_service.cc:1511] Processing CreateTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 (DEFAULT_TABLE table=default.Table_341225ca03144c9e9075e5939566ceae [id=55b54d01f7634e9583dd4f3e1f1776fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.362672 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_0c46d8b6e1044a3d9607e1d5577f5798"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.363139 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6058cd7c17b4544a565a5aacfb9df92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:42.363302 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c46d8b6e1044a3d9607e1d5577f5798 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.364579 11061 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_1913d6e93ce5481fb37de0218cbf3057"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.365145 11061 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1913d6e93ce5481fb37de0218cbf3057 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.367179 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 (DEFAULT_TABLE table=default.Table_8855b825d776480aaf4e160d16693e45 [id=f9b577b7907e4fae8cb2e498a2f59035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.367748 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6837562b484242e5bf2b4eb085de7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:42.369277 11057 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6058cd7c17b4544a565a5aacfb9df92 consensus state has no leader
W20260925 01:49:42.370085 11062 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ef1b5f18d074016a6dea82da8e2d2b2 consensus state has no leader
W20260925 01:49:42.370651 11054 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac03ebbd455f4fad88e875b69a049bc0 consensus state has no leader
I20260925 01:49:42.370836 11205 tablet_service.cc:1511] Processing CreateTablet for tablet f07f754fa5b748a1a25d43e6011c5460 (DEFAULT_TABLE table=default.Table_a6b26d6f652748f68b7f3da24bd2c126 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.371402 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07f754fa5b748a1a25d43e6011c5460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.373648 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_c6206da59ecf432cb4c65623ced807f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.374221 11054 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6206da59ecf432cb4c65623ced807f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.375578 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (DEFAULT_TABLE table=default.Table_dfdbd4d77293412d8acb6101d0b62ca6 [id=f14bcaf842ad44929f252de69d2c40a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.376119 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef1b5f18d074016a6dea82da8e2d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.376806 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_00be63d6c7f14b3d9fe02213f2b47430"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.377441 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00be63d6c7f14b3d9fe02213f2b47430 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.380128 11062 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_2ba2a8cd4c204308b6bd353a094dafe4" } modify_external_catalogs: true
I20260925 01:49:42.380323 11062 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_2ba2a8cd4c204308b6bd353a094dafe4" } modify_external_catalogs: true
I20260925 01:49:42.382531 11057 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_b775943c54c743268de0fee47941a7e9" } new_table_name: "default.Table_09a5b65cdd904adcbe454a84c2a999a8" modify_external_catalogs: true
I20260925 01:49:42.382735 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_691fb438533845f28d06c6bbb6f2996d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.383296 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_691fb438533845f28d06c6bbb6f2996d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.381100 11060 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_7cc3b8c6b31b42e4813477df8a30a4a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.384054 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_b7dbe7b919444a46896861a3c081f0f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.384222 11060 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cc3b8c6b31b42e4813477df8a30a4a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.384543 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7dbe7b919444a46896861a3c081f0f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.385438 11053 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_a6b26d6f652748f68b7f3da24bd2c126" } new_table_name: "default.Table_ca31e318b1904d1cb03064d0a3d43cf2" modify_external_catalogs: true
I20260925 01:49:42.393321 11754 tablet_bootstrap.cc:492] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:42.396032 11570 heartbeater.cc:344] Connected to a master server at 127.10.159.254:40913
I20260925 01:49:42.396267 11570 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
I20260925 01:49:42.398218 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 (DEFAULT_TABLE table=default.Table_e25d501e9e454462828e4dcdb99c8c92 [id=4936b4c5822241e78c7004d9f7ba3f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.398634 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e008337914841b8a1ab4a64ecc6e181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.401028 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 (DEFAULT_TABLE table=default.Table_e25d501e9e454462828e4dcdb99c8c92 [id=4936b4c5822241e78c7004d9f7ba3f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.401607 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e008337914841b8a1ab4a64ecc6e181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.404644 11680 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" instance_seqno: 1790300980724084) as {username='slave'} at 127.10.159.195:44907; Asking this server to re-register.
I20260925 01:49:42.411679 11570 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:42.415068 11680 ts_manager.cc:194] Registered new tserver with Master: 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:42.417014 11059 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_9ef5c3e705a5472e95916b5b9e5a6700" } modify_external_catalogs: true
I20260925 01:49:42.417220 11059 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_9ef5c3e705a5472e95916b5b9e5a6700" } modify_external_catalogs: true
I20260925 01:49:42.417747 11061 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_91898e72d7854ba2b9c085048d7e0b95" } modify_external_catalogs: true
I20260925 01:49:42.417912 11061 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_91898e72d7854ba2b9c085048d7e0b95" } modify_external_catalogs: true
I20260925 01:49:42.421684 11054 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_8855b825d776480aaf4e160d16693e45" } modify_external_catalogs: true
I20260925 01:49:42.421868 11054 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_8855b825d776480aaf4e160d16693e45" } modify_external_catalogs: true
I20260925 01:49:42.422612 11058 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_27810a101f1848a1b8319368749cf79a" } modify_external_catalogs: true
I20260925 01:49:42.422775 11058 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_27810a101f1848a1b8319368749cf79a" } modify_external_catalogs: true
W20260925 01:49:42.423293 11057 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac03ebbd455f4fad88e875b69a049bc0 consensus state has no leader
W20260925 01:49:42.423889 11053 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f07f754fa5b748a1a25d43e6011c5460 consensus state has no leader
I20260925 01:49:42.429303 11062 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:42.430647 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.432787 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
W20260925 01:49:42.433969 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f6058cd7c17b4544a565a5aacfb9df92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6058cd7c17b4544a565a5aacfb9df92 already in progress: creating tablet
I20260925 01:49:42.443698 11500 tablet_service.cc:1511] Processing CreateTablet for tablet a65faada47c34cd1908970460d3d3f6b (DEFAULT_TABLE table=default.Table_27810a101f1848a1b8319368749cf79a [id=b931f965b8bf4871849dc5a4613dc04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.444165 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a65faada47c34cd1908970460d3d3f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.446529 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9558462332400d92f7d61858bdeca2 (DEFAULT_TABLE table=default.Table_ba17d67b0999413dbf51440ca53e6853 [id=a0a49bae7a7d45bd85e1f50591b3fd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.447031 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9558462332400d92f7d61858bdeca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.447142 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9558462332400d92f7d61858bdeca2 (DEFAULT_TABLE table=default.Table_ba17d67b0999413dbf51440ca53e6853 [id=a0a49bae7a7d45bd85e1f50591b3fd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.447613 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9558462332400d92f7d61858bdeca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.449774 11058 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:42.450971 11054 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 6837562b484242e5bf2b4eb085de7ac4
I20260925 01:49:42.451768 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.452466 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
W20260925 01:49:42.453070 11047 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a65faada47c34cd1908970460d3d3f6b because the tablet was not found. No further retry: Not found: Tablet not found: a65faada47c34cd1908970460d3d3f6b
W20260925 01:49:42.453352 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 6837562b484242e5bf2b4eb085de7ac4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6837562b484242e5bf2b4eb085de7ac4 already in progress: creating tablet
I20260925 01:49:42.457410 11061 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet bb82b7b398f040da8d14725d74eafd64
I20260925 01:49:42.457791 11059 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet c96165d1a85d4ee99748563078ae2a3e
I20260925 01:49:42.459646 11219 tablet_service.cc:1511] Processing CreateTablet for tablet a65faada47c34cd1908970460d3d3f6b (DEFAULT_TABLE table=default.Table_27810a101f1848a1b8319368749cf79a [id=b931f965b8bf4871849dc5a4613dc04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.460132 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a65faada47c34cd1908970460d3d3f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.461575 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.461827 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
W20260925 01:49:42.465803 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c96165d1a85d4ee99748563078ae2a3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c96165d1a85d4ee99748563078ae2a3e already in progress: creating tablet
W20260925 01:49:42.466146 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bb82b7b398f040da8d14725d74eafd64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb82b7b398f040da8d14725d74eafd64 already in progress: creating tablet
I20260925 01:49:42.470090 11722 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:42.470402 11722 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:42.472945 11722 leader_election.cc:290] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:49:42.474380 11000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" is_pre_election: true
I20260925 01:49:42.475449 11690 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 01:49:42.484351 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a26b7ec7373d42668f40c7c89084be47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.487008 11346 tablet_service.cc:1511] Processing CreateTablet for tablet da74fa4b6fa841b7aebb81302cab2885 (DEFAULT_TABLE table=default.Table_d76ece082b4743ed8fac6623dcaf6bd2 [id=dc9445c2dde34bba98e731c1cdf445d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.487788 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da74fa4b6fa841b7aebb81302cab2885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.490873 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:49:42.499620 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 (DEFAULT_TABLE table=default.Table_7cc3b8c6b31b42e4813477df8a30a4a2 [id=1250f31018b04ced9587bb443f4091ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.499758 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 018525730c4e4134ab3a0506f1a0a6fa (DEFAULT_TABLE table=default.Table_0c46d8b6e1044a3d9607e1d5577f5798 [id=ceda87d047234cf5885f9bd05d6abd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.499871 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 5b65068a447744ec99e56489963b251c (DEFAULT_TABLE table=default.Table_c6206da59ecf432cb4c65623ced807f5 [id=fe56a57c1dff44e09680b6041eeafac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.500150 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95dfbc1ce9db4f01bf6ec8965b62c994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.500249 11498 tablet_service.cc:1511] Processing CreateTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 (DEFAULT_TABLE table=default.Table_00be63d6c7f14b3d9fe02213f2b47430 [id=8b010808af904c9e8948017b036169ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.500361 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018525730c4e4134ab3a0506f1a0a6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.500572 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1cbf07e15440c7919a4bbcd937fb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.505164 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b65068a447744ec99e56489963b251c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.509202 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 200caea41ba4466386b091875f017956 (DEFAULT_TABLE table=default.Table_b7dbe7b919444a46896861a3c081f0f0 [id=9389812769844f279c1e0c5fa9707dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.509649 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200caea41ba4466386b091875f017956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.510610 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9884d7af60324a24ad06d6fa5db358b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.511404 11501 tablet_service.cc:1511] Processing CreateTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 (DEFAULT_TABLE table=default.Table_1913d6e93ce5481fb37de0218cbf3057 [id=df29f1da8f2e40a49c55d44c0a0e11f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.511835 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc1cd6e88764445b0a1fdc92e0c53e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.512284 11664 leader_election.cc:304] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17a1694989f748dfa9cdb2c10f3f1de5; no voters: ca2cee7752c249f68a372ef5c6a18bff, ec2f98d6295c4f8ead68b46f01e73d37
I20260925 01:49:42.516973 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 (DEFAULT_TABLE table=default.Table_8855b825d776480aaf4e160d16693e45 [id=f9b577b7907e4fae8cb2e498a2f59035]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.519923 11690 pending_rounds.cc:85] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Aborting all ops after (but not including) 15
I20260925 01:49:42.520191 11690 pending_rounds.cc:107] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Aborting uncommitted WRITE_OP operation due to leader change: 2.16
I20260925 01:49:42.520881 11690 pending_rounds.cc:107] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Aborting uncommitted WRITE_OP operation due to leader change: 2.17
I20260925 01:49:42.511426 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe (DEFAULT_TABLE table=default.Table_691fb438533845f28d06c6bbb6f2996d [id=a3021d36f54a4fe3b92a782c075015f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.521278 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4e94cdafd343ee8a84c64668fe48fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.525135 11289 heartbeater.cc:344] Connected to a master server at 127.10.159.254:40913
I20260925 01:49:42.529584 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.530469 11289 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
I20260925 01:49:42.540987 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (DEFAULT_TABLE table=default.Table_dfdbd4d77293412d8acb6101d0b62ca6 [id=f14bcaf842ad44929f252de69d2c40a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.541273 11754 tablet_bootstrap.cc:654] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.544008 11753 tablet_bootstrap.cc:492] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:42.541957 11345 tablet_service.cc:1511] Processing CreateTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 (DEFAULT_TABLE table=default.Table_341225ca03144c9e9075e5939566ceae [id=55b54d01f7634e9583dd4f3e1f1776fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.548516 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfd9645cd6644a55997eb7745c7b29f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.550166 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.550395 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.550717 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 (DEFAULT_TABLE table=default.Table_7cc3b8c6b31b42e4813477df8a30a4a2 [id=1250f31018b04ced9587bb443f4091ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.551064 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95dfbc1ce9db4f01bf6ec8965b62c994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.555275 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.557359 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7900db92b35048aaa200ed3183031d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.558784 11344 tablet_service.cc:1511] Processing CreateTablet for tablet f07f754fa5b748a1a25d43e6011c5460 (DEFAULT_TABLE table=default.Table_a6b26d6f652748f68b7f3da24bd2c126 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.559234 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.559703 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 4d9558462332400d92f7d61858bdeca2 (DEFAULT_TABLE table=default.Table_ba17d67b0999413dbf51440ca53e6853 [id=a0a49bae7a7d45bd85e1f50591b3fd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.562466 11354 tablet_service.cc:1511] Processing CreateTablet for tablet a65faada47c34cd1908970460d3d3f6b (DEFAULT_TABLE table=default.Table_27810a101f1848a1b8319368749cf79a [id=b931f965b8bf4871849dc5a4613dc04b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.564694 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 (DEFAULT_TABLE table=default.Table_e25d501e9e454462828e4dcdb99c8c92 [id=4936b4c5822241e78c7004d9f7ba3f78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.566414 11753 tablet_bootstrap.cc:654] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.567925 11753 log.cc:826] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Log is configured to *not* fsync() on all Append() calls
I20260925 01:49:42.570329 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb82b7b398f040da8d14725d74eafd64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.573748 11061 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_e25d501e9e454462828e4dcdb99c8c92" } new_table_name: "default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d" modify_external_catalogs: true
I20260925 01:49:42.575584 11054 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_4be0241c731440cbbcf5b535939ff384" } new_table_name: "default.Table_ac39b8cafe374ba5b6ff562e28552e83" modify_external_catalogs: true
I20260925 01:49:42.576315 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9558462332400d92f7d61858bdeca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.581122 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_63b71c4cf1634d2aa8b517954ab683c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.581734 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63b71c4cf1634d2aa8b517954ab683c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.582456 11753 tablet_bootstrap.cc:492] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:42.575601 11059 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_1913d6e93ce5481fb37de0218cbf3057" } new_table_name: "default.Table_078cedcd7539492394b2472609504297" modify_external_catalogs: true
I20260925 01:49:42.582880 11753 ts_tablet_manager.cc:1403] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.040s user 0.013s sys 0.000s
I20260925 01:49:42.584793 11062 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_f27e3f7daa4e4b24a4ba5ef004408b43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.585362 11062 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f27e3f7daa4e4b24a4ba5ef004408b43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.586781 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_9b30dd028f974131a81b424ab13625ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.587373 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b30dd028f974131a81b424ab13625ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.588133 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6058cd7c17b4544a565a5aacfb9df92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.593776 11753 raft_consensus.cc:359] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:42.594566 11054 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ef1b5f18d074016a6dea82da8e2d2b2 consensus state has no leader
W20260925 01:49:42.599448 11061 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e008337914841b8a1ab4a64ecc6e181 consensus state has no leader
I20260925 01:49:42.599470 11753 raft_consensus.cc:385] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.599601 11753 raft_consensus.cc:740] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.600477 11753 consensus_queue.cc:260] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.610481 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 200caea41ba4466386b091875f017956 (DEFAULT_TABLE table=default.Table_b7dbe7b919444a46896861a3c081f0f0 [id=9389812769844f279c1e0c5fa9707dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.610944 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 018525730c4e4134ab3a0506f1a0a6fa (DEFAULT_TABLE table=default.Table_0c46d8b6e1044a3d9607e1d5577f5798 [id=ceda87d047234cf5885f9bd05d6abd7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:42.612252 11059 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afc1cd6e88764445b0a1fdc92e0c53e5 consensus state has no leader
I20260925 01:49:42.614494 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200caea41ba4466386b091875f017956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.615527 11203 tablet_service.cc:1511] Processing CreateTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 (DEFAULT_TABLE table=default.Table_00be63d6c7f14b3d9fe02213f2b47430 [id=8b010808af904c9e8948017b036169ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.616266 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe (DEFAULT_TABLE table=default.Table_691fb438533845f28d06c6bbb6f2996d [id=a3021d36f54a4fe3b92a782c075015f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.616917 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 5b65068a447744ec99e56489963b251c (DEFAULT_TABLE table=default.Table_c6206da59ecf432cb4c65623ced807f5 [id=fe56a57c1dff44e09680b6041eeafac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.617416 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_fdcdf308781f4f5ab7f4be9110e4434a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.618081 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdcdf308781f4f5ab7f4be9110e4434a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.618619 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018525730c4e4134ab3a0506f1a0a6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.618867 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b65068a447744ec99e56489963b251c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.619613 11062 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_be377ab2f3c84ec19dcd33e5d8a2d509"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.620157 11062 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be377ab2f3c84ec19dcd33e5d8a2d509 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.622263 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4e94cdafd343ee8a84c64668fe48fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.622568 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1cbf07e15440c7919a4bbcd937fb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.627038 11061 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_cfa072796d2244a5a5d4c70b7c18e2c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.627300 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_f50309f126184cd5ba98431310f154f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.627046 11060 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_f27e3f7daa4e4b24a4ba5ef004408b43" } new_table_name: "default.Table_cfe6eab0e20b4395bac0c7c4e39622bb" modify_external_catalogs: true
I20260925 01:49:42.628118 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_d269df93086941b38d069192be3f4af1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.629303 11053 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_ac39b8cafe374ba5b6ff562e28552e83" } new_table_name: "default.Table_c383e2f971b14d51820bf155099ad75b" modify_external_catalogs: true
I20260925 01:49:42.631146 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_2bbfc5ac490540948fe80f6bff26007b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.632388 11057 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_d7a7cc2075104b02ab8785b3d474847a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.638777 11754 log.cc:826] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Log is configured to *not* fsync() on all Append() calls
W20260925 01:49:42.652281 11061 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfa072796d2244a5a5d4c70b7c18e2c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.652387 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d269df93086941b38d069192be3f4af1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.652325 11057 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7a7cc2075104b02ab8785b3d474847a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.652281 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bbfc5ac490540948fe80f6bff26007b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.653628 11054 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f50309f126184cd5ba98431310f154f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.659376 11058 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_d76ece082b4743ed8fac6623dcaf6bd2" } modify_external_catalogs: true
W20260925 01:49:42.659533 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e506eeed137e42e18e4d0e340d148aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e506eeed137e42e18e4d0e340d148aa8 already in progress: creating tablet
I20260925 01:49:42.659610 11058 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_d76ece082b4743ed8fac6623dcaf6bd2" } modify_external_catalogs: true
W20260925 01:49:42.660280 11047 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9884d7af60324a24ad06d6fa5db358b2 because the tablet was not found. No further retry: Not found: Tablet not found: 9884d7af60324a24ad06d6fa5db358b2
W20260925 01:49:42.662609 11047 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a26b7ec7373d42668f40c7c89084be47 because the tablet was not found. No further retry: Not found: Tablet not found: a26b7ec7373d42668f40c7c89084be47
W20260925 01:49:42.663584 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f6058cd7c17b4544a565a5aacfb9df92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6058cd7c17b4544a565a5aacfb9df92 already in progress: creating tablet
W20260925 01:49:42.664202 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a65faada47c34cd1908970460d3d3f6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a65faada47c34cd1908970460d3d3f6b already in progress: creating tablet
I20260925 01:49:42.664155 11055 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d" } modify_external_catalogs: true
I20260925 01:49:42.664492 11055 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d" } modify_external_catalogs: true
W20260925 01:49:42.664791 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bb82b7b398f040da8d14725d74eafd64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb82b7b398f040da8d14725d74eafd64 already in progress: creating tablet
W20260925 01:49:42.665366 11047 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c96165d1a85d4ee99748563078ae2a3e because the tablet was not found. No further retry: Not found: Tablet not found: c96165d1a85d4ee99748563078ae2a3e
W20260925 01:49:42.665968 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 6837562b484242e5bf2b4eb085de7ac4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6837562b484242e5bf2b4eb085de7ac4 already in progress: creating tablet
I20260925 01:49:42.668174 11209 tablet_service.cc:1511] Processing CreateTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 (DEFAULT_TABLE table=default.Table_1913d6e93ce5481fb37de0218cbf3057 [id=df29f1da8f2e40a49c55d44c0a0e11f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.668576 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc1cd6e88764445b0a1fdc92e0c53e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.676766 11753 ts_tablet_manager.cc:1434] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.094s user 0.020s sys 0.037s
I20260925 01:49:42.679525 11569 heartbeater.cc:499] Master 127.10.159.252:44823 was elected leader, sending a full tablet report...
W20260925 01:49:42.682080 11060 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 491d790067644090aa4d25f4060cc2ec has no consensus state
I20260925 01:49:42.682502 11060 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_7cc3b8c6b31b42e4813477df8a30a4a2" } modify_external_catalogs: true
I20260925 01:49:42.682726 11060 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_7cc3b8c6b31b42e4813477df8a30a4a2" } modify_external_catalogs: true
W20260925 01:49:42.683573 11053 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ef1b5f18d074016a6dea82da8e2d2b2 consensus state has no leader
I20260925 01:49:42.687059 11753 tablet_bootstrap.cc:492] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:42.692198 11062 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_078cedcd7539492394b2472609504297" } modify_external_catalogs: true
I20260925 01:49:42.692569 11062 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_078cedcd7539492394b2472609504297" } modify_external_catalogs: true
I20260925 01:49:42.693115 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.693404 11755 tablet_bootstrap.cc:492] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:42.695703 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.696712 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.698315 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 (DEFAULT_TABLE table=default.Table_7cc3b8c6b31b42e4813477df8a30a4a2 [id=1250f31018b04ced9587bb443f4091ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.701469 11753 tablet_bootstrap.cc:654] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.701660 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.701665 11057 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_691fb438533845f28d06c6bbb6f2996d" } modify_external_catalogs: true
I20260925 01:49:42.701841 11057 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_691fb438533845f28d06c6bbb6f2996d" } modify_external_catalogs: true
I20260925 01:49:42.702198 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 018525730c4e4134ab3a0506f1a0a6fa (DEFAULT_TABLE table=default.Table_0c46d8b6e1044a3d9607e1d5577f5798 [id=ceda87d047234cf5885f9bd05d6abd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.706233 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e008337914841b8a1ab4a64ecc6e181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.708101 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6837562b484242e5bf2b4eb085de7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.710706 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018525730c4e4134ab3a0506f1a0a6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.712078 11348 tablet_service.cc:1511] Processing CreateTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 (DEFAULT_TABLE table=default.Table_00be63d6c7f14b3d9fe02213f2b47430 [id=8b010808af904c9e8948017b036169ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.712201 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef1b5f18d074016a6dea82da8e2d2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.712371 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a65faada47c34cd1908970460d3d3f6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:42.714151 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e506eeed137e42e18e4d0e340d148aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e506eeed137e42e18e4d0e340d148aa8 already in progress: creating tablet
W20260925 01:49:42.714437 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a26b7ec7373d42668f40c7c89084be47 because the tablet was not found. No further retry: Not found: Tablet not found: a26b7ec7373d42668f40c7c89084be47
W20260925 01:49:42.714664 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9884d7af60324a24ad06d6fa5db358b2 because the tablet was not found. No further retry: Not found: Tablet not found: 9884d7af60324a24ad06d6fa5db358b2
W20260925 01:49:42.714846 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f6058cd7c17b4544a565a5aacfb9df92 because the tablet was not found. No further retry: Not found: Tablet not found: f6058cd7c17b4544a565a5aacfb9df92
W20260925 01:49:42.715288 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 6837562b484242e5bf2b4eb085de7ac4 because the tablet was not found. No further retry: Not found: Tablet not found: 6837562b484242e5bf2b4eb085de7ac4
W20260925 01:49:42.715502 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bb82b7b398f040da8d14725d74eafd64 because the tablet was not found. No further retry: Not found: Tablet not found: bb82b7b398f040da8d14725d74eafd64
I20260925 01:49:42.715512 11753 tablet_bootstrap.cc:492] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:42.715665 11753 ts_tablet_manager.cc:1403] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
W20260925 01:49:42.715718 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c96165d1a85d4ee99748563078ae2a3e because the tablet was not found. No further retry: Not found: Tablet not found: c96165d1a85d4ee99748563078ae2a3e
W20260925 01:49:42.715911 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a65faada47c34cd1908970460d3d3f6b because the tablet was not found. No further retry: Not found: Tablet not found: a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:42.716642 11753 raft_consensus.cc:359] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.716872 11753 raft_consensus.cc:385] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.716970 11753 raft_consensus.cc:740] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.717259 11753 consensus_queue.cc:260] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.720647 11753 ts_tablet_manager.cc:1434] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:49:42.721096 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07f754fa5b748a1a25d43e6011c5460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.722254 11753 tablet_bootstrap.cc:492] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:42.724850 11753 tablet_bootstrap.cc:654] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.729849 11754 tablet_bootstrap.cc:492] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:42.730086 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1cbf07e15440c7919a4bbcd937fb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.730221 11754 ts_tablet_manager.cc:1403] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.337s user 0.009s sys 0.004s
I20260925 01:49:42.736028 11350 tablet_service.cc:1511] Processing CreateTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 (DEFAULT_TABLE table=default.Table_1913d6e93ce5481fb37de0218cbf3057 [id=df29f1da8f2e40a49c55d44c0a0e11f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.738415 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 5b65068a447744ec99e56489963b251c (DEFAULT_TABLE table=default.Table_c6206da59ecf432cb4c65623ced807f5 [id=fe56a57c1dff44e09680b6041eeafac5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:42.743597 11572 tablet.cc:2433] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 01:49:42.747035 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe (DEFAULT_TABLE table=default.Table_691fb438533845f28d06c6bbb6f2996d [id=a3021d36f54a4fe3b92a782c075015f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.747437 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 200caea41ba4466386b091875f017956 (DEFAULT_TABLE table=default.Table_b7dbe7b919444a46896861a3c081f0f0 [id=9389812769844f279c1e0c5fa9707dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.747527 11755 tablet_bootstrap.cc:654] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.757143 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 491d790067644090aa4d25f4060cc2ec (DEFAULT_TABLE table=default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.757603 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491d790067644090aa4d25f4060cc2ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.761497 11209 tablet_service.cc:1511] Processing CreateTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb (DEFAULT_TABLE table=default.Table_9b30dd028f974131a81b424ab13625ac [id=464edb71967c4016ae7592aaad5492d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.762046 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42d96d45e8c4e8e8bee374477cfb0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.762547 11496 tablet_service.cc:1511] Processing CreateTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb (DEFAULT_TABLE table=default.Table_9b30dd028f974131a81b424ab13625ac [id=464edb71967c4016ae7592aaad5492d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.763048 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42d96d45e8c4e8e8bee374477cfb0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.766414 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 491d790067644090aa4d25f4060cc2ec (DEFAULT_TABLE table=default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.770548 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491d790067644090aa4d25f4060cc2ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.776153 11753 tablet_bootstrap.cc:492] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:42.777441 11753 ts_tablet_manager.cc:1403] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.000s
I20260925 01:49:42.782591 11753 raft_consensus.cc:359] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.783097 11753 raft_consensus.cc:385] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.783281 11753 raft_consensus.cc:740] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.784027 11753 consensus_queue.cc:260] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.789332 11753 ts_tablet_manager.cc:1434] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260925 01:49:42.793740 11753 tablet_bootstrap.cc:492] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:42.801699 11753 tablet_bootstrap.cc:654] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.805495 11054 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_cfa072796d2244a5a5d4c70b7c18e2c0" } new_table_name: "default.Table_12863b20d1544e0f9c998bc0d9c032a4" modify_external_catalogs: true
I20260925 01:49:42.806458 11059 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_be377ab2f3c84ec19dcd33e5d8a2d509" } new_table_name: "default.Table_8f04a495ad294ac38a1fe39d586033d7" modify_external_catalogs: true
I20260925 01:49:42.822937 11753 tablet_bootstrap.cc:492] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:42.823252 11753 ts_tablet_manager.cc:1403] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.003s
I20260925 01:49:42.824220 11753 raft_consensus.cc:359] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.824527 11753 raft_consensus.cc:385] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.824690 11753 raft_consensus.cc:740] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.825050 11753 consensus_queue.cc:260] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.825608 11056 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_c383e2f971b14d51820bf155099ad75b" } new_table_name: "default.Table_878267640acb42138a736804f08162e1" modify_external_catalogs: true
I20260925 01:49:42.826136 11061 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_3ef5451781f248de82a72b9782090c78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.826856 11061 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ef5451781f248de82a72b9782090c78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.828245 11753 ts_tablet_manager.cc:1434] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:49:42.830770 11753 tablet_bootstrap.cc:492] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:42.831641 11059 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c75a4ed161734d30ab5ad2e2b00d77c9 has no consensus state
I20260925 01:49:42.833266 11753 tablet_bootstrap.cc:654] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.833977 11053 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_c383e2f971b14d51820bf155099ad75b [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 3 got 0
I20260925 01:49:42.834430 11053 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4e008337914841b8a1ab4a64ecc6e181 (table default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d [id=4936b4c5822241e78c7004d9f7ba3f78]). Expected version 1 got 0
I20260925 01:49:42.835237 11053 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:42.835553 11053 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ac03ebbd455f4fad88e875b69a049bc0 (table default.Table_09a5b65cdd904adcbe454a84c2a999a8 [id=3437d40bf64c4d299fea4ecb2b8c776e]). Expected version 2 got 0
I20260925 01:49:42.837438 11060 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 95dfbc1ce9db4f01bf6ec8965b62c994
I20260925 01:49:42.839279 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.839592 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_7abda750abd14e078780e34ba4951149"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.840188 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95dfbc1ce9db4f01bf6ec8965b62c994 already in progress: creating tablet
W20260925 01:49:42.840340 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7abda750abd14e078780e34ba4951149 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.842334 11057 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 8d4e94cdafd343ee8a84c64668fe48fe
I20260925 01:49:42.844343 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.844986 11058 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet da74fa4b6fa841b7aebb81302cab2885
W20260925 01:49:42.845489 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d4e94cdafd343ee8a84c64668fe48fe already in progress: creating tablet
I20260925 01:49:42.846522 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:42.846547 11062 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet afc1cd6e88764445b0a1fdc92e0c53e5
I20260925 01:49:42.837952 11754 raft_consensus.cc:359] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.848017 11753 tablet_bootstrap.cc:492] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:49:42.848152 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet da74fa4b6fa841b7aebb81302cab2885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da74fa4b6fa841b7aebb81302cab2885 already in progress: creating tablet
I20260925 01:49:42.848361 11753 ts_tablet_manager.cc:1403] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.005s
I20260925 01:49:42.849053 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
W20260925 01:49:42.849807 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet afc1cd6e88764445b0a1fdc92e0c53e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afc1cd6e88764445b0a1fdc92e0c53e5 already in progress: creating tablet
I20260925 01:49:42.849714 11753 raft_consensus.cc:359] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.850144 11753 raft_consensus.cc:385] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.850286 11753 raft_consensus.cc:740] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.850714 11753 consensus_queue.cc:260] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.849784 11754 raft_consensus.cc:385] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.852721 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.769474 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 491d790067644090aa4d25f4060cc2ec (DEFAULT_TABLE table=default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.788514 11355 tablet_service.cc:1511] Processing CreateTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb (DEFAULT_TABLE table=default.Table_9b30dd028f974131a81b424ab13625ac [id=464edb71967c4016ae7592aaad5492d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:42.854636 11753 ts_tablet_manager.cc:1434] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260925 01:49:42.851920 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
W20260925 01:49:42.855682 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet da74fa4b6fa841b7aebb81302cab2885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da74fa4b6fa841b7aebb81302cab2885 already in progress: creating tablet
I20260925 01:49:42.767992 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95dfbc1ce9db4f01bf6ec8965b62c994. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:42.856218 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet da74fa4b6fa841b7aebb81302cab2885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da74fa4b6fa841b7aebb81302cab2885 already in progress: creating tablet
I20260925 01:49:42.857749 11753 tablet_bootstrap.cc:492] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:42.852990 11754 raft_consensus.cc:740] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.858260 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.858412 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
W20260925 01:49:42.859576 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet afc1cd6e88764445b0a1fdc92e0c53e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afc1cd6e88764445b0a1fdc92e0c53e5 already in progress: creating tablet
I20260925 01:49:42.860638 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:42.861157 11753 tablet_bootstrap.cc:654] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:42.862249 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 because the tablet was not found. No further retry: Not found: Tablet not found: 95dfbc1ce9db4f01bf6ec8965b62c994
W20260925 01:49:42.862291 11047 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because the tablet was not found. No further retry: Not found: Tablet not found: 8d4e94cdafd343ee8a84c64668fe48fe
I20260925 01:49:42.862479 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
W20260925 01:49:42.863564 11047 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 because the tablet was not found. No further retry: Not found: Tablet not found: 95dfbc1ce9db4f01bf6ec8965b62c994
I20260925 01:49:42.865343 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491d790067644090aa4d25f4060cc2ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.867715 11426 heartbeater.cc:344] Connected to a master server at 127.10.159.254:40913
I20260925 01:49:42.868880 11062 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_4622efbdfda84c86bf2ee76b21029055"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.869642 11062 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4622efbdfda84c86bf2ee76b21029055 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.869578 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.872021 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc1cd6e88764445b0a1fdc92e0c53e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.872037 11426 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
I20260925 01:49:42.873142 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_7e3942ff37734d5aa89cfb724ea34ca7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.873770 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e3942ff37734d5aa89cfb724ea34ca7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:42.876111 11054 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ad258cd4788477ea5f9e34ebcab95c7 has no consensus state
W20260925 01:49:42.876577 11056 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ef1b5f18d074016a6dea82da8e2d2b2 consensus state has no leader
I20260925 01:49:42.876784 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:42.882087 11631 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:42.882352 11631 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: LEADER
W20260925 01:49:42.887032 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet afc1cd6e88764445b0a1fdc92e0c53e5 because the tablet was not found. No further retry: Not found: Tablet not found: afc1cd6e88764445b0a1fdc92e0c53e5
W20260925 01:49:42.887439 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because the tablet was not found. No further retry: Not found: Tablet not found: 8d4e94cdafd343ee8a84c64668fe48fe
I20260925 01:49:42.893981 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b65068a447744ec99e56489963b251c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.897657 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4e94cdafd343ee8a84c64668fe48fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.899772 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 200caea41ba4466386b091875f017956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.900960 11056 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_2bbfc5ac490540948fe80f6bff26007b" } new_table_name: "default.Table_26b2dc8b995c4ade91c9644f6535dc5c" modify_external_catalogs: true
I20260925 01:49:42.904627 11054 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_d269df93086941b38d069192be3f4af1" } new_table_name: "default.Table_579fc3540ec141c1a58dac6f0cce07e1" modify_external_catalogs: true
I20260925 01:49:42.906338 11722 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 01:49:42.907924 11057 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_fbd5f70a039148108c3037e797899417"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:42.908950 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c42d96d45e8c4e8e8bee374477cfb0bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:42.909060 11756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca2cee7752c249f68a372ef5c6a18bff. Latest consensus state: current_term: 3 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:42.910555 11756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:42.913071 11678 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" instance_seqno: 1790300980193841) as {username='slave'} at 127.10.159.194:58253; Asking this server to re-register.
I20260925 01:49:42.913801 11763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "ca2cee7752c249f68a372ef5c6a18bff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:42.914258 11763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:42.915906 11754 consensus_queue.cc:260] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.917729 11426 heartbeater.cc:461] Registering TS with master...
W20260925 01:49:42.919026 11057 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbd5f70a039148108c3037e797899417 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.920853 11060 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_ea9cb22dacf64efe966cbcfb02725dfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:42.921561 11060 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea9cb22dacf64efe966cbcfb02725dfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:42.922297 11679 ts_manager.cc:194] Registered new tserver with Master: aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:42.923447 11680 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" instance_seqno: 1790300979676140) as {username='slave'} at 127.10.159.193:42829; Asking this server to re-register.
I20260925 01:49:42.925365 11289 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:42.937856 11753 tablet_bootstrap.cc:492] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:42.938130 11753 ts_tablet_manager.cc:1403] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.080s user 0.016s sys 0.009s
I20260925 01:49:42.939594 11753 raft_consensus.cc:359] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.940276 11753 raft_consensus.cc:385] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.940503 11753 raft_consensus.cc:740] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.940935 11753 consensus_queue.cc:260] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.947046 11753 ts_tablet_manager.cc:1434] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260925 01:49:42.950373 11753 tablet_bootstrap.cc:492] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:42.954293 11753 tablet_bootstrap.cc:654] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.963843 11753 tablet_bootstrap.cc:492] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:42.964123 11753 ts_tablet_manager.cc:1403] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.002s
I20260925 01:49:42.965605 11753 raft_consensus.cc:359] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.966013 11753 raft_consensus.cc:385] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:42.966152 11753 raft_consensus.cc:740] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:42.966578 11753 consensus_queue.cc:260] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:42.973531 11753 ts_tablet_manager.cc:1434] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.000s sys 0.004s
I20260925 01:49:42.973631 11288 heartbeater.cc:499] Master 127.10.159.252:44823 was elected leader, sending a full tablet report...
I20260925 01:49:42.978165 11753 tablet_bootstrap.cc:492] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:42.981251 11753 tablet_bootstrap.cc:654] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.983134 11754 ts_tablet_manager.cc:1434] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.253s user 0.021s sys 0.029s
I20260925 01:49:42.985327 11754 tablet_bootstrap.cc:492] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:42.988896 11754 tablet_bootstrap.cc:654] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:42.991936 11755 log.cc:826] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Log is configured to *not* fsync() on all Append() calls
I20260925 01:49:43.005954 11680 ts_manager.cc:194] Registered new tserver with Master: b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:43.011864 11755 tablet_bootstrap.cc:492] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:43.012364 11755 ts_tablet_manager.cc:1403] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.417s user 0.003s sys 0.009s
I20260925 01:49:43.013228 11721 mvcc.cc:204] Tried to move back new op lower bound from 7333072824092622848 to 7333072820329017344. Current Snapshot: MvccSnapshot[applied={T|T < 7333072823936704512 or (T in {7333072823951147008,7333072824039383040,7333072824084561920})}]
I20260925 01:49:43.019155 11762 raft_consensus.cc:493] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.019500 11762 raft_consensus.cc:515] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.028445 11755 raft_consensus.cc:359] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.028937 11755 raft_consensus.cc:385] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.029091 11755 raft_consensus.cc:740] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.029896 11755 consensus_queue.cc:260] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.032555 11762 leader_election.cc:290] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.032835 11762 raft_consensus.cc:493] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.033525 11762 raft_consensus.cc:515] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.034224 11762 leader_election.cc:290] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.034574 11425 heartbeater.cc:499] Master 127.10.159.252:44823 was elected leader, sending a full tablet report...
I20260925 01:49:43.047824 11755 ts_tablet_manager.cc:1434] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.035s user 0.010s sys 0.000s
I20260925 01:49:43.048499 11755 tablet_bootstrap.cc:492] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:43.052779 11755 tablet_bootstrap.cc:654] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:43.063840 11056 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 105fd502b74d442eb5d5031f56e5cb62 has no consensus state
W20260925 01:49:43.065770 11054 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3da92b7f256647f19faeed66b4012438 has no consensus state
I20260925 01:49:43.066382 11054 master_service.cc:960] ReplaceTablet: received request to replace tablet ae497a92e49746a79cbbfe3c82b2b544 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.070142 11057 master_service.cc:960] ReplaceTablet: received request to replace tablet 81c7e15700f64a92b87a6901950c5412 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.072321 11060 master_service.cc:960] ReplaceTablet: received request to replace tablet b96b272afb8341dd9bfff9702c433026 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.072355 11754 tablet_bootstrap.cc:492] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:43.072585 11754 ts_tablet_manager.cc:1403] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.012s
I20260925 01:49:43.073603 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_854ab4951a1b404a99eb1caa32ea46e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.073675 11754 raft_consensus.cc:359] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.073886 11754 raft_consensus.cc:385] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.073967 11754 raft_consensus.cc:740] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:43.074447 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_854ab4951a1b404a99eb1caa32ea46e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.076658 11062 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_7b5309958b834d63b67d8a48293e5edd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.077381 11062 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b5309958b834d63b67d8a48293e5edd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.080084 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_f9512449d3e2408ca5f7970a505c860a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.080803 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9512449d3e2408ca5f7970a505c860a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.095112 11754 consensus_queue.cc:260] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.100417 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 3da92b7f256647f19faeed66b4012438 (DEFAULT_TABLE table=default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.100950 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da92b7f256647f19faeed66b4012438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.101239 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 3da92b7f256647f19faeed66b4012438 (DEFAULT_TABLE table=default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.101704 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da92b7f256647f19faeed66b4012438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.104815 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (DEFAULT_TABLE table=default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.105373 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad258cd4788477ea5f9e34ebcab95c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.105711 11754 ts_tablet_manager.cc:1434] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.033s user 0.003s sys 0.000s
I20260925 01:49:43.107239 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 29f28e49791744428729279a79b6c9f1 (DEFAULT_TABLE table=default.Table_d7a7cc2075104b02ab8785b3d474847a [id=f8317c3550b14fe3abf468ea0d755b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.107723 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f28e49791744428729279a79b6c9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.108738 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 (DEFAULT_TABLE table=default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.109181 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105fd502b74d442eb5d5031f56e5cb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.111929 11778 raft_consensus.cc:493] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.112287 11778 raft_consensus.cc:515] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.113245 11059 master_service.cc:960] ReplaceTablet: received request to replace tablet bb82b7b398f040da8d14725d74eafd64 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.113847 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (DEFAULT_TABLE table=default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.113945 11778 leader_election.cc:290] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.114511 11059 master_service.cc:960] ReplaceTablet: received request to replace tablet b96b272afb8341dd9bfff9702c433026 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.115078 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad258cd4788477ea5f9e34ebcab95c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.118391 11062 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_4f98d0836f1149fd9a9578a60d94de53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.118584 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 29f28e49791744428729279a79b6c9f1 (DEFAULT_TABLE table=default.Table_d7a7cc2075104b02ab8785b3d474847a [id=f8317c3550b14fe3abf468ea0d755b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.118973 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f28e49791744428729279a79b6c9f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:43.119105 11062 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f98d0836f1149fd9a9578a60d94de53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.120595 11058 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_4622efbdfda84c86bf2ee76b21029055" } modify_external_catalogs: true
I20260925 01:49:43.120855 11058 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_4622efbdfda84c86bf2ee76b21029055" } modify_external_catalogs: true
I20260925 01:49:43.124001 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 3da92b7f256647f19faeed66b4012438 (DEFAULT_TABLE table=default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.124471 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da92b7f256647f19faeed66b4012438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.125489 11057 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 81c7e15700f64a92b87a6901950c5412
I20260925 01:49:43.126091 11057 catalog_manager.cc:6934] ReplaceTablet: tablet 81c7e15700f64a92b87a6901950c5412 deleted and replaced by tablet 3d3626880758447e9aa85f8f9070d4e3
I20260925 01:49:43.128502 11057 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_c6206da59ecf432cb4c65623ced807f5" } modify_external_catalogs: true
I20260925 01:49:43.128727 11057 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_c6206da59ecf432cb4c65623ced807f5" } modify_external_catalogs: true
I20260925 01:49:43.130146 11054 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet ae497a92e49746a79cbbfe3c82b2b544
I20260925 01:49:43.130751 11054 catalog_manager.cc:6934] ReplaceTablet: tablet ae497a92e49746a79cbbfe3c82b2b544 deleted and replaced by tablet 60c40e2db5e2434192a359f50c02fe13
I20260925 01:49:43.132803 11060 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet b96b272afb8341dd9bfff9702c433026
I20260925 01:49:43.133294 11060 catalog_manager.cc:6934] ReplaceTablet: tablet b96b272afb8341dd9bfff9702c433026 deleted and replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4
I20260925 01:49:43.133725 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (DEFAULT_TABLE table=default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.134378 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad258cd4788477ea5f9e34ebcab95c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.135540 11061 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_878267640acb42138a736804f08162e1 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 4 got 0
I20260925 01:49:43.136390 11061 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 491d790067644090aa4d25f4060cc2ec (table default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]). Expected version 1 got 0
I20260925 01:49:43.136915 11061 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:43.137178 11061 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet ac03ebbd455f4fad88e875b69a049bc0 (table default.Table_09a5b65cdd904adcbe454a84c2a999a8 [id=3437d40bf64c4d299fea4ecb2b8c776e]). Expected version 2 got 0
I20260925 01:49:43.142481 11060 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_09a5b65cdd904adcbe454a84c2a999a8" } modify_external_catalogs: true
I20260925 01:49:43.142572 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.142778 11060 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_09a5b65cdd904adcbe454a84c2a999a8" } modify_external_catalogs: true
I20260925 01:49:43.143436 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.144131 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet b96b272afb8341dd9bfff9702c433026 with delete_type TABLET_DATA_DELETED (replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.144868 11054 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_b7dbe7b919444a46896861a3c081f0f0" } new_table_name: "default.Table_434ed55eea774802bad516c94af8ac39" modify_external_catalogs: true
W20260925 01:49:43.145176 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 81c7e15700f64a92b87a6901950c5412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81c7e15700f64a92b87a6901950c5412 already in progress: creating tablet
W20260925 01:49:43.145763 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ae497a92e49746a79cbbfe3c82b2b544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae497a92e49746a79cbbfe3c82b2b544 already in progress: creating tablet
W20260925 01:49:43.146255 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b96b272afb8341dd9bfff9702c433026 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b96b272afb8341dd9bfff9702c433026 already in progress: creating tablet
I20260925 01:49:43.146950 11059 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_cfe6eab0e20b4395bac0c7c4e39622bb" } modify_external_catalogs: true
I20260925 01:49:43.147245 11059 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_cfe6eab0e20b4395bac0c7c4e39622bb" } modify_external_catalogs: true
I20260925 01:49:43.148239 11778 raft_consensus.cc:493] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.148531 11778 raft_consensus.cc:515] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.149436 11778 leader_election.cc:290] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.150220 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 (DEFAULT_TABLE table=default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.150802 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105fd502b74d442eb5d5031f56e5cb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.155126 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 29f28e49791744428729279a79b6c9f1 (DEFAULT_TABLE table=default.Table_d7a7cc2075104b02ab8785b3d474847a [id=f8317c3550b14fe3abf468ea0d755b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.155493 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.155682 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f28e49791744428729279a79b6c9f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.155822 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet b96b272afb8341dd9bfff9702c433026 with delete_type TABLET_DATA_DELETED (replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.156258 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 86079f22abb74d438c61ecc2a7379cbd (DEFAULT_TABLE table=default.Table_fdcdf308781f4f5ab7f4be9110e4434a [id=0d689fa6870547f3a57c6b6149b94754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.154218 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 (DEFAULT_TABLE table=default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.157219 11754 tablet_bootstrap.cc:492] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:49:43.158221 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ae497a92e49746a79cbbfe3c82b2b544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae497a92e49746a79cbbfe3c82b2b544 already in progress: creating tablet
I20260925 01:49:43.157805 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86079f22abb74d438c61ecc2a7379cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.160501 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 86079f22abb74d438c61ecc2a7379cbd (DEFAULT_TABLE table=default.Table_fdcdf308781f4f5ab7f4be9110e4434a [id=0d689fa6870547f3a57c6b6149b94754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.160897 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86079f22abb74d438c61ecc2a7379cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.162388 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:34520
W20260925 01:49:43.162930 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b96b272afb8341dd9bfff9702c433026 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b96b272afb8341dd9bfff9702c433026 already in progress: creating tablet
W20260925 01:49:43.163547 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 81c7e15700f64a92b87a6901950c5412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81c7e15700f64a92b87a6901950c5412 already in progress: creating tablet
I20260925 01:49:43.163959 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105fd502b74d442eb5d5031f56e5cb62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.177446 11500 tablet_service.cc:1511] Processing CreateTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 (DEFAULT_TABLE table=default.Table_8f04a495ad294ac38a1fe39d586033d7 [id=3414ecadb9c24609b4011cc0ba7c73dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.178015 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75a4ed161734d30ab5ad2e2b00d77c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.184080 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 4195e3f8e93e40fe9dfd72710d319dca (DEFAULT_TABLE table=default.Table_f50309f126184cd5ba98431310f154f5 [id=f267d33f055e4d7ab6b7a96ae212365e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.184492 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4195e3f8e93e40fe9dfd72710d319dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.185400 11754 tablet_bootstrap.cc:654] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.185580 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.185717 11062 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_9b30dd028f974131a81b424ab13625ac" } new_table_name: "default.Table_497014a801f24f9aa384248a367ca1d7" modify_external_catalogs: true
I20260925 01:49:43.187140 11058 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet dcc1d24a48ec4527a29f4a12277e1f1a
I20260925 01:49:43.187588 11058 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_fbd5f70a039148108c3037e797899417" } new_table_name: "default.Table_7f0be4abc90a407dbc377d4fbe092f08" modify_external_catalogs: true
W20260925 01:49:43.191058 11047 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 4e008337914841b8a1ab4a64ecc6e181 (table default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d [id=4936b4c5822241e78c7004d9f7ba3f78], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4e008337914841b8a1ab4a64ecc6e181 consensus state has no leader
I20260925 01:49:43.189992 11056 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:43.198118 11209 tablet_service.cc:1511] Processing CreateTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 (DEFAULT_TABLE table=default.Table_8f04a495ad294ac38a1fe39d586033d7 [id=3414ecadb9c24609b4011cc0ba7c73dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.198173 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6058cd7c17b4544a565a5aacfb9df92" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.198648 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75a4ed161734d30ab5ad2e2b00d77c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.199054 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb82b7b398f040da8d14725d74eafd64" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.199529 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da74fa4b6fa841b7aebb81302cab2885" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.197436 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 4195e3f8e93e40fe9dfd72710d319dca (DEFAULT_TABLE table=default.Table_f50309f126184cd5ba98431310f154f5 [id=f267d33f055e4d7ab6b7a96ae212365e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.201725 11056 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_878267640acb42138a736804f08162e1 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 4 got 0
I20260925 01:49:43.202530 11056 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 491d790067644090aa4d25f4060cc2ec (table default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]). Expected version 1 got 0
I20260925 01:49:43.203398 11060 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet ac03ebbd455f4fad88e875b69a049bc0
I20260925 01:49:43.204573 11060 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_84048a62c4e54c64a5e7e0dc88e0291b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.205377 11060 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84048a62c4e54c64a5e7e0dc88e0291b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.207578 11055 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 4e008337914841b8a1ab4a64ecc6e181
W20260925 01:49:43.209321 11054 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 200caea41ba4466386b091875f017956 consensus state has no leader
W20260925 01:49:43.219976 11291 tablet.cc:2433] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 01:49:43.220860 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4195e3f8e93e40fe9dfd72710d319dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.232367 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.232144 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac03ebbd455f4fad88e875b69a049bc0" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.233126 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.235410 11754 tablet_bootstrap.cc:492] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:43.235620 11754 ts_tablet_manager.cc:1403] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.127s user 0.008s sys 0.015s
I20260925 01:49:43.236529 11754 raft_consensus.cc:359] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.236766 11754 raft_consensus.cc:385] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.236922 11754 raft_consensus.cc:740] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.237226 11754 consensus_queue.cc:260] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.237809 11754 ts_tablet_manager.cc:1434] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:43.238293 11754 tablet_bootstrap.cc:492] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:49:43.241245 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ac03ebbd455f4fad88e875b69a049bc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac03ebbd455f4fad88e875b69a049bc0 already in progress: creating tablet
W20260925 01:49:43.241565 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 4e008337914841b8a1ab4a64ecc6e181 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e008337914841b8a1ab4a64ecc6e181 already in progress: creating tablet
I20260925 01:49:43.243116 11057 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 5b65068a447744ec99e56489963b251c
W20260925 01:49:43.257819 11456 leader_election.cc:343] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:43.258278 11456 leader_election.cc:343] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.258260 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65068a447744ec99e56489963b251c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
W20260925 01:49:43.258512 11456 leader_election.cc:343] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:43.258754 11456 leader_election.cc:343] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:43.264668 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5b65068a447744ec99e56489963b251c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b65068a447744ec99e56489963b251c already in progress: creating tablet
I20260925 01:49:43.266685 11754 tablet_bootstrap.cc:654] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.268853 11057 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:43.269234 11057 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_878267640acb42138a736804f08162e1 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 4 got 0
I20260925 01:49:43.272588 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_d5da1b6d9d084929b15ee48a7144f38a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.273233 11054 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5da1b6d9d084929b15ee48a7144f38a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:43.274121 11062 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c42d96d45e8c4e8e8bee374477cfb0bb consensus state has no leader
I20260925 01:49:43.274652 11062 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_d7a7cc2075104b02ab8785b3d474847a" } new_table_name: "default.Table_05026612160046eb92a16de5dc86abf2" modify_external_catalogs: true
I20260925 01:49:43.274731 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_cffab5e8bd204a9db3001c3fc583958f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.274922 11754 tablet_bootstrap.cc:492] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:43.275194 11754 ts_tablet_manager.cc:1403] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.003s
W20260925 01:49:43.275321 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cffab5e8bd204a9db3001c3fc583958f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:43.276427 11058 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31fe174270f24ff780c212eaef90ef0d has no consensus state
I20260925 01:49:43.276420 11754 raft_consensus.cc:359] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.276623 11754 raft_consensus.cc:385] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.276764 11754 raft_consensus.cc:740] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.276985 11058 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_4f98d0836f1149fd9a9578a60d94de53" } new_table_name: "default.Table_cd22b64ded2d47498fba4bcaf54bc00a" modify_external_catalogs: true
I20260925 01:49:43.277064 11754 consensus_queue.cc:260] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.280822 11059 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 491d790067644090aa4d25f4060cc2ec
I20260925 01:49:43.281790 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_334a2d580acd443b905330d4680eec76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.282367 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_334a2d580acd443b905330d4680eec76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.282542 11754 ts_tablet_manager.cc:1434] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260925 01:49:43.283371 11754 tablet_bootstrap.cc:492] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:43.291199 11754 tablet_bootstrap.cc:654] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.291492 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.292286 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.292344 11778 raft_consensus.cc:493] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.292610 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.292598 11778 raft_consensus.cc:515] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.293256 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.293503 11778 leader_election.cc:290] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.294100 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.294559 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6837562b484242e5bf2b4eb085de7ac4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.295784 11060 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_41614d44ad5844f9911213d219401534"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.298409 11060 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41614d44ad5844f9911213d219401534 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:43.298760 11428 tablet.cc:2433] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 01:49:43.300707 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet b96b272afb8341dd9bfff9702c433026 with delete_type TABLET_DATA_DELETED (replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.301245 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 86079f22abb74d438c61ecc2a7379cbd (DEFAULT_TABLE table=default.Table_fdcdf308781f4f5ab7f4be9110e4434a [id=0d689fa6870547f3a57c6b6149b94754]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.301669 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.301983 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86079f22abb74d438c61ecc2a7379cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.302440 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65068a447744ec99e56489963b251c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
W20260925 01:49:43.302434 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 81c7e15700f64a92b87a6901950c5412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81c7e15700f64a92b87a6901950c5412 already in progress: creating tablet
I20260925 01:49:43.302846 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet e506eeed137e42e18e4d0e340d148aa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.302922 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.303608 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.303864 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.310675 11053 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_21851b803fd649039364f99310471653"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.311422 11053 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21851b803fd649039364f99310471653 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.311960 11239 raft_consensus.cc:2468] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:43.312901 11456 leader_election.cc:304] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:43.313488 11778 raft_consensus.cc:2804] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:43.313670 11778 raft_consensus.cc:493] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:43.313783 11778 raft_consensus.cc:3060] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:43.315310 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_716df684734d4100ba0e2266d8bdb6e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.316437 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_716df684734d4100ba0e2266d8bdb6e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.319609 11778 raft_consensus.cc:515] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.321019 11778 leader_election.cc:290] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.321806 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.323347 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6837562b484242e5bf2b4eb085de7ac4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:43.323662 11239 raft_consensus.cc:3060] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:43.324882 11057 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_64b18a8129e7434c8811d6f5eb28c7fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.325266 11754 tablet_bootstrap.cc:492] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
W20260925 01:49:43.326030 11057 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64b18a8129e7434c8811d6f5eb28c7fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.327816 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.328326 11754 ts_tablet_manager.cc:1403] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.005s
I20260925 01:49:43.329625 11754 raft_consensus.cc:359] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.329947 11754 raft_consensus.cc:385] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.330101 11754 raft_consensus.cc:740] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.327852 11750 tablet_replica.cc:333] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:43.330734 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.331489 11750 raft_consensus.cc:2243] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.332381 11750 raft_consensus.cc:2272] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.330410 11754 consensus_queue.cc:260] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.335500 11754 ts_tablet_manager.cc:1434] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260925 01:49:43.336910 11754 tablet_bootstrap.cc:492] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:43.336817 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.339928 11239 raft_consensus.cc:2468] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:43.340731 11456 leader_election.cc:304] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:43.341395 11778 raft_consensus.cc:2804] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:43.341655 11778 raft_consensus.cc:697] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:43.342622 11778 consensus_queue.cc:237] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.346267 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet b96b272afb8341dd9bfff9702c433026 with delete_type TABLET_DATA_DELETED (replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.347260 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.350080 11061 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_0f4010708b5b45fe8194002faf14225e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.351092 11061 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f4010708b5b45fe8194002faf14225e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.353081 11754 tablet_bootstrap.cc:654] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.354375 11750 ts_tablet_manager.cc:1916] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.355259 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.355958 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.356884 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.357336 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.357844 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.358978 11772 raft_consensus.cc:493] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.359196 11772 raft_consensus.cc:515] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.361550 11772 leader_election.cc:290] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:43.363426 11754 tablet_bootstrap.cc:492] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:43.363646 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 4195e3f8e93e40fe9dfd72710d319dca (DEFAULT_TABLE table=default.Table_f50309f126184cd5ba98431310f154f5 [id=f267d33f055e4d7ab6b7a96ae212365e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:43.364015 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 491d790067644090aa4d25f4060cc2ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 491d790067644090aa4d25f4060cc2ec already in progress: creating tablet
I20260925 01:49:43.364177 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4195e3f8e93e40fe9dfd72710d319dca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:43.364470 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a26b7ec7373d42668f40c7c89084be47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a26b7ec7373d42668f40c7c89084be47 already in progress: creating tablet
W20260925 01:49:43.364763 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c96165d1a85d4ee99748563078ae2a3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c96165d1a85d4ee99748563078ae2a3e already in progress: creating tablet
W20260925 01:49:43.365085 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 81c7e15700f64a92b87a6901950c5412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81c7e15700f64a92b87a6901950c5412 already in progress: creating tablet
W20260925 01:49:43.365423 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bb82b7b398f040da8d14725d74eafd64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb82b7b398f040da8d14725d74eafd64 already in progress: creating tablet
I20260925 01:49:43.366573 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.366840 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.366958 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.367226 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.367331 11745 tablet_replica.cc:333] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:43.367563 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.367935 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.368047 11745 raft_consensus.cc:2243] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.368369 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet e506eeed137e42e18e4d0e340d148aa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.368470 11745 raft_consensus.cc:2272] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.368794 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.369491 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.369827 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.370172 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.370379 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.370693 11745 ts_tablet_manager.cc:1916] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.370788 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.370824 11350 tablet_service.cc:1511] Processing CreateTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 (DEFAULT_TABLE table=default.Table_8f04a495ad294ac38a1fe39d586033d7 [id=3414ecadb9c24609b4011cc0ba7c73dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.371196 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.371632 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.372300 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65068a447744ec99e56489963b251c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.372790 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.373188 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.373557 11762 raft_consensus.cc:493] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.373700 11762 raft_consensus.cc:515] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.374627 11762 leader_election.cc:290] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.380371 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.381001 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75a4ed161734d30ab5ad2e2b00d77c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.383811 11745 ts_tablet_manager.cc:1929] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.383927 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.385941 11745 log.cc:1199] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ac03ebbd455f4fad88e875b69a049bc0
I20260925 01:49:43.386981 11745 ts_tablet_manager.cc:1950] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:43.389998 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet e506eeed137e42e18e4d0e340d148aa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.390604 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.391216 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.391682 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.391924 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.392549 11745 tablet_replica.cc:333] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:43.393513 11745 raft_consensus.cc:2243] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:43.393975 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b96b272afb8341dd9bfff9702c433026 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b96b272afb8341dd9bfff9702c433026 already in progress: creating tablet
W20260925 01:49:43.394354 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5b65068a447744ec99e56489963b251c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b65068a447744ec99e56489963b251c already in progress: creating tablet
W20260925 01:49:43.394649 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ae497a92e49746a79cbbfe3c82b2b544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae497a92e49746a79cbbfe3c82b2b544 already in progress: creating tablet
I20260925 01:49:43.394693 11745 raft_consensus.cc:2272] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:43.394994 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 4e008337914841b8a1ab4a64ecc6e181 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e008337914841b8a1ab4a64ecc6e181 already in progress: creating tablet
W20260925 01:49:43.395543 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 491d790067644090aa4d25f4060cc2ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 491d790067644090aa4d25f4060cc2ec already in progress: creating tablet
W20260925 01:49:43.395820 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ac03ebbd455f4fad88e875b69a049bc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac03ebbd455f4fad88e875b69a049bc0 already in progress: creating tablet
W20260925 01:49:43.396098 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet da74fa4b6fa841b7aebb81302cab2885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da74fa4b6fa841b7aebb81302cab2885 already in progress: creating tablet
W20260925 01:49:43.396422 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a26b7ec7373d42668f40c7c89084be47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a26b7ec7373d42668f40c7c89084be47 already in progress: creating tablet
W20260925 01:49:43.396708 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9884d7af60324a24ad06d6fa5db358b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9884d7af60324a24ad06d6fa5db358b2 already in progress: creating tablet
I20260925 01:49:43.396514 11745 ts_tablet_manager.cc:1916] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:43.397020 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c96165d1a85d4ee99748563078ae2a3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c96165d1a85d4ee99748563078ae2a3e already in progress: creating tablet
W20260925 01:49:43.397324 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 81c7e15700f64a92b87a6901950c5412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81c7e15700f64a92b87a6901950c5412 already in progress: creating tablet
I20260925 01:49:43.398555 11747 tablet_replica.cc:333] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:43.399168 11747 raft_consensus.cc:2243] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.409729 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.414158 11745 ts_tablet_manager.cc:1929] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.414778 11745 log.cc:1199] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:43.415397 11745 ts_tablet_manager.cc:1950] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:43.418339 11745 tablet_replica.cc:333] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:43.418529 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.419153 11745 raft_consensus.cc:2243] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.419687 11745 raft_consensus.cc:2272] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.419711 11747 raft_consensus.cc:2272] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.420933 11745 ts_tablet_manager.cc:1916] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.425297 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.433611 11747 ts_tablet_manager.cc:1916] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.436275 11755 tablet_bootstrap.cc:492] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:43.436614 11755 ts_tablet_manager.cc:1403] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.388s user 0.052s sys 0.065s
I20260925 01:49:43.441140 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.441363 11745 ts_tablet_manager.cc:1929] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.442375 11745 log.cc:1199] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/bb82b7b398f040da8d14725d74eafd64
I20260925 01:49:43.443166 11745 ts_tablet_manager.cc:1950] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:43.444798 11745 tablet_replica.cc:333] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:49:43.445163 11444 kernel_stack_watchdog.cc:198] Thread 11753 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 267ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f85a2c7f980 (unknown) at ??:0
@ 0x95ead7 __sanitizer::internal_sched_yield() at ??:?
@ 0x8c4e1d __interceptor_pthread_create at ??:?
@ 0x7f859f59cd71 kudu::Thread::StartThread() at ??:0
@ 0xa9ba27 kudu::Thread::Create() at ??:?
@ 0x7f859f5bc78b kudu::ThreadPool::CreateThread() at ??:0
@ 0x7f859f5b81d2 kudu::ThreadPool::DoSubmit() at ??:0
@ 0x7f859f5bd4df kudu::ThreadPool::Submit() at ??:0
@ 0x7f85aaf009ad kudu::log::SegmentAllocator::AsyncAllocateSegmentUnlocked() at ??:0
@ 0x7f85aaeff99f kudu::log::SegmentAllocator::AllocateSegmentAndRollOver() at ??:0
@ 0x7f85aaeff55e kudu::log::SegmentAllocator::Init() at ??:0
@ 0x7f85aaf075d5 kudu::log::Log::Init() at ??:0
@ 0x7f85aaf06931 kudu::log::Log::Open() at ??:0
@ 0x7f85ac993611 kudu::tablet::TabletBootstrap::OpenNewLog() at ??:0
@ 0x7f85ac98f97c kudu::tablet::TabletBootstrap::RunBootstrap() at ??:0
@ 0x7f85ac98e0ff kudu::tablet::TabletBootstrap::Bootstrap() at ??:0
I20260925 01:49:43.451798 11755 raft_consensus.cc:359] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.452077 11755 raft_consensus.cc:385] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.452203 11755 raft_consensus.cc:740] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.452497 11755 consensus_queue.cc:260] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.453281 11755 ts_tablet_manager.cc:1434] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260925 01:49:43.453707 11755 tablet_bootstrap.cc:492] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:43.464422 11747 ts_tablet_manager.cc:1929] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.464694 11747 log.cc:1199] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:43.469581 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 06b59e1505e246d2abada79299e09bfe (DEFAULT_TABLE table=default.Table_63b71c4cf1634d2aa8b517954ab683c8 [id=17b11380da7c42e0b51c4d6301d5789d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.469697 11047 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ac03ebbd455f4fad88e875b69a049bc0 (table default.Table_09a5b65cdd904adcbe454a84c2a999a8 [id=3437d40bf64c4d299fea4ecb2b8c776e]) successfully deleted
W20260925 01:49:43.470111 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a26b7ec7373d42668f40c7c89084be47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a26b7ec7373d42668f40c7c89084be47 already in progress: creating tablet
I20260925 01:49:43.470199 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b59e1505e246d2abada79299e09bfe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:43.470394 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9884d7af60324a24ad06d6fa5db358b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9884d7af60324a24ad06d6fa5db358b2 already in progress: creating tablet
W20260925 01:49:43.470606 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95dfbc1ce9db4f01bf6ec8965b62c994 already in progress: creating tablet
W20260925 01:49:43.470861 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c96165d1a85d4ee99748563078ae2a3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c96165d1a85d4ee99748563078ae2a3e already in progress: creating tablet
I20260925 01:49:43.471063 11047 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet f6058cd7c17b4544a565a5aacfb9df92 (table default.Table_2ba2a8cd4c204308b6bd353a094dafe4 [id=55b54d01f7634e9583dd4f3e1f1776fe]) successfully deleted
W20260925 01:49:43.471276 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e506eeed137e42e18e4d0e340d148aa8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e506eeed137e42e18e4d0e340d148aa8 already in progress: creating tablet
W20260925 01:49:43.471467 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a65faada47c34cd1908970460d3d3f6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a65faada47c34cd1908970460d3d3f6b already in progress: creating tablet
W20260925 01:49:43.471669 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d4e94cdafd343ee8a84c64668fe48fe already in progress: creating tablet
I20260925 01:49:43.471868 11047 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet bb82b7b398f040da8d14725d74eafd64 (table default.Table_91898e72d7854ba2b9c085048d7e0b95 [id=fb4d1c608ffb4982afe923ea6e8103af]) successfully deleted
I20260925 01:49:43.477169 11755 tablet_bootstrap.cc:654] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.476905 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 06b59e1505e246d2abada79299e09bfe (DEFAULT_TABLE table=default.Table_63b71c4cf1634d2aa8b517954ab683c8 [id=17b11380da7c42e0b51c4d6301d5789d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.477850 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b59e1505e246d2abada79299e09bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.482903 11754 ts_tablet_manager.cc:1403] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.004s
I20260925 01:49:43.483076 11753 tablet_bootstrap.cc:492] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:43.483292 11753 ts_tablet_manager.cc:1403] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.505s user 0.087s sys 0.149s
I20260925 01:49:43.447213 11745 raft_consensus.cc:2243] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.477087 11747 ts_tablet_manager.cc:1950] T e506eeed137e42e18e4d0e340d148aa8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:43.485097 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07f754fa5b748a1a25d43e6011c5460" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.486979 11754 raft_consensus.cc:359] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.487218 11754 raft_consensus.cc:385] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.487321 11754 raft_consensus.cc:740] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.487593 11754 consensus_queue.cc:260] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.488193 11754 ts_tablet_manager.cc:1434] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:49:43.488539 11754 tablet_bootstrap.cc:492] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:43.477262 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb82b7b398f040da8d14725d74eafd64" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:43.491672 11754 tablet_bootstrap.cc:654] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:43.496219 11062 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29f28e49791744428729279a79b6c9f1 consensus state has no leader
I20260925 01:49:43.497308 11055 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_8f04a495ad294ac38a1fe39d586033d7" } modify_external_catalogs: true
W20260925 01:49:43.497524 11058 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b05053f5646f4748a99647b7dbfae686 has no consensus state
I20260925 01:49:43.497601 11055 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_8f04a495ad294ac38a1fe39d586033d7" } modify_external_catalogs: true
I20260925 01:49:43.497958 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_95548c275bf74095b2d15cdf54943a63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.498615 11058 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95548c275bf74095b2d15cdf54943a63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.500988 11062 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_00be63d6c7f14b3d9fe02213f2b47430" } modify_external_catalogs: true
I20260925 01:49:43.501171 11062 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_00be63d6c7f14b3d9fe02213f2b47430" } modify_external_catalogs: true
I20260925 01:49:43.504117 11054 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_63b71c4cf1634d2aa8b517954ab683c8" } modify_external_catalogs: true
I20260925 01:49:43.504369 11054 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_63b71c4cf1634d2aa8b517954ab683c8" } modify_external_catalogs: true
I20260925 01:49:43.506003 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da74fa4b6fa841b7aebb81302cab2885" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:43.506050 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07f754fa5b748a1a25d43e6011c5460" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:43.506762 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6837562b484242e5bf2b4eb085de7ac4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:43.507257 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6837562b484242e5bf2b4eb085de7ac4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:43.507764 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac03ebbd455f4fad88e875b69a049bc0" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:43.511384 11456 leader_election.cc:343] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.513077 11750 ts_tablet_manager.cc:1929] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.513248 11750 log.cc:1199] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:43.513756 11750 ts_tablet_manager.cc:1950] T e506eeed137e42e18e4d0e340d148aa8 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:43.516333 11048 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet e506eeed137e42e18e4d0e340d148aa8 (table default.Table_fc17121a61824d04b8430e1c61d48de9 [id=c168421652804e92b137fe7114d3055c]) successfully deleted
W20260925 01:49:43.516683 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 6837562b484242e5bf2b4eb085de7ac4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6837562b484242e5bf2b4eb085de7ac4 already in progress: creating tablet
W20260925 01:49:43.517163 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d4e94cdafd343ee8a84c64668fe48fe already in progress: creating tablet
I20260925 01:49:43.512292 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6058cd7c17b4544a565a5aacfb9df92" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:43.517418 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet afc1cd6e88764445b0a1fdc92e0c53e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afc1cd6e88764445b0a1fdc92e0c53e5 already in progress: creating tablet
W20260925 01:49:43.517688 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95dfbc1ce9db4f01bf6ec8965b62c994 already in progress: creating tablet
W20260925 01:49:43.517912 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a65faada47c34cd1908970460d3d3f6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a65faada47c34cd1908970460d3d3f6b already in progress: creating tablet
W20260925 01:49:43.518165 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f6058cd7c17b4544a565a5aacfb9df92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6058cd7c17b4544a565a5aacfb9df92 already in progress: creating tablet
W20260925 01:49:43.518385 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bb82b7b398f040da8d14725d74eafd64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb82b7b398f040da8d14725d74eafd64 already in progress: creating tablet
I20260925 01:49:43.518544 11745 raft_consensus.cc:2272] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.519873 11753 raft_consensus.cc:359] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.520102 11753 raft_consensus.cc:385] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.520193 11753 raft_consensus.cc:740] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.520421 11753 consensus_queue.cc:260] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.521075 11753 ts_tablet_manager.cc:1434] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260925 01:49:43.521422 11753 tablet_bootstrap.cc:492] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:43.523870 11753 tablet_bootstrap.cc:654] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.525658 11745 ts_tablet_manager.cc:1916] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:43.528872 11457 leader_election.cc:343] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.529423 11457 leader_election.cc:304] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:43.540062 11745 ts_tablet_manager.cc:1929] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.540313 11745 log.cc:1199] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/da74fa4b6fa841b7aebb81302cab2885
I20260925 01:49:43.542263 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9558462332400d92f7d61858bdeca2" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:43.542937 11778 raft_consensus.cc:2749] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:43.543372 11177 leader_election.cc:343] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.543661 11745 ts_tablet_manager.cc:1950] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:43.545367 11755 tablet_bootstrap.cc:492] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:43.545569 11755 ts_tablet_manager.cc:1403] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.092s user 0.010s sys 0.001s
I20260925 01:49:43.546515 11755 raft_consensus.cc:359] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.546730 11755 raft_consensus.cc:385] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.546862 11755 raft_consensus.cc:740] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.547160 11755 consensus_queue.cc:260] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.547792 11755 ts_tablet_manager.cc:1434] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:43.548122 11755 tablet_bootstrap.cc:492] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:43.550197 11059 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:43.551000 11755 tablet_bootstrap.cc:654] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.554214 11750 tablet_replica.cc:333] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:43.554448 11750 raft_consensus.cc:2243] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.554608 11750 raft_consensus.cc:2272] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.554720 11060 master_service.cc:960] ReplaceTablet: received request to replace tablet f6058cd7c17b4544a565a5aacfb9df92 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.555522 11060 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_0c46d8b6e1044a3d9607e1d5577f5798" } new_table_name: "default.Table_04f98162b64e4576960f91d0a60432cb" modify_external_catalogs: true
I20260925 01:49:43.556746 11750 ts_tablet_manager.cc:1916] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.563354 11755 tablet_bootstrap.cc:492] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:43.563373 11053 master_service.cc:960] ReplaceTablet: received request to replace tablet f07f754fa5b748a1a25d43e6011c5460 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.563645 11755 ts_tablet_manager.cc:1403] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.003s
I20260925 01:49:43.564728 11755 raft_consensus.cc:359] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.564977 11755 raft_consensus.cc:385] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.565075 11755 raft_consensus.cc:740] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.564896 11059 master_service.cc:960] ReplaceTablet: received request to replace tablet b96b272afb8341dd9bfff9702c433026 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.565282 11755 consensus_queue.cc:260] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.566022 11755 ts_tablet_manager.cc:1434] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260925 01:49:43.567890 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet b96b272afb8341dd9bfff9702c433026 with delete_type TABLET_DATA_DELETED (replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.568190 11747 tablet_replica.cc:333] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:43.568246 11059 master_service.cc:960] ReplaceTablet: received request to replace tablet ae497a92e49746a79cbbfe3c82b2b544 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.568481 11747 raft_consensus.cc:2243] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.568756 11747 raft_consensus.cc:2272] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.569921 11747 ts_tablet_manager.cc:1916] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.572358 11059 master_service.cc:960] ReplaceTablet: received request to replace tablet afc1cd6e88764445b0a1fdc92e0c53e5 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.573007 11059 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_7e3942ff37734d5aa89cfb724ea34ca7" } modify_external_catalogs: true
I20260925 01:49:43.573173 11059 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_7e3942ff37734d5aa89cfb724ea34ca7" } modify_external_catalogs: true
W20260925 01:49:43.573817 11457 leader_election.cc:343] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.574224 11745 tablet_replica.cc:333] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:43.574296 11457 leader_election.cc:304] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:43.574512 11745 raft_consensus.cc:2243] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:49:43.574932 11457 raft_consensus.cc:2686] T da74fa4b6fa841b7aebb81302cab2885 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:43.575449 11750 ts_tablet_manager.cc:1929] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.575627 11750 log.cc:1199] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:43.576162 11750 ts_tablet_manager.cc:1950] T a65faada47c34cd1908970460d3d3f6b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:49:43.576234 11457 leader_election.cc:343] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:43.577128 11457 leader_election.cc:343] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:43.577517 11457 leader_election.cc:343] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.579041 11753 tablet_bootstrap.cc:492] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:43.579264 11750 tablet_replica.cc:333] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:43.579298 11457 leader_election.cc:304] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:43.579515 11457 raft_consensus.cc:2686] T ac03ebbd455f4fad88e875b69a049bc0 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:43.579509 11750 raft_consensus.cc:2243] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.579824 11750 raft_consensus.cc:2272] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.580457 11755 tablet_bootstrap.cc:492] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:43.581895 11457 leader_election.cc:343] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.582105 11457 leader_election.cc:304] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:43.582357 11457 raft_consensus.cc:2686] T bb82b7b398f040da8d14725d74eafd64 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:43.583043 11755 tablet_bootstrap.cc:654] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:43.583038 11457 leader_election.cc:343] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.583112 11750 ts_tablet_manager.cc:1916] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.583173 11457 leader_election.cc:304] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:43.583338 11457 raft_consensus.cc:2686] T f6058cd7c17b4544a565a5aacfb9df92 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:43.584213 11745 pending_rounds.cc:70] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:43.584290 11747 ts_tablet_manager.cc:1929] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.584441 11745 pending_rounds.cc:77] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072827779506176 op_type: NO_OP noop_request { }
I20260925 01:49:43.584751 11745 raft_consensus.cc:2889] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:43.584892 11745 raft_consensus.cc:2272] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.584913 11047 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet da74fa4b6fa841b7aebb81302cab2885 (table default.Table_d76ece082b4743ed8fac6623dcaf6bd2 [id=dc9445c2dde34bba98e731c1cdf445d8]) successfully deleted
I20260925 01:49:43.586119 11745 ts_tablet_manager.cc:1916] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.586153 11753 ts_tablet_manager.cc:1403] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20260925 01:49:43.586951 11753 raft_consensus.cc:359] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.587142 11753 raft_consensus.cc:385] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.587210 11753 raft_consensus.cc:740] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.587453 11753 consensus_queue.cc:260] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.594169 11747 log.cc:1199] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/b96b272afb8341dd9bfff9702c433026
I20260925 01:49:43.594712 11747 ts_tablet_manager.cc:1950] T b96b272afb8341dd9bfff9702c433026 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:43.595908 11753 ts_tablet_manager.cc:1434] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:49:43.596899 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.597049 11745 ts_tablet_manager.cc:1929] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:43.597187 11745 log.cc:1199] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/6837562b484242e5bf2b4eb085de7ac4
I20260925 01:49:43.597499 11048 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet b96b272afb8341dd9bfff9702c433026 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]) successfully deleted
I20260925 01:49:43.597920 11745 ts_tablet_manager.cc:1950] T 6837562b484242e5bf2b4eb085de7ac4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:43.598187 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.599130 11754 tablet_bootstrap.cc:492] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:43.599309 11754 ts_tablet_manager.cc:1403] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.111s user 0.009s sys 0.030s
I20260925 01:49:43.600106 11047 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 6837562b484242e5bf2b4eb085de7ac4 (table default.Table_8855b825d776480aaf4e160d16693e45 [id=f9b577b7907e4fae8cb2e498a2f59035]) successfully deleted
W20260925 01:49:43.600382 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet afc1cd6e88764445b0a1fdc92e0c53e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afc1cd6e88764445b0a1fdc92e0c53e5 already in progress: creating tablet
I20260925 01:49:43.600327 11754 raft_consensus.cc:359] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.600554 11754 raft_consensus.cc:385] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.600629 11754 raft_consensus.cc:740] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:43.600633 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5b65068a447744ec99e56489963b251c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b65068a447744ec99e56489963b251c already in progress: creating tablet
W20260925 01:49:43.600889 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 491d790067644090aa4d25f4060cc2ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 491d790067644090aa4d25f4060cc2ec already in progress: creating tablet
I20260925 01:49:43.600883 11754 consensus_queue.cc:260] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.603050 11056 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_ba17d67b0999413dbf51440ca53e6853" } new_table_name: "default.Table_6bae170b0f624aaaad76789bdbf72e0d" modify_external_catalogs: true
I20260925 01:49:43.603844 11753 tablet_bootstrap.cc:492] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:43.605226 11055 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet c75a4ed161734d30ab5ad2e2b00d77c9
I20260925 01:49:43.605564 11747 tablet_replica.cc:333] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:43.605783 11747 raft_consensus.cc:2243] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.605819 11753 tablet_bootstrap.cc:654] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.605979 11747 raft_consensus.cc:2272] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.606096 11055 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_3ef5451781f248de82a72b9782090c78" } new_table_name: "default.Table_9f4e74bbaa2e4916a69570f511ad227f" modify_external_catalogs: true
I20260925 01:49:43.606915 11747 ts_tablet_manager.cc:1916] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.608954 11754 ts_tablet_manager.cc:1434] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260925 01:49:43.609347 11754 tablet_bootstrap.cc:492] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:43.609704 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.611893 11754 tablet_bootstrap.cc:654] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.613570 11061 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_ebef853028984518b5b550224ea8e5dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.615589 11745 tablet_replica.cc:333] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:43.615772 11745 raft_consensus.cc:2243] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.615988 11745 raft_consensus.cc:2272] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:43.616585 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 4e008337914841b8a1ab4a64ecc6e181 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e008337914841b8a1ab4a64ecc6e181 already in progress: creating tablet
W20260925 01:49:43.616683 11061 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebef853028984518b5b550224ea8e5dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.616585 11058 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_854ab4951a1b404a99eb1caa32ea46e0" } modify_external_catalogs: true
I20260925 01:49:43.617895 11058 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_854ab4951a1b404a99eb1caa32ea46e0" } modify_external_catalogs: true
I20260925 01:49:43.617537 11745 ts_tablet_manager.cc:1916] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:43.619904 11060 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 018525730c4e4134ab3a0506f1a0a6fa consensus state has no leader
I20260925 01:49:43.620797 11062 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet ad1cbf07e15440c7919a4bbcd937fb53
W20260925 01:49:43.622233 11056 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d9558462332400d92f7d61858bdeca2 consensus state has no leader
I20260925 01:49:43.622340 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.619566 11053 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet f07f754fa5b748a1a25d43e6011c5460
I20260925 01:49:43.623589 11053 catalog_manager.cc:6934] ReplaceTablet: tablet f07f754fa5b748a1a25d43e6011c5460 deleted and replaced by tablet fa619556e5af473998080f4bbc9e5d1e
I20260925 01:49:43.617856 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.626194 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 06b59e1505e246d2abada79299e09bfe (DEFAULT_TABLE table=default.Table_63b71c4cf1634d2aa8b517954ab683c8 [id=17b11380da7c42e0b51c4d6301d5789d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.626715 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b59e1505e246d2abada79299e09bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.630227 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.631434 11754 tablet_bootstrap.cc:492] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:43.631592 11754 ts_tablet_manager.cc:1403] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.003s
I20260925 01:49:43.632411 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9558462332400d92f7d61858bdeca2" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:43.632869 11055 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1396d679e5824c469490170d257f6a9b has no consensus state
I20260925 01:49:43.635262 11754 raft_consensus.cc:359] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:43.635455 11754 raft_consensus.cc:385] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.635562 11754 raft_consensus.cc:740] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.635804 11754 consensus_queue.cc:260] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:43.636897 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet f07f754fa5b748a1a25d43e6011c5460 with delete_type TABLET_DATA_DELETED (replaced by tablet fa619556e5af473998080f4bbc9e5d1e) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:43.639897 11754 ts_tablet_manager.cc:1434] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260925 01:49:43.640102 11753 tablet_bootstrap.cc:492] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:43.640244 11754 tablet_bootstrap.cc:492] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:43.640273 11753 ts_tablet_manager.cc:1403] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.003s
I20260925 01:49:43.641619 11753 raft_consensus.cc:359] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:43.641821 11753 raft_consensus.cc:385] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.641929 11753 raft_consensus.cc:740] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.643899 11754 tablet_bootstrap.cc:654] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.645066 11747 ts_tablet_manager.cc:1929] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.645227 11747 log.cc:1199] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ac03ebbd455f4fad88e875b69a049bc0
I20260925 01:49:43.645720 11747 ts_tablet_manager.cc:1950] T ac03ebbd455f4fad88e875b69a049bc0 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:49:43.651306 11176 leader_election.cc:343] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.649173 11755 tablet_bootstrap.cc:492] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:43.827924 11755 ts_tablet_manager.cc:1403] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.248s user 0.010s sys 0.000s
I20260925 01:49:43.827791 11176 leader_election.cc:304] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:43.647264 11753 consensus_queue.cc:260] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:43.646922 11048 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ac03ebbd455f4fad88e875b69a049bc0 (table default.Table_09a5b65cdd904adcbe454a84c2a999a8 [id=3437d40bf64c4d299fea4ecb2b8c776e]) successfully deleted
W20260925 01:49:43.828639 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 177362us
I20260925 01:49:43.828804 11755 raft_consensus.cc:359] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:43.828737 11048 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 181809us
I20260925 01:49:43.829017 11755 raft_consensus.cc:385] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.829090 11755 raft_consensus.cc:740] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.653437 11750 ts_tablet_manager.cc:1929] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.829358 11755 consensus_queue.cc:260] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.829573 11750 log.cc:1199] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/4e008337914841b8a1ab4a64ecc6e181
I20260925 01:49:43.829941 11755 ts_tablet_manager.cc:1434] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:43.830010 11750 ts_tablet_manager.cc:1950] T 4e008337914841b8a1ab4a64ecc6e181 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:43.830332 11755 tablet_bootstrap.cc:492] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:43.830497 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c75a4ed161734d30ab5ad2e2b00d77c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c75a4ed161734d30ab5ad2e2b00d77c9 already in progress: creating tablet
W20260925 01:49:43.830765 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ad1cbf07e15440c7919a4bbcd937fb53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad1cbf07e15440c7919a4bbcd937fb53 already in progress: creating tablet
W20260925 01:49:43.830972 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f07f754fa5b748a1a25d43e6011c5460 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f07f754fa5b748a1a25d43e6011c5460 already in progress: creating tablet
I20260925 01:49:43.656152 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.831317 11750 tablet_replica.cc:333] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:43.831347 11778 raft_consensus.cc:493] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.831524 11750 raft_consensus.cc:2243] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.831504 11778 raft_consensus.cc:515] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:43.831679 11750 raft_consensus.cc:2272] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.832116 11755 tablet_bootstrap.cc:654] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.832284 11750 ts_tablet_manager.cc:1916] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.832540 11778 leader_election.cc:290] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:43.657132 11047 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet e506eeed137e42e18e4d0e340d148aa8 (table default.Table_fc17121a61824d04b8430e1c61d48de9 [id=c168421652804e92b137fe7114d3055c]) successfully deleted
W20260925 01:49:43.832851 11047 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 175749us
W20260925 01:49:43.833122 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95dfbc1ce9db4f01bf6ec8965b62c994 already in progress: creating tablet
W20260925 01:49:43.833304 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f6058cd7c17b4544a565a5aacfb9df92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6058cd7c17b4544a565a5aacfb9df92 already in progress: creating tablet
I20260925 01:49:43.833390 11772 raft_consensus.cc:2749] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:43.833470 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9884d7af60324a24ad06d6fa5db358b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9884d7af60324a24ad06d6fa5db358b2 already in progress: creating tablet
I20260925 01:49:43.672036 11754 tablet_bootstrap.cc:492] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
W20260925 01:49:43.833614 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ae497a92e49746a79cbbfe3c82b2b544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae497a92e49746a79cbbfe3c82b2b544 already in progress: creating tablet
W20260925 01:49:43.833778 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b96b272afb8341dd9bfff9702c433026 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b96b272afb8341dd9bfff9702c433026 already in progress: creating tablet
I20260925 01:49:43.833843 11754 ts_tablet_manager.cc:1403] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.194s user 0.005s sys 0.004s
I20260925 01:49:43.834218 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.834467 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet f07f754fa5b748a1a25d43e6011c5460 with delete_type TABLET_DATA_DELETED (replaced by tablet fa619556e5af473998080f4bbc9e5d1e) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:43.834844 11754 raft_consensus.cc:359] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.835232 11754 raft_consensus.cc:385] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.835378 11754 raft_consensus.cc:740] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.835702 11754 consensus_queue.cc:260] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.836216 11754 ts_tablet_manager.cc:1434] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:43.836580 11754 tablet_bootstrap.cc:492] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:43.693351 11054 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 06b59e1505e246d2abada79299e09bfe
I20260925 01:49:43.837719 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_e547fc11bd8240709bc7e5ef7e961594"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.838477 11054 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e547fc11bd8240709bc7e5ef7e961594 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.839986 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (DEFAULT_TABLE table=default.Table_d5da1b6d9d084929b15ee48a7144f38a [id=f3f8339a90b64cd4812637e6f997f107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.840358 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.842379 11350 tablet_service.cc:1511] Processing CreateTablet for tablet b05053f5646f4748a99647b7dbfae686 (DEFAULT_TABLE table=default.Table_cd22b64ded2d47498fba4bcaf54bc00a [id=351fd2bbafea4565a9cc4537f7f0c1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.842446 11754 tablet_bootstrap.cc:654] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.842746 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05053f5646f4748a99647b7dbfae686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.846437 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (DEFAULT_TABLE table=default.Table_f9512449d3e2408ca5f7970a505c860a [id=37bc53f74b2a4f618298bde3281e0ecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.846885 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.849238 11750 ts_tablet_manager.cc:1929] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.849416 11750 log.cc:1199] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/6837562b484242e5bf2b4eb085de7ac4
I20260925 01:49:43.849792 11750 ts_tablet_manager.cc:1950] T 6837562b484242e5bf2b4eb085de7ac4 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:43.850564 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 31fe174270f24ff780c212eaef90ef0d (DEFAULT_TABLE table=default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.851293 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fe174270f24ff780c212eaef90ef0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.852600 11750 tablet_replica.cc:333] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:43.852794 11750 raft_consensus.cc:2243] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.853091 11750 raft_consensus.cc:2272] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.853876 11750 ts_tablet_manager.cc:1916] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:43.854485 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 2d76845ed48045b7b3632179be022e5f (DEFAULT_TABLE table=default.Table_7e3942ff37734d5aa89cfb724ea34ca7 [id=c213f0abfafd451b99a639859fc4bb18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.854986 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d76845ed48045b7b3632179be022e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.857445 11755 tablet_bootstrap.cc:492] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:43.857666 11755 ts_tablet_manager.cc:1403] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.008s
I20260925 01:49:43.858840 11755 raft_consensus.cc:359] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.859140 11755 raft_consensus.cc:385] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.859297 11755 raft_consensus.cc:740] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.859549 11755 consensus_queue.cc:260] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.695036 11059 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 2d76845ed48045b7b3632179be022e5f
I20260925 01:49:43.861676 11754 tablet_bootstrap.cc:492] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:43.861795 11059 master_service.cc:960] ReplaceTablet: received request to replace tablet c42d96d45e8c4e8e8bee374477cfb0bb from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.861862 11754 ts_tablet_manager.cc:1403] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.003s
I20260925 01:49:43.862659 11750 ts_tablet_manager.cc:1929] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.862838 11750 log.cc:1199] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/f07f754fa5b748a1a25d43e6011c5460
I20260925 01:49:43.863226 11754 raft_consensus.cc:359] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.863523 11750 ts_tablet_manager.cc:1950] T f07f754fa5b748a1a25d43e6011c5460 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:43.864504 11754 raft_consensus.cc:385] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:43.864625 11754 raft_consensus.cc:740] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:43.864889 11754 consensus_queue.cc:260] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.697005 11058 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet a3ec6c34d22241e5bda3ec6665a47fc7
I20260925 01:49:43.868072 11754 ts_tablet_manager.cc:1434] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260925 01:49:43.868469 11754 tablet_bootstrap.cc:492] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:43.871170 11755 ts_tablet_manager.cc:1434] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s
I20260925 01:49:43.704766 11061 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_f50309f126184cd5ba98431310f154f5" } new_table_name: "default.Table_fea39c1d72644363a905c7285f20a052" modify_external_catalogs: true
I20260925 01:49:43.704999 11055 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_b2c32d1c9f694835aa159840a4024f00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.705108 11057 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_e25c617f09054071828a13f1a7f5bdc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.872185 11055 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2c32d1c9f694835aa159840a4024f00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.705348 11053 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_878267640acb42138a736804f08162e1" } new_table_name: "default.Table_ae4548d7f5a946568a2f0c4515aa6107" modify_external_catalogs: true
I20260925 01:49:43.751031 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_393671d61d694438bfaf25af0b823b4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.872735 11057 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e25c617f09054071828a13f1a7f5bdc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:43.872932 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_393671d61d694438bfaf25af0b823b4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.762609 11060 master_service.cc:960] ReplaceTablet: received request to replace tablet bfd9645cd6644a55997eb7745c7b29f2 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.656767 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet f07f754fa5b748a1a25d43e6011c5460 with delete_type TABLET_DATA_DELETED (replaced by tablet fa619556e5af473998080f4bbc9e5d1e) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:43.714524 11745 ts_tablet_manager.cc:1929] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.875190 11745 log.cc:1199] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/81c7e15700f64a92b87a6901950c5412
I20260925 01:49:43.875278 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd9645cd6644a55997eb7745c7b29f2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.762725 11062 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_b187688e2bdb475496c7d6278e6a6754"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.752178 11762 raft_consensus.cc:493] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.875649 11239 raft_consensus.cc:2468] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:49:43.875950 11062 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b187688e2bdb475496c7d6278e6a6754 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.875890 11762 raft_consensus.cc:515] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.876782 11762 leader_election.cc:290] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:43.877249 11745 ts_tablet_manager.cc:1950] T 81c7e15700f64a92b87a6901950c5412 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:43.877416 11456 leader_election.cc:304] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:43.878859 11745 tablet_replica.cc:333] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:43.879181 11745 raft_consensus.cc:2243] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:43.879159 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:43.879366 11753 ts_tablet_manager.cc:1434] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.239s user 0.003s sys 0.000s
I20260925 01:49:43.879419 11745 raft_consensus.cc:2272] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:43.879837 11753 tablet_bootstrap.cc:492] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:43.880430 11745 ts_tablet_manager.cc:1916] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:43.881983 11061 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4195e3f8e93e40fe9dfd72710d319dca consensus state has no leader
I20260925 01:49:43.882324 11061 master_service.cc:960] ReplaceTablet: received request to replace tablet f6058cd7c17b4544a565a5aacfb9df92 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.882813 11061 master_service.cc:960] ReplaceTablet: received request to replace tablet c96165d1a85d4ee99748563078ae2a3e from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.883366 11061 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_341c53c72e0c4d22bf6650740401b19c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.884961 11355 tablet_service.cc:1511] Processing CreateTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b (DEFAULT_TABLE table=default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.885421 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.884956 11343 tablet_service.cc:1511] Processing CreateTablet for tablet ff92ca86767f4ba6905da62b6a4b892c (DEFAULT_TABLE table=default.Table_ea9cb22dacf64efe966cbcfb02725dfe [id=e4e40511b79d43919b00485a71bf0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.885769 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff92ca86767f4ba6905da62b6a4b892c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.885710 11352 tablet_service.cc:1511] Processing CreateTablet for tablet b9937c3776f549dea887ace26dae492c (DEFAULT_TABLE table=default.Table_7b5309958b834d63b67d8a48293e5edd [id=96eed11bd70c486199e13071d27865da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.885993 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 5acd5d878aac4261a7294e87304c9dfc (DEFAULT_TABLE table=default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.886175 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9937c3776f549dea887ace26dae492c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.886371 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acd5d878aac4261a7294e87304c9dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.886881 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 60c40e2db5e2434192a359f50c02fe13 (DEFAULT_TABLE table=default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.887286 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c40e2db5e2434192a359f50c02fe13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.890226 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:43.890332 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 8d208d580a2c4c27bd614ccc88088384 (DEFAULT_TABLE table=default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.890443 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 1396d679e5824c469490170d257f6a9b (DEFAULT_TABLE table=default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.890673 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d208d580a2c4c27bd614ccc88088384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.890921 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1396d679e5824c469490170d257f6a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.834012 11047 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a65faada47c34cd1908970460d3d3f6b (table default.Table_27810a101f1848a1b8319368749cf79a [id=b931f965b8bf4871849dc5a4613dc04b]) successfully deleted
W20260925 01:49:43.892198 11047 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 58160.9us
W20260925 01:49:43.892463 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d4e94cdafd343ee8a84c64668fe48fe already in progress: creating tablet
I20260925 01:49:43.892807 11047 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 4e008337914841b8a1ab4a64ecc6e181 (table default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d [id=4936b4c5822241e78c7004d9f7ba3f78]) successfully deleted
W20260925 01:49:43.893018 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet afc1cd6e88764445b0a1fdc92e0c53e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet afc1cd6e88764445b0a1fdc92e0c53e5 already in progress: creating tablet
I20260925 01:49:43.893257 11047 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 6837562b484242e5bf2b4eb085de7ac4 (table default.Table_8855b825d776480aaf4e160d16693e45 [id=f9b577b7907e4fae8cb2e498a2f59035]) successfully deleted
W20260925 01:49:43.893543 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet da74fa4b6fa841b7aebb81302cab2885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da74fa4b6fa841b7aebb81302cab2885 already in progress: creating tablet
W20260925 01:49:43.893800 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c75a4ed161734d30ab5ad2e2b00d77c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c75a4ed161734d30ab5ad2e2b00d77c9 already in progress: creating tablet
W20260925 01:49:43.893844 11061 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_341c53c72e0c4d22bf6650740401b19c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:43.894130 11047 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ad1cbf07e15440c7919a4bbcd937fb53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad1cbf07e15440c7919a4bbcd937fb53 already in progress: creating tablet
I20260925 01:49:43.894335 11047 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]) successfully deleted
I20260925 01:49:43.894392 11345 tablet_service.cc:1511] Processing CreateTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 (DEFAULT_TABLE table=default.Table_854ab4951a1b404a99eb1caa32ea46e0 [id=2df4a02c11a14e6584003a727651841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.894776 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ec6c34d22241e5bda3ec6665a47fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.897591 11204 tablet_service.cc:1511] Processing CreateTablet for tablet e686dff5ada64f05a1c7bd914c1377a4 (DEFAULT_TABLE table=default.Table_716df684734d4100ba0e2266d8bdb6e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.897709 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (DEFAULT_TABLE table=default.Table_f9512449d3e2408ca5f7970a505c860a [id=37bc53f74b2a4f618298bde3281e0ecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.898304 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (DEFAULT_TABLE table=default.Table_d5da1b6d9d084929b15ee48a7144f38a [id=f3f8339a90b64cd4812637e6f997f107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.898411 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 3d3626880758447e9aa85f8f9070d4e3 (DEFAULT_TABLE table=default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.898787 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3626880758447e9aa85f8f9070d4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.898775 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 2d76845ed48045b7b3632179be022e5f (DEFAULT_TABLE table=default.Table_7e3942ff37734d5aa89cfb724ea34ca7 [id=c213f0abfafd451b99a639859fc4bb18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.898937 11219 tablet_service.cc:1511] Processing CreateTablet for tablet b05053f5646f4748a99647b7dbfae686 (DEFAULT_TABLE table=default.Table_cd22b64ded2d47498fba4bcaf54bc00a [id=351fd2bbafea4565a9cc4537f7f0c1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.899345 11206 tablet_service.cc:1511] Processing CreateTablet for tablet ff92ca86767f4ba6905da62b6a4b892c (DEFAULT_TABLE table=default.Table_ea9cb22dacf64efe966cbcfb02725dfe [id=e4e40511b79d43919b00485a71bf0509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.899447 11217 tablet_service.cc:1511] Processing CreateTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b (DEFAULT_TABLE table=default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.899893 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 5acd5d878aac4261a7294e87304c9dfc (DEFAULT_TABLE table=default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.901612 11211 tablet_service.cc:1511] Processing CreateTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 (DEFAULT_TABLE table=default.Table_64b18a8129e7434c8811d6f5eb28c7fe [id=3dd1eb1f66404d10a4398f52c951bf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.902416 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 770ebdbd355142ba86fd9eb8eaa844f4 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.902813 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770ebdbd355142ba86fd9eb8eaa844f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.898345 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 31fe174270f24ff780c212eaef90ef0d (DEFAULT_TABLE table=default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.906519 11356 tablet_service.cc:1511] Processing CreateTablet for tablet e7623999b3c04ca69672a1e43fa6921f (DEFAULT_TABLE table=default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.906924 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7623999b3c04ca69672a1e43fa6921f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.907114 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (DEFAULT_TABLE table=default.Table_f9512449d3e2408ca5f7970a505c860a [id=37bc53f74b2a4f618298bde3281e0ecf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.907591 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.908804 11753 tablet_bootstrap.cc:654] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:43.910413 11346 tablet_service.cc:1511] Processing CreateTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 (DEFAULT_TABLE table=default.Table_64b18a8129e7434c8811d6f5eb28c7fe [id=3dd1eb1f66404d10a4398f52c951bf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.910780 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e1f114c2a749d4af6a366c044f5ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.912904 11353 tablet_service.cc:1511] Processing CreateTablet for tablet e686dff5ada64f05a1c7bd914c1377a4 (DEFAULT_TABLE table=default.Table_716df684734d4100ba0e2266d8bdb6e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.913844 11220 tablet_service.cc:1511] Processing CreateTablet for tablet b9937c3776f549dea887ace26dae492c (DEFAULT_TABLE table=default.Table_7b5309958b834d63b67d8a48293e5edd [id=96eed11bd70c486199e13071d27865da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.914345 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 60c40e2db5e2434192a359f50c02fe13 (DEFAULT_TABLE table=default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.914786 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 1396d679e5824c469490170d257f6a9b (DEFAULT_TABLE table=default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.915169 11213 tablet_service.cc:1511] Processing CreateTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 (DEFAULT_TABLE table=default.Table_854ab4951a1b404a99eb1caa32ea46e0 [id=2df4a02c11a14e6584003a727651841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.915604 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 3d3626880758447e9aa85f8f9070d4e3 (DEFAULT_TABLE table=default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.915997 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 770ebdbd355142ba86fd9eb8eaa844f4 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.916399 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb4dac3099346a7975229d472a3919e (DEFAULT_TABLE table=default.Table_ebef853028984518b5b550224ea8e5dc [id=4e06f81ce5a94972bd01063957cf921f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.916868 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 8d208d580a2c4c27bd614ccc88088384 (DEFAULT_TABLE table=default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.917245 11210 tablet_service.cc:1511] Processing CreateTablet for tablet e7623999b3c04ca69672a1e43fa6921f (DEFAULT_TABLE table=default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.918578 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb4dac3099346a7975229d472a3919e (DEFAULT_TABLE table=default.Table_ebef853028984518b5b550224ea8e5dc [id=4e06f81ce5a94972bd01063957cf921f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.918977 11212 tablet_service.cc:1511] Processing CreateTablet for tablet fa619556e5af473998080f4bbc9e5d1e (DEFAULT_TABLE table=default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.898041 11047 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 81c7e15700f64a92b87a6901950c5412 (table default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]) successfully deleted
W20260925 01:49:43.906044 11053 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ef1b5f18d074016a6dea82da8e2d2b2 consensus state has no leader
W20260925 01:49:43.919536 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c75a4ed161734d30ab5ad2e2b00d77c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c75a4ed161734d30ab5ad2e2b00d77c9 already in progress: creating tablet
W20260925 01:49:43.919754 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ad1cbf07e15440c7919a4bbcd937fb53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad1cbf07e15440c7919a4bbcd937fb53 already in progress: creating tablet
I20260925 01:49:43.919827 11053 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_39b733d1fe004efdad259218984d60df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.912099 11058 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_7b5309958b834d63b67d8a48293e5edd" } modify_external_catalogs: true
I20260925 01:49:43.920317 11058 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_7b5309958b834d63b67d8a48293e5edd" } modify_external_catalogs: true
I20260925 01:49:43.920292 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 31fe174270f24ff780c212eaef90ef0d (DEFAULT_TABLE table=default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.907474 11059 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet c42d96d45e8c4e8e8bee374477cfb0bb
W20260925 01:49:43.920679 11053 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39b733d1fe004efdad259218984d60df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.921260 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e686dff5ada64f05a1c7bd914c1377a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.921275 11059 catalog_manager.cc:6934] ReplaceTablet: tablet c42d96d45e8c4e8e8bee374477cfb0bb deleted and replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749
I20260925 01:49:43.921622 11059 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_ab792e1485f44174b025aba98b817a48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:43.922210 11059 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab792e1485f44174b025aba98b817a48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.922147 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd9645cd6644a55997eb7745c7b29f2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:43.922712 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb4dac3099346a7975229d472a3919e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.923622 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fe174270f24ff780c212eaef90ef0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.925989 11499 tablet_service.cc:1511] Processing CreateTablet for tablet b9937c3776f549dea887ace26dae492c (DEFAULT_TABLE table=default.Table_7b5309958b834d63b67d8a48293e5edd [id=96eed11bd70c486199e13071d27865da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.926421 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9937c3776f549dea887ace26dae492c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.927124 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e686dff5ada64f05a1c7bd914c1377a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.927675 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c40e2db5e2434192a359f50c02fe13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.927945 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.928689 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e1f114c2a749d4af6a366c044f5ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.930214 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770ebdbd355142ba86fd9eb8eaa844f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.934242 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d76845ed48045b7b3632179be022e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.934471 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acd5d878aac4261a7294e87304c9dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.934681 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ec6c34d22241e5bda3ec6665a47fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.935109 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31fe174270f24ff780c212eaef90ef0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.935767 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.936002 11214 tablet_service.cc:1511] Processing CreateTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 (DEFAULT_TABLE table=default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.936415 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.937448 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff92ca86767f4ba6905da62b6a4b892c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.938195 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb4dac3099346a7975229d472a3919e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.938726 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.941677 11780 raft_consensus.cc:493] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.941969 11780 raft_consensus.cc:515] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:43.942301 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05053f5646f4748a99647b7dbfae686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.943322 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa619556e5af473998080f4bbc9e5d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.944254 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 3d3626880758447e9aa85f8f9070d4e3 (DEFAULT_TABLE table=default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.944265 11780 leader_election.cc:290] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:43.944743 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3626880758447e9aa85f8f9070d4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.945631 11498 tablet_service.cc:1511] Processing CreateTablet for tablet ff92ca86767f4ba6905da62b6a4b892c (DEFAULT_TABLE table=default.Table_ea9cb22dacf64efe966cbcfb02725dfe [id=e4e40511b79d43919b00485a71bf0509]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:43.946177 11456 leader_election.cc:343] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.946686 11495 tablet_service.cc:1511] Processing CreateTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 (DEFAULT_TABLE table=default.Table_854ab4951a1b404a99eb1caa32ea46e0 [id=2df4a02c11a14e6584003a727651841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.946894 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d208d580a2c4c27bd614ccc88088384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.947009 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 1396d679e5824c469490170d257f6a9b (DEFAULT_TABLE table=default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.945837 11500 tablet_service.cc:1511] Processing CreateTablet for tablet b05053f5646f4748a99647b7dbfae686 (DEFAULT_TABLE table=default.Table_cd22b64ded2d47498fba4bcaf54bc00a [id=351fd2bbafea4565a9cc4537f7f0c1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.954434 11354 tablet_service.cc:1511] Processing CreateTablet for tablet fa619556e5af473998080f4bbc9e5d1e (DEFAULT_TABLE table=default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.954906 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa619556e5af473998080f4bbc9e5d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.958602 11486 tablet_service.cc:1511] Processing CreateTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 (DEFAULT_TABLE table=default.Table_64b18a8129e7434c8811d6f5eb28c7fe [id=3dd1eb1f66404d10a4398f52c951bf72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.958906 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (DEFAULT_TABLE table=default.Table_d5da1b6d9d084929b15ee48a7144f38a [id=f3f8339a90b64cd4812637e6f997f107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.960083 11755 tablet_bootstrap.cc:492] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:43.960666 11488 tablet_service.cc:1511] Processing CreateTablet for tablet e7623999b3c04ca69672a1e43fa6921f (DEFAULT_TABLE table=default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.963390 11056 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_f9512449d3e2408ca5f7970a505c860a" } new_table_name: "default.Table_2fe9e3d572a34772b63e49e00ceec625" modify_external_catalogs: true
I20260925 01:49:43.971401 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 770ebdbd355142ba86fd9eb8eaa844f4 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.971741 11502 tablet_service.cc:1511] Processing CreateTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b (DEFAULT_TABLE table=default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.972268 11060 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet bfd9645cd6644a55997eb7745c7b29f2
I20260925 01:49:43.972533 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 5acd5d878aac4261a7294e87304c9dfc (DEFAULT_TABLE table=default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.972815 11060 catalog_manager.cc:6934] ReplaceTablet: tablet bfd9645cd6644a55997eb7745c7b29f2 deleted and replaced by tablet e7f421bb962e407c8b459eaad6e45b61
I20260925 01:49:43.973151 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 8d208d580a2c4c27bd614ccc88088384 (DEFAULT_TABLE table=default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.973212 11060 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_ebef853028984518b5b550224ea8e5dc" } modify_external_catalogs: true
I20260925 01:49:43.973407 11060 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_ebef853028984518b5b550224ea8e5dc" } modify_external_catalogs: true
I20260925 01:49:43.973896 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb4dac3099346a7975229d472a3919e (DEFAULT_TABLE table=default.Table_ebef853028984518b5b550224ea8e5dc [id=4e06f81ce5a94972bd01063957cf921f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.962009 11057 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_59d4c86ec501405bac429442b634b429"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.974300 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 2d76845ed48045b7b3632179be022e5f (DEFAULT_TABLE table=default.Table_7e3942ff37734d5aa89cfb724ea34ca7 [id=c213f0abfafd451b99a639859fc4bb18]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:43.974609 11057 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59d4c86ec501405bac429442b634b429 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.974617 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 60c40e2db5e2434192a359f50c02fe13 (DEFAULT_TABLE table=default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.973994 11053 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_cffab5e8bd204a9db3001c3fc583958f" } new_table_name: "default.Table_cd9ac2e25d7147f7907421d1e9590f4d" modify_external_catalogs: true
W20260925 01:49:43.979950 11457 leader_election.cc:343] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.980101 11457 leader_election.cc:304] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:43.980168 11062 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_64b18a8129e7434c8811d6f5eb28c7fe" } new_table_name: "default.Table_43fcb0af03694aafb7d0f246fb1b2815" modify_external_catalogs: true
W20260925 01:49:43.981380 11457 leader_election.cc:343] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:43.981818 11778 raft_consensus.cc:2749] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:43.982265 11819 raft_consensus.cc:493] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:43.982406 11819 raft_consensus.cc:515] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:43.983561 11056 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8bf42293dd5d452aa7ed9e0eaa78f54d consensus state has no leader
I20260925 01:49:43.984117 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_46b43d62b822482c8a723d9e33935c02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:43.983492 11485 tablet_service.cc:1511] Processing CreateTablet for tablet e686dff5ada64f05a1c7bd914c1377a4 (DEFAULT_TABLE table=default.Table_716df684734d4100ba0e2266d8bdb6e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:43.984709 11484 tablet_service.cc:1511] Processing CreateTablet for tablet fa619556e5af473998080f4bbc9e5d1e (DEFAULT_TABLE table=default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:43.984759 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46b43d62b822482c8a723d9e33935c02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:43.985239 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ec6c34d22241e5bda3ec6665a47fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.985473 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7623999b3c04ca69672a1e43fa6921f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.985647 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5acd5d878aac4261a7294e87304c9dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.985852 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1396d679e5824c469490170d257f6a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.986034 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa619556e5af473998080f4bbc9e5d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.989434 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d208d580a2c4c27bd614ccc88088384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.989728 11745 ts_tablet_manager.cc:1929] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:43.989872 11745 log.cc:1199] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/f07f754fa5b748a1a25d43e6011c5460
I20260925 01:49:43.990561 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c40e2db5e2434192a359f50c02fe13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.991240 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff92ca86767f4ba6905da62b6a4b892c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.991344 11059 master_service.cc:960] ReplaceTablet: received request to replace tablet 105fd502b74d442eb5d5031f56e5cb62 from {username='slave'} at 127.0.0.1:55092
I20260925 01:49:43.991716 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.992763 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d76845ed48045b7b3632179be022e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.993285 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.994207 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770ebdbd355142ba86fd9eb8eaa844f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.995416 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb4dac3099346a7975229d472a3919e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.997386 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e686dff5ada64f05a1c7bd914c1377a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.997685 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e1f114c2a749d4af6a366c044f5ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.997962 11762 raft_consensus.cc:2804] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:43.998104 11762 raft_consensus.cc:493] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:43.998234 11762 raft_consensus.cc:3060] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:43.999024 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05053f5646f4748a99647b7dbfae686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:43.999675 11819 leader_election.cc:290] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:44.011310 11745 ts_tablet_manager.cc:1950] T f07f754fa5b748a1a25d43e6011c5460 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:44.022316 11062 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9e1f114c2a749d4af6a366c044f5ea5 consensus state has no leader
W20260925 01:49:44.025705 11053 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3289c6dc8e84a358f877a197412d901 consensus state has no leader
I20260925 01:49:44.038373 11772 raft_consensus.cc:493] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.038630 11772 raft_consensus.cc:515] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.040846 11772 leader_election.cc:290] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.040930 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1396d679e5824c469490170d257f6a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.042574 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437bbb14fd264180887c0f5aa2ce80ea" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:44.013913 11491 tablet_service.cc:1511] Processing CreateTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 (DEFAULT_TABLE table=default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:44.046801 11456 leader_election.cc:343] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.048892 11047 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]) successfully deleted
I20260925 01:49:44.052410 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d3626880758447e9aa85f8f9070d4e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.059693 11059 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 105fd502b74d442eb5d5031f56e5cb62
I20260925 01:49:44.060223 11059 catalog_manager.cc:6934] ReplaceTablet: tablet 105fd502b74d442eb5d5031f56e5cb62 deleted and replaced by tablet 00906edfa6b648229bcba8e59d68b969
I20260925 01:49:44.066337 11060 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet 3eb4dac3099346a7975229d472a3919e
I20260925 01:49:44.067596 11217 tablet_service.cc:1511] Processing CreateTablet for tablet c3289c6dc8e84a358f877a197412d901 (DEFAULT_TABLE table=default.Table_cffab5e8bd204a9db3001c3fc583958f [id=5af8648813b343d1885f0e3d4b587ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.071442 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da74fa4b6fa841b7aebb81302cab2885" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:44.072672 11359 tablet_service.cc:1511] Processing CreateTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 (DEFAULT_TABLE table=default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.073144 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:44.073654 11176 leader_election.cc:343] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: da74fa4b6fa841b7aebb81302cab2885
I20260925 01:49:44.073707 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 357963616763428fa69c7670e760f84e (DEFAULT_TABLE table=default.Table_41614d44ad5844f9911213d219401534 [id=4ea66d3270f54caaa02e4084c6696342]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.074321 11348 tablet_service.cc:1511] Processing CreateTablet for tablet cedc909f3c864a7cbbd12dbdfb3315ec (DEFAULT_TABLE table=default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.074702 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cedc909f3c864a7cbbd12dbdfb3315ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.076309 11345 tablet_service.cc:1511] Processing CreateTablet for tablet c3289c6dc8e84a358f877a197412d901 (DEFAULT_TABLE table=default.Table_cffab5e8bd204a9db3001c3fc583958f [id=5af8648813b343d1885f0e3d4b587ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.076905 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 357963616763428fa69c7670e760f84e (DEFAULT_TABLE table=default.Table_41614d44ad5844f9911213d219401534 [id=4ea66d3270f54caaa02e4084c6696342]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.077416 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3289c6dc8e84a358f877a197412d901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.079777 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9937c3776f549dea887ace26dae492c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.080456 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 357963616763428fa69c7670e760f84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.081511 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3289c6dc8e84a358f877a197412d901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.081938 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 357963616763428fa69c7670e760f84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.082413 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7623999b3c04ca69672a1e43fa6921f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.082422 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76845ed48045b7b3632179be022e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
W20260925 01:49:44.084232 11177 leader_election.cc:343] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.085371 11058 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet b9937c3776f549dea887ace26dae492c
I20260925 01:49:44.085835 11754 tablet_bootstrap.cc:654] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.091632 11762 raft_consensus.cc:515] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:44.092136 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb with delete_type TABLET_DATA_DELETED (replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.092916 11058 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_cd9ac2e25d7147f7907421d1e9590f4d" } modify_external_catalogs: true
I20260925 01:49:44.093124 11058 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_cd9ac2e25d7147f7907421d1e9590f4d" } modify_external_catalogs: true
I20260925 01:49:44.094195 11177 leader_election.cc:304] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:44.094547 11772 raft_consensus.cc:2749] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.095017 11060 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_43fcb0af03694aafb7d0f246fb1b2815" } modify_external_catalogs: true
I20260925 01:49:44.095222 11060 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_43fcb0af03694aafb7d0f246fb1b2815" } modify_external_catalogs: true
I20260925 01:49:44.096019 11059 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_b2c32d1c9f694835aa159840a4024f00" } modify_external_catalogs: true
I20260925 01:49:44.096253 11059 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_b2c32d1c9f694835aa159840a4024f00" } modify_external_catalogs: true
I20260925 01:49:44.097347 11211 tablet_service.cc:1511] Processing CreateTablet for tablet cedc909f3c864a7cbbd12dbdfb3315ec (DEFAULT_TABLE table=default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.099614 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cedc909f3c864a7cbbd12dbdfb3315ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.100045 11056 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_05026612160046eb92a16de5dc86abf2" } new_table_name: "default.Table_84f0f4996f3d4d609ad1b68dfa611853" modify_external_catalogs: true
I20260925 01:49:44.101020 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd9645cd6644a55997eb7745c7b29f2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:44.102908 11239 raft_consensus.cc:3060] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:44.103260 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76845ed48045b7b3632179be022e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.104411 11755 tablet_bootstrap.cc:654] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.111130 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
W20260925 01:49:44.113255 11056 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29f28e49791744428729279a79b6c9f1 consensus state has no leader
W20260925 01:49:44.100023 11047 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2d76845ed48045b7b3632179be022e5f because the tablet was not found. No further retry: Not found: Tablet not found: 2d76845ed48045b7b3632179be022e5f
I20260925 01:49:44.120185 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_f7f257d6361c41b08685b0f8cdeac396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:44.120862 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7f257d6361c41b08685b0f8cdeac396 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:44.120971 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.123164 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet bfd9645cd6644a55997eb7745c7b29f2 with delete_type TABLET_DATA_DELETED (replaced by tablet e7f421bb962e407c8b459eaad6e45b61) from {username='slave'} at 127.0.0.1:41980
W20260925 01:49:44.123946 11047 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c42d96d45e8c4e8e8bee374477cfb0bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c42d96d45e8c4e8e8bee374477cfb0bb already in progress: creating tablet
I20260925 01:49:44.126421 11054 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_d5da1b6d9d084929b15ee48a7144f38a" } new_table_name: "default.Table_8f5194a1b70d43f185050d1bdb176d8b" modify_external_catalogs: true
I20260925 01:49:44.127588 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.129338 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 06b59e1505e246d2abada79299e09bfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.129979 11484 tablet_service.cc:1511] Processing CreateTablet for tablet c3289c6dc8e84a358f877a197412d901 (DEFAULT_TABLE table=default.Table_cffab5e8bd204a9db3001c3fc583958f [id=5af8648813b343d1885f0e3d4b587ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.130950 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 06b59e1505e246d2abada79299e09bfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.131181 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb with delete_type TABLET_DATA_DELETED (replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749) from {username='slave'} at 127.0.0.1:35284
W20260925 01:49:44.133767 11054 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 consensus state has no leader
I20260925 01:49:44.133834 11747 tablet_replica.cc:333] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:44.134100 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 357963616763428fa69c7670e760f84e (DEFAULT_TABLE table=default.Table_41614d44ad5844f9911213d219401534 [id=4ea66d3270f54caaa02e4084c6696342]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.134577 11762 leader_election.cc:290] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:44.135658 11747 raft_consensus.cc:2243] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.135886 11747 raft_consensus.cc:2272] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.136922 11747 ts_tablet_manager.cc:1916] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.137739 11503 tablet_service.cc:1511] Processing CreateTablet for tablet cedc909f3c864a7cbbd12dbdfb3315ec (DEFAULT_TABLE table=default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.139235 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.139552 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa7a3941254478c800f9e366e3f7b06 (DEFAULT_TABLE table=default.Table_e547fc11bd8240709bc7e5ef7e961594 [id=25512a7f4c4741d4aba6f86f1497dca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.139696 11500 tablet_service.cc:1511] Processing CreateTablet for tablet e7f421bb962e407c8b459eaad6e45b61 (DEFAULT_TABLE table=default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.148046 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3289c6dc8e84a358f877a197412d901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.158954 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 357963616763428fa69c7670e760f84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.164109 11502 tablet_service.cc:1511] Processing CreateTablet for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (DEFAULT_TABLE table=default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.165181 11745 tablet_replica.cc:333] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:44.166810 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cedc909f3c864a7cbbd12dbdfb3315ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.167593 11060 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet a9e1f114c2a749d4af6a366c044f5ea5
I20260925 01:49:44.170164 11060 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_7f229e69d1044678b1b85292293ee4e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:44.171061 11060 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f229e69d1044678b1b85292293ee4e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:44.172984 11745 raft_consensus.cc:2243] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.173228 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (DEFAULT_TABLE table=default.Table_393671d61d694438bfaf25af0b823b4c [id=56d41c65456f4cf691b9f87319014030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.175307 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 with delete_type TABLET_DATA_DELETED (replaced by tablet 00906edfa6b648229bcba8e59d68b969) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.180802 11753 tablet_bootstrap.cc:492] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.188822 11755 tablet_bootstrap.cc:492] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.189208 11755 ts_tablet_manager.cc:1403] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.318s user 0.002s sys 0.008s
I20260925 01:49:44.190315 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet 06b59e1505e246d2abada79299e09bfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.191478 11755 raft_consensus.cc:359] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.191809 11755 raft_consensus.cc:385] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.191931 11755 raft_consensus.cc:740] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.192327 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_cb56a1417e89414aaf3f117d28525d3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:44.192360 11755 consensus_queue.cc:260] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:44.193121 11054 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb56a1417e89414aaf3f117d28525d3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:44.196084 11755 ts_tablet_manager.cc:1434] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260925 01:49:44.196990 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 99913eb35197442880a27b3c288237f4 (DEFAULT_TABLE table=default.Table_e25c617f09054071828a13f1a7f5bdc7 [id=5a101d4224e546e686f9bf819b07c07b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.198805 11062 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_e547fc11bd8240709bc7e5ef7e961594" } new_table_name: "default.Table_39b1b83f732c44ca93f0e5e37326d739" modify_external_catalogs: true
I20260925 01:49:44.198750 11053 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_c42a2d0957624d578f66a1c0268d2ef2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:44.199221 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa7a3941254478c800f9e366e3f7b06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:44.199419 11053 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c42a2d0957624d578f66a1c0268d2ef2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:44.200212 11755 tablet_bootstrap.cc:492] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.200408 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f421bb962e407c8b459eaad6e45b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.201063 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99913eb35197442880a27b3c288237f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.201375 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:44.202930 11048 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet a9e1f114c2a749d4af6a366c044f5ea5 (table default.Table_43fcb0af03694aafb7d0f246fb1b2815 [id=3dd1eb1f66404d10a4398f52c951bf72], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9e1f114c2a749d4af6a366c044f5ea5 consensus state has no leader
I20260925 01:49:44.203840 11755 tablet_bootstrap.cc:654] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.206398 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:44.207115 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:44.208992 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb4dac3099346a7975229d472a3919e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.211467 11753 ts_tablet_manager.cc:1403] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.301s user 0.013s sys 0.001s
I20260925 01:49:44.211627 11058 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet c3289c6dc8e84a358f877a197412d901
I20260925 01:49:44.224013 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.224409 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76845ed48045b7b3632179be022e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.226883 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.226850 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.227464 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet bfd9645cd6644a55997eb7745c7b29f2 with delete_type TABLET_DATA_DELETED (replaced by tablet e7f421bb962e407c8b459eaad6e45b61) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.227908 11753 raft_consensus.cc:359] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.228710 11753 raft_consensus.cc:385] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.228837 11753 raft_consensus.cc:740] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.229255 11753 consensus_queue.cc:260] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.229945 11753 ts_tablet_manager.cc:1434] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260925 01:49:44.230345 11753 tablet_bootstrap.cc:492] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.234052 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.237850 11239 raft_consensus.cc:2468] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
W20260925 01:49:44.244098 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a3ec6c34d22241e5bda3ec6665a47fc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3ec6c34d22241e5bda3ec6665a47fc7 already in progress: creating tablet
W20260925 01:49:44.245229 11048 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2d76845ed48045b7b3632179be022e5f because the tablet was not found. No further retry: Not found: Tablet not found: 2d76845ed48045b7b3632179be022e5f
I20260925 01:49:44.236330 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82ac4f3b4d48fbbb33c21f5630d749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.247906 11059 catalog_manager.cc:6133] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Sending DeleteTablet for 3 replicas of tablet ccffbe61eea34333abdc6da94612c0f6
W20260925 01:49:44.249155 11062 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fa7a3941254478c800f9e366e3f7b06 consensus state has no leader
I20260925 01:49:44.249401 11750 tablet_replica.cc:333] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:44.249761 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.237972 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 (DEFAULT_TABLE table=default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.258810 11456 leader_election.cc:304] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:44.259423 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa7a3941254478c800f9e366e3f7b06 (DEFAULT_TABLE table=default.Table_e547fc11bd8240709bc7e5ef7e961594 [id=25512a7f4c4741d4aba6f86f1497dca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.259824 11745 raft_consensus.cc:2272] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.260118 11762 raft_consensus.cc:2706] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Received election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260925 01:49:44.262039 11753 tablet_bootstrap.cc:654] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.265995 11745 ts_tablet_manager.cc:1916] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.266465 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f9e96bcdf9418ea54dc73bf68a2be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.270874 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa7a3941254478c800f9e366e3f7b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.273587 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 99913eb35197442880a27b3c288237f4 (DEFAULT_TABLE table=default.Table_e25c617f09054071828a13f1a7f5bdc7 [id=5a101d4224e546e686f9bf819b07c07b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.274397 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb with delete_type TABLET_DATA_DELETED (replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.282346 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99913eb35197442880a27b3c288237f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.284811 11204 tablet_service.cc:1511] Processing CreateTablet for tablet e7f421bb962e407c8b459eaad6e45b61 (DEFAULT_TABLE table=default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.285405 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f421bb962e407c8b459eaad6e45b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.287034 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437bbb14fd264180887c0f5aa2ce80ea" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:44.288130 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfd9645cd6644a55997eb7745c7b29f2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:44.289136 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.289984 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet bfd9645cd6644a55997eb7745c7b29f2 with delete_type TABLET_DATA_DELETED (replaced by tablet e7f421bb962e407c8b459eaad6e45b61) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.290975 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa7a3941254478c800f9e366e3f7b06 (DEFAULT_TABLE table=default.Table_e547fc11bd8240709bc7e5ef7e961594 [id=25512a7f4c4741d4aba6f86f1497dca4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.291904 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (DEFAULT_TABLE table=default.Table_393671d61d694438bfaf25af0b823b4c [id=56d41c65456f4cf691b9f87319014030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.292841 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 99913eb35197442880a27b3c288237f4 (DEFAULT_TABLE table=default.Table_e25c617f09054071828a13f1a7f5bdc7 [id=5a101d4224e546e686f9bf819b07c07b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.293787 11351 tablet_service.cc:1511] Processing CreateTablet for tablet e7f421bb962e407c8b459eaad6e45b61 (DEFAULT_TABLE table=default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.294588 11350 tablet_service.cc:1511] Processing CreateTablet for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (DEFAULT_TABLE table=default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.296293 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 (DEFAULT_TABLE table=default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.296993 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f9e96bcdf9418ea54dc73bf68a2be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.303860 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 with delete_type TABLET_DATA_DELETED (replaced by tablet 00906edfa6b648229bcba8e59d68b969) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.305478 11219 tablet_service.cc:1511] Processing CreateTablet for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (DEFAULT_TABLE table=default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.307022 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82ac4f3b4d48fbbb33c21f5630d749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.313555 11745 ts_tablet_manager.cc:1929] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.313777 11745 log.cc:1199] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/bfd9645cd6644a55997eb7745c7b29f2
I20260925 01:49:44.313833 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 (DEFAULT_TABLE table=default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.314435 11745 ts_tablet_manager.cc:1950] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:44.314757 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 with delete_type TABLET_DATA_DELETED (replaced by tablet 00906edfa6b648229bcba8e59d68b969) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.315881 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb4dac3099346a7975229d472a3919e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.316097 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.316226 11753 tablet_bootstrap.cc:492] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.316493 11753 ts_tablet_manager.cc:1403] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.086s user 0.009s sys 0.032s
I20260925 01:49:44.316473 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.316759 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.317245 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.317909 11753 raft_consensus.cc:359] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.317932 11345 tablet_service.cc:1511] Processing CreateTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 (DEFAULT_TABLE table=default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.318228 11753 raft_consensus.cc:385] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.318399 11753 raft_consensus.cc:740] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.318650 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.318904 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet c3289c6dc8e84a358f877a197412d901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.319048 11357 tablet_service.cc:1511] Processing CreateTablet for tablet a3358b78a1da48388d1f72536b1ed0a2 (DEFAULT_TABLE table=default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.319314 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 00906edfa6b648229bcba8e59d68b969 (DEFAULT_TABLE table=default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.319823 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (DEFAULT_TABLE table=default.Table_ab792e1485f44174b025aba98b817a48 [id=861f838981bc470e9d593a7733c4526f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.319917 11352 tablet_service.cc:1511] Processing CreateTablet for tablet ca76f6f710d841fd8999b40e5a48693f (DEFAULT_TABLE table=default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.320462 11348 tablet_service.cc:1511] Processing CreateTablet for tablet ccffbe61eea34333abdc6da94612c0f6 (DEFAULT_TABLE table=default.Table_b2c32d1c9f694835aa159840a4024f00 [id=fd0ffd9fb56b40f590be7bd7b9128f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.320957 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.321352 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd27c6d835948ba859b4c11d8ebf783 (DEFAULT_TABLE table=default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.321980 11753 consensus_queue.cc:260] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.327553 11753 ts_tablet_manager.cc:1434] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260925 01:49:44.328025 11780 raft_consensus.cc:493] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.328207 11780 raft_consensus.cc:515] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.328841 11780 leader_election.cc:290] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.332599 11753 tablet_bootstrap.cc:492] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.334867 11755 tablet_bootstrap.cc:492] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.334877 11753 tablet_bootstrap.cc:654] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.342319 11755 ts_tablet_manager.cc:1403] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.143s user 0.016s sys 0.016s
I20260925 01:49:44.343667 11755 raft_consensus.cc:359] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.344084 11755 raft_consensus.cc:385] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.344250 11755 raft_consensus.cc:740] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.344698 11755 consensus_queue.cc:260] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.346760 11750 raft_consensus.cc:2243] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.347160 11750 raft_consensus.cc:2272] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.347995 11750 ts_tablet_manager.cc:1916] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.349148 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (DEFAULT_TABLE table=default.Table_393671d61d694438bfaf25af0b823b4c [id=56d41c65456f4cf691b9f87319014030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.349701 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.350837 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb4dac3099346a7975229d472a3919e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.353515 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet bb82b7b398f040da8d14725d74eafd64 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:35284
I20260925 01:49:44.354436 11755 ts_tablet_manager.cc:1434] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:49:44.359295 11754 tablet_bootstrap.cc:492] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:44.361330 11754 ts_tablet_manager.cc:1403] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.491s user 0.015s sys 0.040s
I20260925 01:49:44.362897 11754 raft_consensus.cc:359] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.363572 11754 raft_consensus.cc:385] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.363737 11754 raft_consensus.cc:740] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.364820 11755 tablet_bootstrap.cc:492] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.365376 11754 consensus_queue.cc:260] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.366288 11754 ts_tablet_manager.cc:1434] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260925 01:49:44.367218 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 11028
I20260925 01:49:44.371085 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4683df170284c228a08df5422e37d16" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:44.371563 11755 tablet_bootstrap.cc:654] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:44.373234 11314 leader_election.cc:343] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.374887 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96165d1a85d4ee99748563078ae2a3e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:44.375706 11314 leader_election.cc:343] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.381717 11754 tablet_bootstrap.cc:492] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:44.383199 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa7a3941254478c800f9e366e3f7b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.383487 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f421bb962e407c8b459eaad6e45b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.384060 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.385848 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd27c6d835948ba859b4c11d8ebf783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.387152 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca76f6f710d841fd8999b40e5a48693f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.388098 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3358b78a1da48388d1f72536b1ed0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.388720 11353 tablet_service.cc:1511] Processing CreateTablet for tablet ba19192502634f8599407d923114a627 (DEFAULT_TABLE table=default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.389130 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb98d5a38f43450c80d057d9eb2f92d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.389679 11356 tablet_service.cc:1511] Processing CreateTablet for tablet c28c9e51d80a442486b78be32c74a94f (DEFAULT_TABLE table=default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.390266 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28c9e51d80a442486b78be32c74a94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.391165 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7496a9eaa1714e9fa83d8c88bf1070fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.391520 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00906edfa6b648229bcba8e59d68b969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.391849 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (DEFAULT_TABLE table=default.Table_cb56a1417e89414aaf3f117d28525d3b [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.395524 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5021ab79dc4eaf9ed612f7125a6dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.429998 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82ac4f3b4d48fbbb33c21f5630d749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.467173 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba19192502634f8599407d923114a627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.468174 11747 ts_tablet_manager.cc:1929] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.474316 11780 raft_consensus.cc:493] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.474646 11780 raft_consensus.cc:515] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:44.474449 11049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.253:42889, user_credentials={real_user=slave}} blocked reactor thread for 282752us
I20260925 01:49:44.479712 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet c3289c6dc8e84a358f877a197412d901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:41980
W20260925 01:49:44.480399 11457 leader_election.cc:343] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.480808 11358 tablet_service.cc:1511] Processing CreateTablet for tablet c4eb584e929c46f891d28ad01e6d78ae (DEFAULT_TABLE table=default.Table_7f229e69d1044678b1b85292293ee4e5 [id=cde938f51c1d4ea8a32a3f9b684c510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.481462 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99913eb35197442880a27b3c288237f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.485200 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 67921f86c4f6422e97d7f306262569f8 (DEFAULT_TABLE table=default.Table_c42a2d0957624d578f66a1c0268d2ef2 [id=107d0cda55154f5e84ce4dd14d36364a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.485742 11747 log.cc:1199] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/81c7e15700f64a92b87a6901950c5412
I20260925 01:49:44.486833 11747 ts_tablet_manager.cc:1950] T 81c7e15700f64a92b87a6901950c5412 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:44.488480 11780 leader_election.cc:290] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.488729 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb82b7b398f040da8d14725d74eafd64" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:44.507376 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4eb584e929c46f891d28ad01e6d78ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.513895 11747 tablet_replica.cc:333] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
W20260925 01:49:44.516881 11314 leader_election.cc:343] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:49:44.517370 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67921f86c4f6422e97d7f306262569f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.517813 11048 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 81c7e15700f64a92b87a6901950c5412 (table default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]) successfully deleted
W20260925 01:49:44.518270 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 06b59e1505e246d2abada79299e09bfe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06b59e1505e246d2abada79299e09bfe already in progress: creating tablet
W20260925 01:49:44.518586 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c42d96d45e8c4e8e8bee374477cfb0bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c42d96d45e8c4e8e8bee374477cfb0bb already in progress: creating tablet
I20260925 01:49:44.527983 11457 leader_election.cc:304] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:44.529119 11762 raft_consensus.cc:2749] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.532164 11056 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_0523f9d0a4ec4762bf166dafb16b6f9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:44.531370 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 48428.2us
I20260925 01:49:44.532599 11054 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 5 got 0
W20260925 01:49:44.532620 11457 leader_election.cc:343] T bfd9645cd6644a55997eb7745c7b29f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:44.532953 11056 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0523f9d0a4ec4762bf166dafb16b6f9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:44.535488 11092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 01:49:44.537256 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02f9e96bcdf9418ea54dc73bf68a2be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.539288 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccffbe61eea34333abdc6da94612c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.542675 11753 tablet_bootstrap.cc:492] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.542973 11753 ts_tablet_manager.cc:1403] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.210s user 0.073s sys 0.099s
I20260925 01:49:44.544206 11753 raft_consensus.cc:359] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.544570 11753 raft_consensus.cc:385] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.544684 11753 raft_consensus.cc:740] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.545004 11753 consensus_queue.cc:260] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.545706 11753 ts_tablet_manager.cc:1434] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260925 01:49:44.546211 11753 tablet_bootstrap.cc:492] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.548673 11753 tablet_bootstrap.cc:654] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.551425 11747 raft_consensus.cc:2243] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.554018 11498 tablet_service.cc:1511] Processing CreateTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 (DEFAULT_TABLE table=default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.554551 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb98d5a38f43450c80d057d9eb2f92d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.552606 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet c3289c6dc8e84a358f877a197412d901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.556017 11772 raft_consensus.cc:493] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.556268 11772 raft_consensus.cc:515] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.558439 11772 leader_election.cc:290] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.560150 11221 tablet_service.cc:1511] Processing CreateTablet for tablet ccffbe61eea34333abdc6da94612c0f6 (DEFAULT_TABLE table=default.Table_b2c32d1c9f694835aa159840a4024f00 [id=fd0ffd9fb56b40f590be7bd7b9128f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.560640 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccffbe61eea34333abdc6da94612c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.562384 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 67921f86c4f6422e97d7f306262569f8 (DEFAULT_TABLE table=default.Table_c42a2d0957624d578f66a1c0268d2ef2 [id=107d0cda55154f5e84ce4dd14d36364a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.562870 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67921f86c4f6422e97d7f306262569f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.566701 11213 tablet_service.cc:1511] Processing CreateTablet for tablet ba19192502634f8599407d923114a627 (DEFAULT_TABLE table=default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.567099 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba19192502634f8599407d923114a627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.569573 11491 tablet_service.cc:1511] Processing CreateTablet for tablet a3358b78a1da48388d1f72536b1ed0a2 (DEFAULT_TABLE table=default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.570152 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3358b78a1da48388d1f72536b1ed0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.571094 11212 tablet_service.cc:1511] Processing CreateTablet for tablet c4eb584e929c46f891d28ad01e6d78ae (DEFAULT_TABLE table=default.Table_7f229e69d1044678b1b85292293ee4e5 [id=cde938f51c1d4ea8a32a3f9b684c510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.571568 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4eb584e929c46f891d28ad01e6d78ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.575373 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (DEFAULT_TABLE table=default.Table_cb56a1417e89414aaf3f117d28525d3b [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.575847 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5021ab79dc4eaf9ed612f7125a6dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.578325 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6058cd7c17b4544a565a5aacfb9df92" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:44.579089 11214 tablet_service.cc:1511] Processing CreateTablet for tablet c28c9e51d80a442486b78be32c74a94f (DEFAULT_TABLE table=default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:44.579348 11177 leader_election.cc:343] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.579576 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28c9e51d80a442486b78be32c74a94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.581840 11747 raft_consensus.cc:2272] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:44.582468 11176 leader_election.cc:343] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:44.582691 11176 leader_election.cc:304] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:44.583141 11772 raft_consensus.cc:2749] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.583772 11747 ts_tablet_manager.cc:1916] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.584060 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (DEFAULT_TABLE table=default.Table_ab792e1485f44174b025aba98b817a48 [id=861f838981bc470e9d593a7733c4526f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.584575 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7496a9eaa1714e9fa83d8c88bf1070fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.589797 11218 tablet_service.cc:1511] Processing CreateTablet for tablet a3358b78a1da48388d1f72536b1ed0a2 (DEFAULT_TABLE table=default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.595638 11754 tablet_bootstrap.cc:654] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.607438 11755 tablet_bootstrap.cc:492] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.613425 11209 tablet_service.cc:1511] Processing CreateTablet for tablet ca76f6f710d841fd8999b40e5a48693f (DEFAULT_TABLE table=default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.613866 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:34520
I20260925 01:49:44.616269 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 00906edfa6b648229bcba8e59d68b969 (DEFAULT_TABLE table=default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.617007 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00906edfa6b648229bcba8e59d68b969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.618104 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 00906edfa6b648229bcba8e59d68b969 (DEFAULT_TABLE table=default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.627099 11755 ts_tablet_manager.cc:1403] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.243s user 0.031s sys 0.013s
I20260925 01:49:44.628973 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3358b78a1da48388d1f72536b1ed0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.635118 11490 tablet_service.cc:1511] Processing CreateTablet for tablet ca76f6f710d841fd8999b40e5a48693f (DEFAULT_TABLE table=default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.635810 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca76f6f710d841fd8999b40e5a48693f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.641564 11210 tablet_service.cc:1511] Processing CreateTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 (DEFAULT_TABLE table=default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.642412 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd27c6d835948ba859b4c11d8ebf783 (DEFAULT_TABLE table=default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.642954 11502 tablet_service.cc:1511] Processing CreateTablet for tablet ccffbe61eea34333abdc6da94612c0f6 (DEFAULT_TABLE table=default.Table_b2c32d1c9f694835aa159840a4024f00 [id=fd0ffd9fb56b40f590be7bd7b9128f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.643503 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccffbe61eea34333abdc6da94612c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.643625 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00906edfa6b648229bcba8e59d68b969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.644618 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd27c6d835948ba859b4c11d8ebf783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.645496 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca76f6f710d841fd8999b40e5a48693f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.653576 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb98d5a38f43450c80d057d9eb2f92d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.654598 11492 tablet_service.cc:1511] Processing CreateTablet for tablet ba19192502634f8599407d923114a627 (DEFAULT_TABLE table=default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.655238 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba19192502634f8599407d923114a627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.662899 11499 tablet_service.cc:1511] Processing CreateTablet for tablet c28c9e51d80a442486b78be32c74a94f (DEFAULT_TABLE table=default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.663503 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28c9e51d80a442486b78be32c74a94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.662813 11755 raft_consensus.cc:359] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.670868 11755 raft_consensus.cc:385] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.671015 11755 raft_consensus.cc:740] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.671913 11750 ts_tablet_manager.cc:1929] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.671926 11755 consensus_queue.cc:260] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.672091 11750 log.cc:1199] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/bb82b7b398f040da8d14725d74eafd64
I20260925 01:49:44.672464 11750 ts_tablet_manager.cc:1950] T bb82b7b398f040da8d14725d74eafd64 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:44.672590 11755 ts_tablet_manager.cc:1434] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260925 01:49:44.673534 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.680894 11755 tablet_bootstrap.cc:492] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.690862 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 67921f86c4f6422e97d7f306262569f8 (DEFAULT_TABLE table=default.Table_c42a2d0957624d578f66a1c0268d2ef2 [id=107d0cda55154f5e84ce4dd14d36364a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.691543 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67921f86c4f6422e97d7f306262569f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.702724 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (DEFAULT_TABLE table=default.Table_cb56a1417e89414aaf3f117d28525d3b [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.703522 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c5021ab79dc4eaf9ed612f7125a6dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.706447 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 8dd27c6d835948ba859b4c11d8ebf783 (DEFAULT_TABLE table=default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.707083 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd27c6d835948ba859b4c11d8ebf783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.713032 11755 tablet_bootstrap.cc:654] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.718568 11747 ts_tablet_manager.cc:1929] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.719002 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96165d1a85d4ee99748563078ae2a3e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:44.719744 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4683df170284c228a08df5422e37d16" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:44.720371 11499 tablet_service.cc:1511] Processing CreateTablet for tablet c4eb584e929c46f891d28ad01e6d78ae (DEFAULT_TABLE table=default.Table_7f229e69d1044678b1b85292293ee4e5 [id=cde938f51c1d4ea8a32a3f9b684c510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.720933 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4eb584e929c46f891d28ad01e6d78ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.723426 11753 tablet_bootstrap.cc:492] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.723583 11753 ts_tablet_manager.cc:1403] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.178s user 0.054s sys 0.104s
I20260925 01:49:44.724484 11753 raft_consensus.cc:359] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.724727 11753 raft_consensus.cc:385] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.724900 11753 raft_consensus.cc:740] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.725270 11753 consensus_queue.cc:260] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.725965 11753 ts_tablet_manager.cc:1434] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:44.726382 11753 tablet_bootstrap.cc:492] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.729319 11753 tablet_bootstrap.cc:654] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.730983 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (DEFAULT_TABLE table=default.Table_ab792e1485f44174b025aba98b817a48 [id=861f838981bc470e9d593a7733c4526f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:44.731424 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7496a9eaa1714e9fa83d8c88bf1070fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:44.735422 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:41980
I20260925 01:49:44.735675 11745 tablet_replica.cc:333] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:44.735895 11745 raft_consensus.cc:2243] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.736060 11745 raft_consensus.cc:2272] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.741195 11745 ts_tablet_manager.cc:1916] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:44.720570 11314 leader_election.cc:343] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.746029 11314 leader_election.cc:304] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:44.746539 11314 raft_consensus.cc:2686] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:49:44.747284 11314 leader_election.cc:343] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: bb82b7b398f040da8d14725d74eafd64
I20260925 01:49:44.747486 11314 leader_election.cc:304] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:44.748059 11780 raft_consensus.cc:2749] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.748813 11747 log.cc:1199] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c96165d1a85d4ee99748563078ae2a3e
I20260925 01:49:44.749449 11747 ts_tablet_manager.cc:1950] T c96165d1a85d4ee99748563078ae2a3e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:44.751839 11750 tablet_replica.cc:333] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:44.752137 11750 raft_consensus.cc:2243] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.752389 11747 tablet_replica.cc:333] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:44.752545 11750 raft_consensus.cc:2272] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.752739 11747 raft_consensus.cc:2243] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.754004 11747 raft_consensus.cc:2272] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.753849 11754 tablet_bootstrap.cc:492] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:44.756712 11754 ts_tablet_manager.cc:1403] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.390s user 0.008s sys 0.000s
I20260925 01:49:44.756487 11750 ts_tablet_manager.cc:1916] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.757815 11754 raft_consensus.cc:359] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.758076 11754 raft_consensus.cc:385] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.758486 11754 raft_consensus.cc:740] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.758769 11754 consensus_queue.cc:260] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.764117 11745 ts_tablet_manager.cc:1929] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.765980 11754 ts_tablet_manager.cc:1434] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
W20260925 01:49:44.754678 11314 leader_election.cc:343] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.766260 11314 leader_election.cc:304] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:44.767860 11780 raft_consensus.cc:2749] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.756450 11755 tablet_bootstrap.cc:492] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.768575 11755 ts_tablet_manager.cc:1403] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.001s
I20260925 01:49:44.769351 11755 raft_consensus.cc:359] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.769527 11755 raft_consensus.cc:385] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.769645 11755 raft_consensus.cc:740] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.769932 11755 consensus_queue.cc:260] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.770637 11745 log.cc:1199] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a26b7ec7373d42668f40c7c89084be47
I20260925 01:49:44.772030 11745 ts_tablet_manager.cc:1950] T a26b7ec7373d42668f40c7c89084be47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:44.773154 11755 ts_tablet_manager.cc:1434] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260925 01:49:44.776129 11755 tablet_bootstrap.cc:492] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.778800 11755 tablet_bootstrap.cc:654] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.780354 11754 tablet_bootstrap.cc:492] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:44.778748 11750 ts_tablet_manager.cc:1929] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.783658 11750 log.cc:1199] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/da74fa4b6fa841b7aebb81302cab2885
I20260925 01:49:44.784397 11750 ts_tablet_manager.cc:1950] T da74fa4b6fa841b7aebb81302cab2885 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:44.781064 11747 ts_tablet_manager.cc:1916] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.785470 11753 tablet_bootstrap.cc:492] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.785698 11753 ts_tablet_manager.cc:1403] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.059s user 0.015s sys 0.023s
I20260925 01:49:44.786036 11750 tablet_replica.cc:333] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:44.786419 11750 raft_consensus.cc:2243] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.786718 11753 raft_consensus.cc:359] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.786985 11753 raft_consensus.cc:385] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.787161 11750 raft_consensus.cc:2272] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.787225 11753 raft_consensus.cc:740] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.787528 11753 consensus_queue.cc:260] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.788156 11753 ts_tablet_manager.cc:1434] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:44.787752 11754 tablet_bootstrap.cc:654] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.795126 11754 tablet_bootstrap.cc:492] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:44.795320 11750 ts_tablet_manager.cc:1916] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.795405 11754 ts_tablet_manager.cc:1403] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20260925 01:49:44.797080 11754 raft_consensus.cc:359] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.797329 11754 raft_consensus.cc:385] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.797463 11754 raft_consensus.cc:740] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.797722 11754 consensus_queue.cc:260] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.799047 11755 tablet_bootstrap.cc:492] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.799252 11755 ts_tablet_manager.cc:1403] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260925 01:49:44.800047 11755 raft_consensus.cc:359] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.800256 11755 raft_consensus.cc:385] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.800341 11755 raft_consensus.cc:740] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.800612 11755 consensus_queue.cc:260] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.802027 11753 tablet_bootstrap.cc:492] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.803409 11755 ts_tablet_manager.cc:1434] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:49:44.804024 11753 tablet_bootstrap.cc:654] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.805670 11755 tablet_bootstrap.cc:492] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.807973 11755 tablet_bootstrap.cc:654] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.809302 11754 ts_tablet_manager.cc:1434] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260925 01:49:44.812278 11754 tablet_bootstrap.cc:492] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:44.812508 11753 tablet_bootstrap.cc:492] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.812682 11753 ts_tablet_manager.cc:1403] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20260925 01:49:44.813434 11753 raft_consensus.cc:359] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.813683 11753 raft_consensus.cc:385] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.813803 11753 raft_consensus.cc:740] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.810367 11747 ts_tablet_manager.cc:1929] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.814100 11753 consensus_queue.cc:260] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.814265 11747 log.cc:1199] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ae497a92e49746a79cbbfe3c82b2b544
I20260925 01:49:44.814908 11747 ts_tablet_manager.cc:1950] T ae497a92e49746a79cbbfe3c82b2b544 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:44.816169 11754 tablet_bootstrap.cc:654] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.816408 11753 ts_tablet_manager.cc:1434] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260925 01:49:44.816740 11753 tablet_bootstrap.cc:492] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.818720 11753 tablet_bootstrap.cc:654] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.819175 11747 tablet_replica.cc:333] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:44.819486 11747 raft_consensus.cc:2243] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:44.819756 11747 raft_consensus.cc:2272] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:44.820497 11747 ts_tablet_manager.cc:1916] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:44.826565 11762 raft_consensus.cc:493] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.826789 11762 raft_consensus.cc:515] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.826928 11753 tablet_bootstrap.cc:492] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.827105 11753 ts_tablet_manager.cc:1403] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20260925 01:49:44.827610 11762 leader_election.cc:290] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:44.828150 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9884d7af60324a24ad06d6fa5db358b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:44.828583 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9884d7af60324a24ad06d6fa5db358b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:44.828893 11457 leader_election.cc:343] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:44.829157 11456 leader_election.cc:343] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.829306 11456 leader_election.cc:304] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:44.829608 11753 raft_consensus.cc:359] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.829738 11762 raft_consensus.cc:2749] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.829918 11753 raft_consensus.cc:385] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.830091 11753 raft_consensus.cc:740] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.830382 11753 consensus_queue.cc:260] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.830961 11753 ts_tablet_manager.cc:1434] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:49:44.830967 11750 ts_tablet_manager.cc:1929] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.831106 11750 log.cc:1199] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/bfd9645cd6644a55997eb7745c7b29f2
I20260925 01:49:44.831343 11753 tablet_bootstrap.cc:492] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.831863 11750 ts_tablet_manager.cc:1950] T bfd9645cd6644a55997eb7745c7b29f2 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:44.833156 11753 tablet_bootstrap.cc:654] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.834704 11755 tablet_bootstrap.cc:492] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.834885 11755 ts_tablet_manager.cc:1403] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.003s
I20260925 01:49:44.835808 11755 raft_consensus.cc:359] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.836017 11755 raft_consensus.cc:385] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.836118 11755 raft_consensus.cc:740] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.836951 11755 consensus_queue.cc:260] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.840162 11772 raft_consensus.cc:493] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.840782 11755 ts_tablet_manager.cc:1434] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260925 01:49:44.840703 11772 raft_consensus.cc:515] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.841466 11772 leader_election.cc:290] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.842278 11755 tablet_bootstrap.cc:492] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.842206 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:44.842483 11522 raft_consensus.cc:2468] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:44.841966 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:44.843227 11176 leader_election.cc:304] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:49:44.843838 11177 leader_election.cc:343] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.844502 11753 tablet_bootstrap.cc:492] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.844708 11753 ts_tablet_manager.cc:1403] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.002s
I20260925 01:49:44.845570 11753 raft_consensus.cc:359] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.845836 11753 raft_consensus.cc:385] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.845959 11753 raft_consensus.cc:740] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.846249 11753 consensus_queue.cc:260] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.846493 11772 raft_consensus.cc:2804] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:44.846626 11772 raft_consensus.cc:493] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:44.846728 11772 raft_consensus.cc:3060] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:44.846892 11753 ts_tablet_manager.cc:1434] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:49:44.847191 11753 tablet_bootstrap.cc:492] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.847262 11755 tablet_bootstrap.cc:654] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.849119 11753 tablet_bootstrap.cc:654] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.854728 11772 raft_consensus.cc:515] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.856544 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:44.856938 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:44.857272 11177 leader_election.cc:343] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.857290 11522 raft_consensus.cc:3060] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:44.862821 11522 raft_consensus.cc:2468] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:44.863726 11176 leader_election.cc:304] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:44.866437 11772 leader_election.cc:290] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.868299 11772 raft_consensus.cc:2804] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:44.868710 11772 raft_consensus.cc:697] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:44.869763 11772 consensus_queue.cc:237] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.871934 11753 tablet_bootstrap.cc:492] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.838029 11754 tablet_bootstrap.cc:492] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:44.872208 11753 ts_tablet_manager.cc:1403] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.020s
I20260925 01:49:44.872387 11754 ts_tablet_manager.cc:1403] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.004s
I20260925 01:49:44.873198 11753 raft_consensus.cc:359] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.873517 11753 raft_consensus.cc:385] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.873646 11753 raft_consensus.cc:740] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.874045 11753 consensus_queue.cc:260] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.874782 11753 ts_tablet_manager.cc:1434] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:49:44.875239 11753 tablet_bootstrap.cc:492] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.877851 11753 tablet_bootstrap.cc:654] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.879014 11754 raft_consensus.cc:359] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.879825 11754 raft_consensus.cc:385] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.881371 11754 raft_consensus.cc:740] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.881734 11754 consensus_queue.cc:260] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.890112 11754 ts_tablet_manager.cc:1434] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s
I20260925 01:49:44.891120 11753 tablet_bootstrap.cc:492] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.891376 11753 ts_tablet_manager.cc:1403] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.002s
I20260925 01:49:44.891685 11754 tablet_bootstrap.cc:492] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:44.892134 11747 ts_tablet_manager.cc:1929] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:44.892673 11753 raft_consensus.cc:359] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.892953 11753 raft_consensus.cc:385] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.893086 11753 raft_consensus.cc:740] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.893224 11747 log.cc:1199] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/bb82b7b398f040da8d14725d74eafd64
I20260925 01:49:44.893437 11753 consensus_queue.cc:260] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.897574 11754 tablet_bootstrap.cc:654] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.897895 11747 ts_tablet_manager.cc:1950] T bb82b7b398f040da8d14725d74eafd64 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:44.899750 11753 ts_tablet_manager.cc:1434] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.002s sys 0.002s
I20260925 01:49:44.900306 11753 tablet_bootstrap.cc:492] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.899361 11755 tablet_bootstrap.cc:492] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.900537 11755 ts_tablet_manager.cc:1403] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.058s user 0.031s sys 0.017s
I20260925 01:49:44.901394 11755 raft_consensus.cc:359] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.901613 11755 raft_consensus.cc:385] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.901683 11755 raft_consensus.cc:740] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.901968 11755 consensus_queue.cc:260] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.902475 11755 ts_tablet_manager.cc:1434] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:44.902892 11755 tablet_bootstrap.cc:492] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.904733 11755 tablet_bootstrap.cc:654] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.912400 11753 tablet_bootstrap.cc:654] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.917536 11754 tablet_bootstrap.cc:492] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:44.917876 11754 ts_tablet_manager.cc:1403] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.001s
I20260925 01:49:44.918339 11753 tablet_bootstrap.cc:492] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.918561 11753 ts_tablet_manager.cc:1403] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.005s
I20260925 01:49:44.919116 11754 raft_consensus.cc:359] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.919443 11753 raft_consensus.cc:359] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.919806 11753 raft_consensus.cc:385] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.919957 11753 raft_consensus.cc:740] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.920305 11754 raft_consensus.cc:385] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.920444 11754 raft_consensus.cc:740] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.920311 11753 consensus_queue.cc:260] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.920733 11754 consensus_queue.cc:260] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.921166 11755 tablet_bootstrap.cc:492] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.921331 11755 ts_tablet_manager.cc:1403] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.007s
I20260925 01:49:44.922199 11755 raft_consensus.cc:359] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.922385 11755 raft_consensus.cc:385] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.922469 11755 raft_consensus.cc:740] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.922714 11754 ts_tablet_manager.cc:1434] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:49:44.922696 11755 consensus_queue.cc:260] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.923419 11755 ts_tablet_manager.cc:1434] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:44.923790 11755 tablet_bootstrap.cc:492] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.924068 11754 tablet_bootstrap.cc:492] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:44.925755 11755 tablet_bootstrap.cc:654] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.927791 11772 raft_consensus.cc:493] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.927984 11772 raft_consensus.cc:515] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.928661 11772 leader_election.cc:290] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.929163 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65068a447744ec99e56489963b251c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:44.929351 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65068a447744ec99e56489963b251c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:44.930009 11176 leader_election.cc:343] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.931706 11762 raft_consensus.cc:493] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:44.931818 11177 leader_election.cc:343] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:44.931967 11177 leader_election.cc:304] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:44.931938 11762 raft_consensus.cc:515] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.932389 11772 raft_consensus.cc:2749] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.932821 11762 leader_election.cc:290] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:44.934548 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96b272afb8341dd9bfff9702c433026" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:44.935693 11456 leader_election.cc:343] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:44.936026 11457 leader_election.cc:343] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: b96b272afb8341dd9bfff9702c433026
I20260925 01:49:44.936160 11457 leader_election.cc:304] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:44.937263 11755 tablet_bootstrap.cc:492] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.937314 11762 raft_consensus.cc:2749] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.937522 11755 ts_tablet_manager.cc:1403] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.008s
I20260925 01:49:44.938135 11754 tablet_bootstrap.cc:654] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.938555 11755 raft_consensus.cc:359] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:44.938833 11755 raft_consensus.cc:385] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.938948 11755 raft_consensus.cc:740] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.939237 11755 consensus_queue.cc:260] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:44.939903 11755 ts_tablet_manager.cc:1434] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:44.940277 11755 tablet_bootstrap.cc:492] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.942854 11755 tablet_bootstrap.cc:654] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.944872 11753 ts_tablet_manager.cc:1434] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.026s user 0.002s sys 0.001s
I20260925 01:49:44.951062 11753 tablet_bootstrap.cc:492] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:44.951776 11755 tablet_bootstrap.cc:492] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.951977 11755 ts_tablet_manager.cc:1403] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260925 01:49:44.952823 11755 raft_consensus.cc:359] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.953100 11755 raft_consensus.cc:385] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.953233 11755 raft_consensus.cc:740] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.953307 11753 tablet_bootstrap.cc:654] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.953544 11755 consensus_queue.cc:260] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.954265 11755 ts_tablet_manager.cc:1434] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:44.955188 11755 tablet_bootstrap.cc:492] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.958271 11755 tablet_bootstrap.cc:654] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.960834 11754 tablet_bootstrap.cc:492] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:44.961246 11754 ts_tablet_manager.cc:1403] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.004s
I20260925 01:49:44.962810 11754 raft_consensus.cc:359] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.963261 11754 raft_consensus.cc:385] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.963471 11754 raft_consensus.cc:740] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.963922 11754 consensus_queue.cc:260] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.969502 11754 ts_tablet_manager.cc:1434] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260925 01:49:44.970309 11753 tablet_bootstrap.cc:492] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:44.971490 11755 tablet_bootstrap.cc:492] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.971794 11755 ts_tablet_manager.cc:1403] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.010s
I20260925 01:49:44.971879 11762 raft_consensus.cc:493] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:44.972407 11762 raft_consensus.cc:515] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.972915 11755 raft_consensus.cc:359] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.973208 11755 raft_consensus.cc:385] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.973305 11755 raft_consensus.cc:740] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.973369 11754 tablet_bootstrap.cc:492] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:44.973382 11762 leader_election.cc:290] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:44.973678 11755 consensus_queue.cc:260] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.974401 11755 ts_tablet_manager.cc:1434] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:44.974910 11755 tablet_bootstrap.cc:492] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:44.976294 11457 leader_election.cc:343] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:44.976823 11780 raft_consensus.cc:493] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:44.976868 11456 leader_election.cc:343] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:44.976985 11456 leader_election.cc:304] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:44.977042 11780 raft_consensus.cc:515] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.977335 11755 tablet_bootstrap.cc:654] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.977766 11780 leader_election.cc:290] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:44.978586 11762 raft_consensus.cc:2749] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.979252 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26b7ec7373d42668f40c7c89084be47" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:44.980463 11314 leader_election.cc:343] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:44.982339 11314 leader_election.cc:343] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a26b7ec7373d42668f40c7c89084be47
I20260925 01:49:44.982518 11314 leader_election.cc:304] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:44.983070 11780 raft_consensus.cc:2749] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:44.983412 11754 tablet_bootstrap.cc:654] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.985234 11753 ts_tablet_manager.cc:1403] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.008s
I20260925 01:49:44.986660 11753 raft_consensus.cc:359] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.987160 11753 raft_consensus.cc:385] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.987344 11753 raft_consensus.cc:740] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.987864 11753 consensus_queue.cc:260] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.991421 11755 tablet_bootstrap.cc:492] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:44.991588 11755 ts_tablet_manager.cc:1403] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.013s
I20260925 01:49:44.992272 11753 ts_tablet_manager.cc:1434] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260925 01:49:44.992381 11755 raft_consensus.cc:359] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.992599 11755 raft_consensus.cc:385] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:44.992693 11755 raft_consensus.cc:740] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:44.992933 11755 consensus_queue.cc:260] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.993583 11755 ts_tablet_manager.cc:1434] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:49:44.993942 11755 tablet_bootstrap.cc:492] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:44.996017 11755 tablet_bootstrap.cc:654] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:44.998977 11753 tablet_bootstrap.cc:492] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.001191 11753 tablet_bootstrap.cc:654] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.003523 11754 tablet_bootstrap.cc:492] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.003713 11754 ts_tablet_manager.cc:1403] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.001s
I20260925 01:49:45.004110 11755 tablet_bootstrap.cc:492] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.004384 11755 ts_tablet_manager.cc:1403] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260925 01:49:45.004500 11754 raft_consensus.cc:359] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.004700 11754 raft_consensus.cc:385] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.004769 11754 raft_consensus.cc:740] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.005015 11754 consensus_queue.cc:260] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.005640 11754 ts_tablet_manager.cc:1434] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:45.006132 11754 tablet_bootstrap.cc:492] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.007834 11755 raft_consensus.cc:359] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.008142 11755 raft_consensus.cc:385] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.008263 11754 tablet_bootstrap.cc:654] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.008277 11755 raft_consensus.cc:740] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.008621 11755 consensus_queue.cc:260] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.010440 11755 ts_tablet_manager.cc:1434] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260925 01:49:45.010782 11755 tablet_bootstrap.cc:492] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.013597 11755 tablet_bootstrap.cc:654] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.032117 11755 tablet_bootstrap.cc:492] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.032382 11755 ts_tablet_manager.cc:1403] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.009s
I20260925 01:49:45.035733 11754 tablet_bootstrap.cc:492] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.035920 11754 ts_tablet_manager.cc:1403] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.006s
I20260925 01:49:45.036978 11754 raft_consensus.cc:359] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.037279 11754 raft_consensus.cc:385] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.037461 11754 raft_consensus.cc:740] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.037825 11754 consensus_queue.cc:260] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.039817 11755 raft_consensus.cc:359] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.040220 11755 raft_consensus.cc:385] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.040385 11755 raft_consensus.cc:740] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.040678 11755 consensus_queue.cc:260] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.042443 11866 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca2cee7752c249f68a372ef5c6a18bff)
I20260925 01:49:45.042761 11866 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:45.043497 11753 tablet_bootstrap.cc:492] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.043743 11753 ts_tablet_manager.cc:1403] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.045s user 0.012s sys 0.008s
I20260925 01:49:45.044186 11866 leader_election.cc:290] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:49:45.047730 11754 ts_tablet_manager.cc:1434] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.012s user 0.001s sys 0.002s
I20260925 01:49:45.048120 11754 tablet_bootstrap.cc:492] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.049619 11755 ts_tablet_manager.cc:1434] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
I20260925 01:49:45.051822 11754 tablet_bootstrap.cc:654] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.055166 11755 tablet_bootstrap.cc:492] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.057981 11755 tablet_bootstrap.cc:654] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.061615 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 4 candidate_status { last_received { term: 3 index: 166 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:49:45.062212 11690 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec2f98d6295c4f8ead68b46f01e73d37 for term 4 because replica has last-logged OpId of term: 3 index: 167, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 166.
I20260925 01:49:45.063915 11755 tablet_bootstrap.cc:492] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.064134 11755 ts_tablet_manager.cc:1403] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260925 01:49:45.065225 11755 raft_consensus.cc:359] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.065523 11755 raft_consensus.cc:385] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.065623 11755 raft_consensus.cc:740] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.066000 11755 consensus_queue.cc:260] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.066354 11753 raft_consensus.cc:359] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.066835 11753 raft_consensus.cc:385] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.066952 11753 raft_consensus.cc:740] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.067261 11753 consensus_queue.cc:260] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.067921 11753 ts_tablet_manager.cc:1434] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260925 01:49:45.068287 11753 tablet_bootstrap.cc:492] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.068995 11754 tablet_bootstrap.cc:492] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.069751 11053 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_c6503d38584945e3a845e2f96ab5a4fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:45.067947 11867 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca2cee7752c249f68a372ef5c6a18bff)
W20260925 01:49:45.070485 11053 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6503d38584945e3a845e2f96ab5a4fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:45.070674 11048 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c96165d1a85d4ee99748563078ae2a3e (table default.Table_9ef5c3e705a5472e95916b5b9e5a6700 [id=ca8c84b0f3fd4aac9fb747b21cfec090]) successfully deleted
I20260925 01:49:45.070586 11867 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
W20260925 01:49:45.070938 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bfd9645cd6644a55997eb7745c7b29f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfd9645cd6644a55997eb7745c7b29f2 already in progress: creating tablet
W20260925 01:49:45.071245 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 105fd502b74d442eb5d5031f56e5cb62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 105fd502b74d442eb5d5031f56e5cb62 already in progress: creating tablet
W20260925 01:49:45.071485 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 3eb4dac3099346a7975229d472a3919e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eb4dac3099346a7975229d472a3919e already in progress: creating tablet
W20260925 01:49:45.071753 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b9937c3776f549dea887ace26dae492c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9937c3776f549dea887ace26dae492c already in progress: creating tablet
W20260925 01:49:45.071987 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a9e1f114c2a749d4af6a366c044f5ea5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9e1f114c2a749d4af6a366c044f5ea5 already in progress: creating tablet
I20260925 01:49:45.072170 11048 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ae497a92e49746a79cbbfe3c82b2b544 (table default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]) successfully deleted
W20260925 01:49:45.072335 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c3289c6dc8e84a358f877a197412d901 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3289c6dc8e84a358f877a197412d901 already in progress: creating tablet
W20260925 01:49:45.072501 11048 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ccffbe61eea34333abdc6da94612c0f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccffbe61eea34333abdc6da94612c0f6 already in progress: creating tablet
I20260925 01:49:45.072636 11048 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet bb82b7b398f040da8d14725d74eafd64 (table default.Table_91898e72d7854ba2b9c085048d7e0b95 [id=fb4d1c608ffb4982afe923ea6e8103af]) successfully deleted
I20260925 01:49:45.073127 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 4 candidate_status { last_received { term: 3 index: 167 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" is_pre_election: true
I20260925 01:49:45.073396 10999 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17a1694989f748dfa9cdb2c10f3f1de5 in term 3.
I20260925 01:49:45.074331 11667 leader_election.cc:304] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a1694989f748dfa9cdb2c10f3f1de5, ec2f98d6295c4f8ead68b46f01e73d37; no voters:
I20260925 01:49:45.074756 11755 ts_tablet_manager.cc:1434] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260925 01:49:45.075115 11755 tablet_bootstrap.cc:492] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.077126 11754 ts_tablet_manager.cc:1403] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.002s
I20260925 01:49:45.077571 11755 tablet_bootstrap.cc:654] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.078179 11754 raft_consensus.cc:359] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.078425 11754 raft_consensus.cc:385] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.078509 11754 raft_consensus.cc:740] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.078765 11754 consensus_queue.cc:260] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.079236 11753 tablet_bootstrap.cc:654] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.079319 11754 ts_tablet_manager.cc:1434] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:45.079731 11754 tablet_bootstrap.cc:492] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.080430 11867 leader_election.cc:290] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:49:45.080806 11867 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 01:49:45.081009 11867 raft_consensus.cc:493] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca2cee7752c249f68a372ef5c6a18bff)
I20260925 01:49:45.081202 11867 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 01:49:45.086220 11867 raft_consensus.cc:515] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:45.087185 11867 leader_election.cc:290] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 4 election: Requested vote from peers ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:49:45.087533 11754 tablet_bootstrap.cc:654] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.092677 11753 tablet_bootstrap.cc:492] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.092931 11753 ts_tablet_manager.cc:1403] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.002s
I20260925 01:49:45.093750 11753 raft_consensus.cc:359] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.094009 11753 raft_consensus.cc:385] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.094152 11753 raft_consensus.cc:740] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.094491 11753 consensus_queue.cc:260] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:44.535792 11054 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_58fdde0b3e6a47b79d42646ec2ed37ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:45.095362 11055 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55092:
table { table_name: "default.Table_46b43d62b822482c8a723d9e33935c02" } modify_external_catalogs: true
I20260925 01:49:45.096160 11058 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55092:
name: "default.Table_3f397bb38f82466883e8e43a81afcf4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:45.097766 11072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 4 candidate_status { last_received { term: 3 index: 167 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:49:45.098541 10879 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAIg11R/build/asan/bin/kudu with pid 11028
I20260925 01:49:45.100843 11753 ts_tablet_manager.cc:1434] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260925 01:49:45.101301 11753 tablet_bootstrap.cc:492] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.103987 11753 tablet_bootstrap.cc:654] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.107801 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" candidate_term: 4 candidate_status { last_received { term: 3 index: 167 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
I20260925 01:49:45.108155 10999 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 3 FOLLOWER]: Advancing to term 4
I20260925 01:49:45.111986 11754 tablet_bootstrap.cc:492] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.112251 11754 ts_tablet_manager.cc:1403] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.033s user 0.005s sys 0.004s
I20260925 01:49:45.113713 11754 raft_consensus.cc:359] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.114032 10999 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17a1694989f748dfa9cdb2c10f3f1de5 in term 4.
I20260925 01:49:45.114210 11754 raft_consensus.cc:385] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.114343 11754 raft_consensus.cc:740] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.114825 11754 consensus_queue.cc:260] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.115960 11754 ts_tablet_manager.cc:1434] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260925 01:49:45.116423 11754 tablet_bootstrap.cc:492] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.119299 11754 tablet_bootstrap.cc:654] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.124181 11667 leader_election.cc:304] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17a1694989f748dfa9cdb2c10f3f1de5, ec2f98d6295c4f8ead68b46f01e73d37; no voters:
I20260925 01:49:45.124647 11874 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 01:49:45.124943 11874 raft_consensus.cc:697] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [term 4 LEADER]: Becoming Leader. State: Replica: 17a1694989f748dfa9cdb2c10f3f1de5, State: Running, Role: LEADER
I20260925 01:49:45.127036 11874 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 167, Committed index: 167, Last appended: 3.167, Last appended by leader: 167, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:45.131117 11772 raft_consensus.cc:493] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.131371 11772 raft_consensus.cc:515] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.132335 11772 leader_election.cc:290] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.133224 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96b272afb8341dd9bfff9702c433026" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.133535 11522 raft_consensus.cc:2468] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:49:45.133556 11177 leader_election.cc:343] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: b96b272afb8341dd9bfff9702c433026
I20260925 01:49:45.134311 11176 leader_election.cc:304] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:45.135052 11772 raft_consensus.cc:2804] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.135182 11772 raft_consensus.cc:493] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.135311 11772 raft_consensus.cc:3060] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.136760 11753 tablet_bootstrap.cc:492] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.138810 11867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1694989f748dfa9cdb2c10f3f1de5. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:45.139204 11867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:45.140175 11772 raft_consensus.cc:515] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.140914 11882 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
I20260925 01:49:45.137023 11753 ts_tablet_manager.cc:1403] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.016s
I20260925 01:49:45.141925 11772 leader_election.cc:290] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.142913 11754 tablet_bootstrap.cc:492] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.142930 11753 raft_consensus.cc:359] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:45.143064 11177 leader_election.cc:343] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: b96b272afb8341dd9bfff9702c433026
I20260925 01:49:45.143221 11753 raft_consensus.cc:385] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.143265 11754 ts_tablet_manager.cc:1403] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.012s
I20260925 01:49:45.143350 11753 raft_consensus.cc:740] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.143805 11753 consensus_queue.cc:260] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.144352 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96b272afb8341dd9bfff9702c433026" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.144464 11754 raft_consensus.cc:359] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.144585 11522 raft_consensus.cc:3060] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.144644 11753 ts_tablet_manager.cc:1434] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260925 01:49:45.144729 11754 raft_consensus.cc:385] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.144853 11754 raft_consensus.cc:740] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.145170 11754 consensus_queue.cc:260] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.145774 11754 ts_tablet_manager.cc:1434] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:45.146113 11754 tablet_bootstrap.cc:492] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.147795 11754 tablet_bootstrap.cc:654] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.147809 11522 raft_consensus.cc:2468] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:45.148717 11176 leader_election.cc:304] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:45.149360 11772 raft_consensus.cc:2804] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.149559 11772 raft_consensus.cc:697] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:45.149931 11772 consensus_queue.cc:237] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.153012 11753 tablet_bootstrap.cc:492] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.153821 11780 raft_consensus.cc:493] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.154016 11780 raft_consensus.cc:515] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.154805 11780 leader_election.cc:290] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.156132 11851 raft_consensus.cc:493] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.156315 11851 raft_consensus.cc:515] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.157109 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437bbb14fd264180887c0f5aa2ce80ea" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.157332 11239 raft_consensus.cc:2468] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.157418 11851 leader_election.cc:290] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.158425 11314 leader_election.cc:304] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:49:45.159008 11177 leader_election.cc:343] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: 81c7e15700f64a92b87a6901950c5412
I20260925 01:49:45.159329 11753 tablet_bootstrap.cc:654] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.160444 11780 raft_consensus.cc:2804] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.160559 11780 raft_consensus.cc:493] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.160671 11780 raft_consensus.cc:3060] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.164489 11780 raft_consensus.cc:515] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.165808 11762 raft_consensus.cc:493] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.166185 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437bbb14fd264180887c0f5aa2ce80ea" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.166486 11239 raft_consensus.cc:3060] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:45.169720 11176 leader_election.cc:343] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 81c7e15700f64a92b87a6901950c5412
I20260925 01:49:45.169910 11176 leader_election.cc:304] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:45.170464 11772 raft_consensus.cc:2749] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.170555 11762 raft_consensus.cc:515] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.171252 11762 leader_election.cc:290] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.171768 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437bbb14fd264180887c0f5aa2ce80ea" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.172001 11522 raft_consensus.cc:2468] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.173105 11755 tablet_bootstrap.cc:492] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.173303 11755 ts_tablet_manager.cc:1403] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.098s user 0.012s sys 0.039s
I20260925 01:49:45.174568 11755 raft_consensus.cc:359] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.174705 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7900db92b35048aaa200ed3183031d6b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.174846 11755 raft_consensus.cc:385] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.174988 11755 raft_consensus.cc:740] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.175030 11379 raft_consensus.cc:2468] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.175273 11755 consensus_queue.cc:260] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.175872 11457 leader_election.cc:304] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.176265 11780 leader_election.cc:290] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.177881 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951]
I20260925 01:49:45.178303 11762 raft_consensus.cc:2804] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.178450 11762 raft_consensus.cc:493] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.178545 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727]
I20260925 01:49:45.178596 11762 raft_consensus.cc:3060] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.179131 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]
I20260925 01:49:45.180230 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_fdcdf308781f4f5ab7f4be9110e4434a [id=0d689fa6870547f3a57c6b6149b94754]
I20260925 01:49:45.181159 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a]
I20260925 01:49:45.181715 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_c42a2d0957624d578f66a1c0268d2ef2 [id=107d0cda55154f5e84ce4dd14d36364a]
I20260925 01:49:45.182277 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]
I20260925 01:49:45.182300 11762 raft_consensus.cc:515] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.183812 11239 raft_consensus.cc:2468] T 437bbb14fd264180887c0f5aa2ce80ea P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.184312 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7900db92b35048aaa200ed3183031d6b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.184603 11242 raft_consensus.cc:3060] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.184731 11314 leader_election.cc:304] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.184978 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7900db92b35048aaa200ed3183031d6b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.185602 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87]
I20260925 01:49:45.185774 11780 raft_consensus.cc:2804] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.185863 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7900db92b35048aaa200ed3183031d6b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.186018 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]
I20260925 01:49:45.186170 11379 raft_consensus.cc:3060] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.186275 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437bbb14fd264180887c0f5aa2ce80ea" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.186466 11522 raft_consensus.cc:3060] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.185974 11780 raft_consensus.cc:697] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:45.186947 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]
I20260925 01:49:45.187059 11780 consensus_queue.cc:237] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.187381 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_39b1b83f732c44ca93f0e5e37326d739 [id=25512a7f4c4741d4aba6f86f1497dca4]
I20260925 01:49:45.187848 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]
I20260925 01:49:45.188261 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_cb56a1417e89414aaf3f117d28525d3b [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]
I20260925 01:49:45.188689 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327]
I20260925 01:49:45.189139 11242 raft_consensus.cc:2468] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.189951 11456 leader_election.cc:304] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.190129 11379 raft_consensus.cc:2468] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.190533 11754 tablet_bootstrap.cc:492] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.190788 11754 ts_tablet_manager.cc:1403] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.014s
I20260925 01:49:45.190920 11762 leader_election.cc:290] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.191162 11762 raft_consensus.cc:2804] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.191356 11762 raft_consensus.cc:697] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.191910 11762 consensus_queue.cc:237] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.191998 11754 raft_consensus.cc:359] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.192287 11754 raft_consensus.cc:385] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.192400 11754 raft_consensus.cc:740] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.192764 11754 consensus_queue.cc:260] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.193758 11754 ts_tablet_manager.cc:1434] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:45.193758 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded]
I20260925 01:49:45.194134 11754 tablet_bootstrap.cc:492] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.194881 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_cd22b64ded2d47498fba4bcaf54bc00a [id=351fd2bbafea4565a9cc4537f7f0c1aa]
I20260925 01:49:45.195401 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_2fe9e3d572a34772b63e49e00ceec625 [id=37bc53f74b2a4f618298bde3281e0ecf]
I20260925 01:49:45.196450 11754 tablet_bootstrap.cc:654] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.198880 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]
I20260925 01:49:45.199433 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]
I20260925 01:49:45.200289 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]
I20260925 01:49:45.203063 11522 raft_consensus.cc:2468] T 437bbb14fd264180887c0f5aa2ce80ea P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.203754 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_41614d44ad5844f9911213d219401534 [id=4ea66d3270f54caaa02e4084c6696342]
I20260925 01:49:45.204329 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_c7551c285d614e408f7784bdb7535702 [id=4fb54256e58245988a5cc88ce6565832]
I20260925 01:49:45.207036 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_393671d61d694438bfaf25af0b823b4c [id=56d41c65456f4cf691b9f87319014030]
I20260925 01:49:45.208766 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_e25c617f09054071828a13f1a7f5bdc7 [id=5a101d4224e546e686f9bf819b07c07b]
I20260925 01:49:45.210599 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_f753f432c5264d9399607b334195d845 [id=5bd8ff335261411fba51131e4dde1ea7]
I20260925 01:49:45.212926 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e]
I20260925 01:49:45.214814 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_ab792e1485f44174b025aba98b817a48 [id=861f838981bc470e9d593a7733c4526f]
I20260925 01:49:45.216423 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]
I20260925 01:49:45.218134 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_434ed55eea774802bad516c94af8ac39 [id=9389812769844f279c1e0c5fa9707dc0]
I20260925 01:49:45.219830 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]
I20260925 01:49:45.221500 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_716df684734d4100ba0e2266d8bdb6e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]
I20260925 01:49:45.223085 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915]
I20260925 01:49:45.224300 11780 raft_consensus.cc:493] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.224498 11780 raft_consensus.cc:515] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.225108 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]
I20260925 01:49:45.226200 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491d790067644090aa4d25f4060cc2ec" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.226233 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491d790067644090aa4d25f4060cc2ec" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.226779 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d]
W20260925 01:49:45.226884 11314 leader_election.cc:343] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:45.227180 11314 leader_election.cc:343] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:45.227301 11314 leader_election.cc:304] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.227619 11780 leader_election.cc:290] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.227998 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d]
I20260925 01:49:45.228070 11780 raft_consensus.cc:2749] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.230767 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]
I20260925 01:49:45.232632 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7]
I20260925 01:49:45.215857 11887 raft_consensus.cc:493] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.219455 11753 tablet_bootstrap.cc:492] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.234724 11753 ts_tablet_manager.cc:1403] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.082s user 0.003s sys 0.018s
I20260925 01:49:45.235378 11755 ts_tablet_manager.cc:1434] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.062s user 0.005s sys 0.025s
I20260925 01:49:45.235685 11753 raft_consensus.cc:359] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.235898 11753 raft_consensus.cc:385] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.236006 11753 raft_consensus.cc:740] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.236182 11755 tablet_bootstrap.cc:492] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.236279 11753 consensus_queue.cc:260] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.236825 11753 ts_tablet_manager.cc:1434] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:45.237234 11753 tablet_bootstrap.cc:492] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.239158 11755 tablet_bootstrap.cc:654] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.239650 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]
I20260925 01:49:45.241720 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]
I20260925 01:49:45.242722 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_7f229e69d1044678b1b85292293ee4e5 [id=cde938f51c1d4ea8a32a3f9b684c510b]
I20260925 01:49:45.243366 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]
I20260925 01:49:45.244611 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_ea9cb22dacf64efe966cbcfb02725dfe [id=e4e40511b79d43919b00485a71bf0509]
I20260925 01:49:45.245256 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930]
I20260925 01:49:45.245579 11772 raft_consensus.cc:493] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.245811 11772 raft_consensus.cc:515] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.246316 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7]
I20260925 01:49:45.246703 11772 leader_election.cc:290] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.246835 11753 tablet_bootstrap.cc:654] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.247320 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]
I20260925 01:49:45.248030 11887 raft_consensus.cc:515] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:45.248421 11177 leader_election.cc:343] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: ac03ebbd455f4fad88e875b69a049bc0
I20260925 01:49:45.249115 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_8f5194a1b70d43f185050d1bdb176d8b [id=f3f8339a90b64cd4812637e6f997f107]
W20260925 01:49:45.249229 11176 leader_election.cc:343] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: ac03ebbd455f4fad88e875b69a049bc0
I20260925 01:49:45.249408 11176 leader_election.cc:304] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:45.249528 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9558462332400d92f7d61858bdeca2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.249850 11242 raft_consensus.cc:2468] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.250257 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9558462332400d92f7d61858bdeca2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.250483 11456 leader_election.cc:304] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.250541 11379 raft_consensus.cc:2468] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.250396 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]
I20260925 01:49:45.251178 11772 raft_consensus.cc:2749] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.255056 11755 tablet_bootstrap.cc:492] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.255465 11755 ts_tablet_manager.cc:1403] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.000s
I20260925 01:49:45.255471 11762 raft_consensus.cc:2804] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.255750 11762 raft_consensus.cc:493] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.255936 11762 raft_consensus.cc:3060] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.256824 11755 raft_consensus.cc:359] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.257190 11755 raft_consensus.cc:385] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.257306 11755 raft_consensus.cc:740] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.257696 11755 consensus_queue.cc:260] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.258505 11755 ts_tablet_manager.cc:1434] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260925 01:49:45.258991 11755 tablet_bootstrap.cc:492] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.264034 11882 catalog_manager.cc:692] Loaded metadata for table default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]
I20260925 01:49:45.269243 11762 raft_consensus.cc:515] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.269433 11882 tablet_loader.cc:96] loaded metadata for tablet 00906edfa6b648229bcba8e59d68b969 (table default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6])
I20260925 01:49:45.270920 11753 tablet_bootstrap.cc:492] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.270874 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9558462332400d92f7d61858bdeca2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.271152 11242 raft_consensus.cc:3060] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.271364 11753 ts_tablet_manager.cc:1403] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.001s
I20260925 01:49:45.272472 11753 raft_consensus.cc:359] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.272750 11753 raft_consensus.cc:385] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.272847 11753 raft_consensus.cc:740] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.273165 11753 consensus_queue.cc:260] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.273880 11753 ts_tablet_manager.cc:1434] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:45.261592 11755 tablet_bootstrap.cc:654] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.274801 11242 raft_consensus.cc:2468] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.275442 11456 leader_election.cc:304] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.275776 11888 raft_consensus.cc:2804] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.276079 11882 tablet_loader.cc:96] loaded metadata for tablet 018525730c4e4134ab3a0506f1a0a6fa (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e])
I20260925 01:49:45.276741 11882 tablet_loader.cc:96] loaded metadata for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 (table default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d])
I20260925 01:49:45.278589 11882 tablet_loader.cc:96] loaded metadata for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_39b1b83f732c44ca93f0e5e37326d739 [id=25512a7f4c4741d4aba6f86f1497dca4])
I20260925 01:49:45.279454 11882 tablet_loader.cc:96] loaded metadata for tablet 1396d679e5824c469490170d257f6a9b (table default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951])
I20260925 01:49:45.279973 11882 tablet_loader.cc:96] loaded metadata for tablet 200caea41ba4466386b091875f017956 (table default.Table_434ed55eea774802bad516c94af8ac39 [id=9389812769844f279c1e0c5fa9707dc0])
I20260925 01:49:45.280684 11882 tablet_loader.cc:96] loaded metadata for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88])
I20260925 01:49:45.281750 11755 tablet_bootstrap.cc:492] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.282127 11755 ts_tablet_manager.cc:1403] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.001s
I20260925 01:49:45.283352 11755 raft_consensus.cc:359] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.283849 11755 raft_consensus.cc:385] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.284017 11755 raft_consensus.cc:740] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.284417 11755 consensus_queue.cc:260] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.285440 11753 tablet_bootstrap.cc:492] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.285473 11755 ts_tablet_manager.cc:1434] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:45.286659 11882 tablet_loader.cc:96] loaded metadata for tablet 31fe174270f24ff780c212eaef90ef0d (table default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d])
I20260925 01:49:45.287263 11882 tablet_loader.cc:96] loaded metadata for tablet 357963616763428fa69c7670e760f84e (table default.Table_41614d44ad5844f9911213d219401534 [id=4ea66d3270f54caaa02e4084c6696342])
I20260925 01:49:45.287868 11882 tablet_loader.cc:96] loaded metadata for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_cb56a1417e89414aaf3f117d28525d3b [id=2b2ff147f85b437fb7bc6a9f3ddd70d6])
I20260925 01:49:45.288410 11882 tablet_loader.cc:96] loaded metadata for tablet 3d3626880758447e9aa85f8f9070d4e3 (table default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd])
I20260925 01:49:45.289037 11882 tablet_loader.cc:96] loaded metadata for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76])
I20260925 01:49:45.289585 11753 tablet_bootstrap.cc:654] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.290107 11882 tablet_loader.cc:96] loaded metadata for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e])
I20260925 01:49:45.290740 11882 tablet_loader.cc:96] loaded metadata for tablet 437bbb14fd264180887c0f5aa2ce80ea (table default.Table_c7551c285d614e408f7784bdb7535702 [id=4fb54256e58245988a5cc88ce6565832])
W20260925 01:49:45.290949 11176 connection.cc:573] server connection from 127.0.0.1:34520 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:49:45.291097 11664 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.159.252:44823 (error 108)
W20260925 01:49:45.291428 11457 connection.cc:573] server connection from 127.0.0.1:41980 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 01:49:45.291781 11882 tablet_loader.cc:96] loaded metadata for tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27])
I20260925 01:49:45.292712 11882 tablet_loader.cc:96] loaded metadata for tablet 55e9d52e3f79408a99216250aefc45c8 (table default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687])
I20260925 01:49:45.293313 11882 tablet_loader.cc:96] loaded metadata for tablet 5acd5d878aac4261a7294e87304c9dfc (table default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded])
I20260925 01:49:45.294433 11755 tablet_bootstrap.cc:492] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.297256 11755 tablet_bootstrap.cc:654] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:45.299854 11576 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.159.252:44823)
W20260925 01:49:45.300302 11576 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.10.159.252:44823)
W20260925 01:49:45.300631 11576 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.10.159.252:44823)
W20260925 01:49:45.301110 11576 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.10.159.252:44823)
I20260925 01:49:45.293932 11882 tablet_loader.cc:96] loaded metadata for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938])
I20260925 01:49:45.308032 11882 tablet_loader.cc:96] loaded metadata for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7])
I20260925 01:49:45.308663 11882 tablet_loader.cc:96] loaded metadata for tablet 60c40e2db5e2434192a359f50c02fe13 (table default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b])
I20260925 01:49:45.309168 11882 tablet_loader.cc:96] loaded metadata for tablet 67921f86c4f6422e97d7f306262569f8 (table default.Table_c42a2d0957624d578f66a1c0268d2ef2 [id=107d0cda55154f5e84ce4dd14d36364a])
I20260925 01:49:45.310295 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d9558462332400d92f7d61858bdeca2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.310585 11379 raft_consensus.cc:3060] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.314954 11379 raft_consensus.cc:2468] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.315156 11882 tablet_loader.cc:96] loaded metadata for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_ab792e1485f44174b025aba98b817a48 [id=861f838981bc470e9d593a7733c4526f])
I20260925 01:49:45.316068 11762 leader_election.cc:290] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.316228 11882 tablet_loader.cc:96] loaded metadata for tablet 770ebdbd355142ba86fd9eb8eaa844f4 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219])
I20260925 01:49:45.317763 11882 tablet_loader.cc:96] loaded metadata for tablet 7900db92b35048aaa200ed3183031d6b (table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38])
I20260925 01:49:45.318289 11762 raft_consensus.cc:493] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:45.319018 11890 log.cc:927] Time spent T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
I20260925 01:49:45.319490 11882 tablet_loader.cc:96] loaded metadata for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_393671d61d694438bfaf25af0b823b4c [id=56d41c65456f4cf691b9f87319014030])
I20260925 01:49:45.321192 11762 raft_consensus.cc:515] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.324251 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae497a92e49746a79cbbfe3c82b2b544" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.324642 11242 raft_consensus.cc:2468] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.325292 11456 leader_election.cc:304] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.322589 11887 leader_election.cc:290] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.326493 11887 raft_consensus.cc:2804] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.326920 11882 tablet_loader.cc:96] loaded metadata for tablet 86079f22abb74d438c61ecc2a7379cbd (table default.Table_fdcdf308781f4f5ab7f4be9110e4434a [id=0d689fa6870547f3a57c6b6149b94754])
I20260925 01:49:45.327392 11887 raft_consensus.cc:493] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.328567 11882 tablet_loader.cc:96] loaded metadata for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_8f5194a1b70d43f185050d1bdb176d8b [id=f3f8339a90b64cd4812637e6f997f107])
I20260925 01:49:45.329908 11882 tablet_loader.cc:96] loaded metadata for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_2fe9e3d572a34772b63e49e00ceec625 [id=37bc53f74b2a4f618298bde3281e0ecf])
W20260925 01:49:45.329217 11457 leader_election.cc:343] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: ae497a92e49746a79cbbfe3c82b2b544
I20260925 01:49:45.330293 11887 raft_consensus.cc:3060] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.330590 11886 raft_consensus.cc:493] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.330780 11886 raft_consensus.cc:515] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.330860 11762 leader_election.cc:290] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.331869 11886 leader_election.cc:290] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.332887 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65faada47c34cd1908970460d3d3f6b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.333179 11522 raft_consensus.cc:2468] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.334016 11314 leader_election.cc:304] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.334278 11882 tablet_loader.cc:96] loaded metadata for tablet 8d208d580a2c4c27bd614ccc88088384 (table default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e])
I20260925 01:49:45.334614 11886 raft_consensus.cc:2804] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.334779 11886 raft_consensus.cc:493] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.334897 11886 raft_consensus.cc:3060] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.335727 11882 tablet_loader.cc:96] loaded metadata for tablet 8dd27c6d835948ba859b4c11d8ebf783 (table default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930])
W20260925 01:49:45.336443 11175 connection.cc:573] client connection to 127.10.159.252:44823 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:49:45.336979 10974 connection.cc:573] client connection to 127.10.159.252:44823 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:49:45.337141 10974 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 4 similar messages]
I20260925 01:49:45.339452 11886 raft_consensus.cc:515] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.341491 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a65faada47c34cd1908970460d3d3f6b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.341756 11522 raft_consensus.cc:3060] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.342703 11882 tablet_loader.cc:96] loaded metadata for tablet 99913eb35197442880a27b3c288237f4 (table default.Table_e25c617f09054071828a13f1a7f5bdc7 [id=5a101d4224e546e686f9bf819b07c07b])
I20260925 01:49:45.343660 11882 tablet_loader.cc:96] loaded metadata for tablet a3358b78a1da48388d1f72536b1ed0a2 (table default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605])
I20260925 01:49:45.345916 11522 raft_consensus.cc:2468] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.346561 11886 leader_election.cc:290] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.348146 11314 leader_election.cc:304] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.348883 11886 raft_consensus.cc:2804] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.349135 11886 raft_consensus.cc:697] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:45.349634 11886 consensus_queue.cc:237] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.351809 11882 tablet_loader.cc:96] loaded metadata for tablet b05053f5646f4748a99647b7dbfae686 (table default.Table_cd22b64ded2d47498fba4bcaf54bc00a [id=351fd2bbafea4565a9cc4537f7f0c1aa])
I20260925 01:49:45.358682 11888 raft_consensus.cc:697] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.359243 11882 tablet_loader.cc:96] loaded metadata for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b (table default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6])
I20260925 01:49:45.359323 11888 consensus_queue.cc:237] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.361476 11882 tablet_loader.cc:96] loaded metadata for tablet ba19192502634f8599407d923114a627 (table default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915])
I20260925 01:49:45.363505 11754 tablet_bootstrap.cc:492] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.363744 11754 ts_tablet_manager.cc:1403] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.170s user 0.045s sys 0.100s
I20260925 01:49:45.364434 11882 tablet_loader.cc:96] loaded metadata for tablet bb98d5a38f43450c80d057d9eb2f92d1 (table default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d])
I20260925 01:49:45.364771 11754 raft_consensus.cc:359] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.365016 11754 raft_consensus.cc:385] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.365106 11754 raft_consensus.cc:740] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:45.365358 11900 negotiation.cc:336] Failed RPC negotiation. Trace:
0925 01:49:45.303722 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.10.159.252:44823 (local address 127.0.0.1:37800)
0925 01:49:45.363173 (+ 59451us) negotiation.cc:107] Waiting for socket to connect
0925 01:49:45.363363 (+ 190us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":59262,"thread_start_us":58830,"threads_started":1}
I20260925 01:49:45.365497 11754 consensus_queue.cc:260] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.365800 11882 tablet_loader.cc:96] loaded metadata for tablet c28c9e51d80a442486b78be32c74a94f (table default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727])
I20260925 01:49:45.365932 11897 raft_consensus.cc:493] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.366204 11897 raft_consensus.cc:515] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.366446 11754 ts_tablet_manager.cc:1434] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260925 01:49:45.366827 11754 tablet_bootstrap.cc:492] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.367283 11882 tablet_loader.cc:96] loaded metadata for tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_7f229e69d1044678b1b85292293ee4e5 [id=cde938f51c1d4ea8a32a3f9b684c510b])
I20260925 01:49:45.367733 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96165d1a85d4ee99748563078ae2a3e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.367952 11242 raft_consensus.cc:2468] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.368556 11456 leader_election.cc:304] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.368935 11895 raft_consensus.cc:2804] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.369071 11895 raft_consensus.cc:493] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.369151 11754 tablet_bootstrap.cc:654] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.369253 11882 tablet_loader.cc:96] loaded metadata for tablet ca76f6f710d841fd8999b40e5a48693f (table default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87])
I20260925 01:49:45.369318 11895 raft_consensus.cc:3060] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.372462 11762 raft_consensus.cc:493] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.372725 11762 raft_consensus.cc:515] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.374033 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65068a447744ec99e56489963b251c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.374292 11242 raft_consensus.cc:2468] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.374861 11456 leader_election.cc:304] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.375480 11882 tablet_loader.cc:96] loaded metadata for tablet cedc909f3c864a7cbbd12dbdfb3315ec (table default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7])
W20260925 01:49:45.375744 11904 negotiation.cc:336] Failed RPC negotiation. Trace:
0925 01:49:45.338298 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.10.159.252:44823 (local address 127.10.159.193:48505)
0925 01:49:45.374375 (+ 36077us) negotiation.cc:107] Waiting for socket to connect
0925 01:49:45.374553 (+ 178us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":35954,"threads_started":1}
I20260925 01:49:45.377938 11754 tablet_bootstrap.cc:492] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.377935 11882 tablet_loader.cc:96] loaded metadata for tablet e4683df170284c228a08df5422e37d16 (table default.Table_f753f432c5264d9399607b334195d845 [id=5bd8ff335261411fba51131e4dde1ea7])
I20260925 01:49:45.378127 11754 ts_tablet_manager.cc:1403] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.003s
W20260925 01:49:45.378513 11901 negotiation.cc:336] Failed RPC negotiation. Trace:
0925 01:49:45.314222 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.10.159.252:44823 (local address 127.10.159.195:50809)
0925 01:49:45.376751 (+ 62529us) negotiation.cc:107] Waiting for socket to connect
0925 01:49:45.376985 (+ 234us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":62351,"threads_started":1}
I20260925 01:49:45.378624 11882 tablet_loader.cc:96] loaded metadata for tablet e686dff5ada64f05a1c7bd914c1377a4 (table default.Table_716df684734d4100ba0e2266d8bdb6e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f])
I20260925 01:49:45.379123 11754 raft_consensus.cc:359] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.379354 11754 raft_consensus.cc:385] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.379454 11754 raft_consensus.cc:740] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.379812 11754 consensus_queue.cc:260] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.380578 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65068a447744ec99e56489963b251c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.380748 11754 ts_tablet_manager.cc:1434] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:45.381078 11754 tablet_bootstrap.cc:492] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.381085 11882 tablet_loader.cc:96] loaded metadata for tablet e7623999b3c04ca69672a1e43fa6921f (table default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327])
W20260925 01:49:45.381388 11457 leader_election.cc:343] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:45.381461 11882 tablet_loader.cc:96] loaded metadata for tablet e7f421bb962e407c8b459eaad6e45b61 (table default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0])
W20260925 01:49:45.381740 11902 negotiation.cc:336] Failed RPC negotiation. Trace:
0925 01:49:45.314800 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.10.159.252:44823 (local address 127.10.159.194:56131)
0925 01:49:45.379285 (+ 64485us) negotiation.cc:107] Waiting for socket to connect
0925 01:49:45.379717 (+ 432us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":64325,"threads_started":1}
I20260925 01:49:45.381893 11882 tablet_loader.cc:96] loaded metadata for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 (table default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a])
I20260925 01:49:45.383136 11754 tablet_bootstrap.cc:654] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.384552 11882 tablet_loader.cc:96] loaded metadata for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6])
I20260925 01:49:45.385218 11754 tablet_bootstrap.cc:492] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.385437 11754 ts_tablet_manager.cc:1403] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
W20260925 01:49:45.386924 11314 leader_election.cc:343] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:45.386950 11754 raft_consensus.cc:359] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.387128 11754 raft_consensus.cc:385] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.387188 11754 raft_consensus.cc:740] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.387465 11754 consensus_queue.cc:260] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.387851 11762 leader_election.cc:290] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.388201 11754 ts_tablet_manager.cc:1434] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:45.388546 11882 tablet_loader.cc:96] loaded metadata for tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9])
I20260925 01:49:45.388629 11754 tablet_bootstrap.cc:492] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:49:45.390005 10974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 52840.9us
I20260925 01:49:45.390537 11882 tablet_loader.cc:96] loaded metadata for tablet ff92ca86767f4ba6905da62b6a4b892c (table default.Table_ea9cb22dacf64efe966cbcfb02725dfe [id=e4e40511b79d43919b00485a71bf0509])
I20260925 01:49:45.390614 11754 tablet_bootstrap.cc:654] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:45.391083 11314 leader_election.cc:343] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:45.391462 11882 catalog_manager.cc:1533] Initializing Kudu cluster ID...
W20260925 01:49:45.391553 11457 leader_election.cc:343] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: c96165d1a85d4ee99748563078ae2a3e
W20260925 01:49:45.392649 10974 leader_election.cc:336] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823): Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:45.393025 10974 leader_election.cc:304] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:49:45.393468 11866 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 01:49:45.393784 11897 leader_election.cc:290] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.394337 11762 raft_consensus.cc:2804] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.395059 11762 raft_consensus.cc:493] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.395661 11762 raft_consensus.cc:3060] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:45.398033 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 106914us
I20260925 01:49:45.399008 11754 tablet_bootstrap.cc:492] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.399165 11754 ts_tablet_manager.cc:1403] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260925 01:49:45.399999 11754 raft_consensus.cc:359] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.400187 11754 raft_consensus.cc:385] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.400264 11754 raft_consensus.cc:740] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.401108 11754 consensus_queue.cc:260] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.401892 11754 ts_tablet_manager.cc:1434] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:45.402235 11754 tablet_bootstrap.cc:492] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.403033 11882 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:45.403975 11882 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
I20260925 01:49:45.404294 11754 tablet_bootstrap.cc:654] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.404861 11755 tablet_bootstrap.cc:492] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.405109 11755 ts_tablet_manager.cc:1403] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.111s user 0.013s sys 0.022s
I20260925 01:49:45.406221 11755 raft_consensus.cc:359] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.406395 11754 tablet_bootstrap.cc:492] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.406510 11755 raft_consensus.cc:385] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.406562 11754 ts_tablet_manager.cc:1403] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260925 01:49:45.406610 11755 raft_consensus.cc:740] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.407011 11755 consensus_queue.cc:260] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.407656 11755 ts_tablet_manager.cc:1434] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:45.407325 11754 raft_consensus.cc:359] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.407784 11754 raft_consensus.cc:385] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.407902 11754 raft_consensus.cc:740] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.408205 11754 consensus_queue.cc:260] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.408784 11754 ts_tablet_manager.cc:1434] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:45.409128 11754 tablet_bootstrap.cc:492] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.409960 11755 tablet_bootstrap.cc:492] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.410657 11882 catalog_manager.cc:1553] Loading token signing keys...
I20260925 01:49:45.410830 11754 tablet_bootstrap.cc:654] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.411902 11755 tablet_bootstrap.cc:654] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.416574 11754 tablet_bootstrap.cc:492] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.416769 11754 ts_tablet_manager.cc:1403] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260925 01:49:45.417634 11754 raft_consensus.cc:359] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.417846 11754 raft_consensus.cc:385] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.417735 11882 catalog_manager.cc:6230] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Loaded TSK: 0
I20260925 01:49:45.418092 11754 raft_consensus.cc:740] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.418040 11886 raft_consensus.cc:493] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.418259 11886 raft_consensus.cc:515] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:45.418339 11754 consensus_queue.cc:260] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.419011 11754 ts_tablet_manager.cc:1434] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:45.419011 11886 leader_election.cc:290] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:45.419309 11754 tablet_bootstrap.cc:492] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.420636 11882 catalog_manager.cc:1563] Initializing in-progress tserver states...
I20260925 01:49:45.421209 11754 tablet_bootstrap.cc:654] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:45.424654 11314 leader_election.cc:343] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: bfd9645cd6644a55997eb7745c7b29f2
W20260925 01:49:45.426086 11314 leader_election.cc:343] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: bfd9645cd6644a55997eb7745c7b29f2
I20260925 01:49:45.426270 11314 leader_election.cc:304] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.426637 11886 raft_consensus.cc:2749] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.429548 11887 raft_consensus.cc:515] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.430995 11887 leader_election.cc:290] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.431341 11895 raft_consensus.cc:515] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:45.431559 11457 leader_election.cc:343] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: ae497a92e49746a79cbbfe3c82b2b544
I20260925 01:49:45.432086 11754 tablet_bootstrap.cc:492] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.432217 11895 leader_election.cc:290] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.432282 11754 ts_tablet_manager.cc:1403] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.001s
W20260925 01:49:45.433408 11457 leader_election.cc:343] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: c96165d1a85d4ee99748563078ae2a3e
I20260925 01:49:45.433451 11754 raft_consensus.cc:359] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.433677 11754 raft_consensus.cc:385] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.433761 11754 raft_consensus.cc:740] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:45.434041 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 59166.2us
I20260925 01:49:45.434033 11754 consensus_queue.cc:260] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.434801 11754 ts_tablet_manager.cc:1434] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:45.434906 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae497a92e49746a79cbbfe3c82b2b544" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.435125 11242 raft_consensus.cc:3060] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.435128 11754 tablet_bootstrap.cc:492] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.437326 11754 tablet_bootstrap.cc:654] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.437924 11762 raft_consensus.cc:515] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.438838 11762 leader_election.cc:290] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.439883 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65068a447744ec99e56489963b251c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:49:45.440670 11457 leader_election.cc:343] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:45.441555 11664 leader_election.cc:336] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823): Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
W20260925 01:49:45.441916 11664 leader_election.cc:336] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823): Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111)
I20260925 01:49:45.443219 11242 raft_consensus.cc:2468] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.444793 11754 tablet_bootstrap.cc:492] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.445039 11754 ts_tablet_manager.cc:1403] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260925 01:49:45.444985 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c96165d1a85d4ee99748563078ae2a3e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.445324 11755 tablet_bootstrap.cc:492] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.445365 11242 raft_consensus.cc:3060] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.445488 11755 ts_tablet_manager.cc:1403] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260925 01:49:45.445971 11754 raft_consensus.cc:359] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.446254 11754 raft_consensus.cc:385] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.446388 11754 raft_consensus.cc:740] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.446400 11755 raft_consensus.cc:359] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.446688 11755 raft_consensus.cc:385] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.446655 11754 consensus_queue.cc:260] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.446784 11755 raft_consensus.cc:740] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.447089 11753 tablet_bootstrap.cc:492] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.447192 11755 consensus_queue.cc:260] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.448022 11755 ts_tablet_manager.cc:1434] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:45.448391 11755 tablet_bootstrap.cc:492] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.448453 11754 ts_tablet_manager.cc:1434] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:49:45.448747 11754 tablet_bootstrap.cc:492] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.450362 11755 tablet_bootstrap.cc:654] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.450618 11754 tablet_bootstrap.cc:654] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.452952 11886 raft_consensus.cc:493] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.453166 11886 raft_consensus.cc:515] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.453930 11886 leader_election.cc:290] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.454331 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5853dcaed91a4f87b5d7b36db7a61965"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:45.454214 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7feb65e332c34c1db0f6aa4f98ffa8b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:45.461966 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5853dcaed91a4f87b5d7b36db7a61965 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:45.464354 11242 raft_consensus.cc:2468] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.465298 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9884d7af60324a24ad06d6fa5db358b2" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.465555 11242 raft_consensus.cc:2468] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.466144 11314 leader_election.cc:304] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.466554 11886 raft_consensus.cc:2804] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.466674 11886 raft_consensus.cc:493] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.466804 11886 raft_consensus.cc:3060] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:45.467229 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7feb65e332c34c1db0f6aa4f98ffa8b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:45.469079 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4cf67d6ebac74fe195aff1bffe6cde96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:45.469661 11780 raft_consensus.cc:493] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:45.469825 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cf67d6ebac74fe195aff1bffe6cde96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:45.469826 11780 raft_consensus.cc:515] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.470706 11780 leader_election.cc:290] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:49:45.472107 11314 leader_election.cc:343] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 6837562b484242e5bf2b4eb085de7ac4
I20260925 01:49:45.472000 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cb56a1417e89414aaf3f117d28525d3b" } new_table_name: "default.Table_98e49819b069428c81b83d226192a743" modify_external_catalogs: true
I20260925 01:49:45.472885 11886 raft_consensus.cc:515] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.474694 11886 leader_election.cc:290] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.474973 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_59d4c86ec501405bac429442b634b429" } modify_external_catalogs: true
I20260925 01:49:45.475195 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_59d4c86ec501405bac429442b634b429" } modify_external_catalogs: true
I20260925 01:49:45.476089 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65068a447744ec99e56489963b251c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.476295 11239 raft_consensus.cc:3060] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.477308 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9884d7af60324a24ad06d6fa5db358b2" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.477528 11240 raft_consensus.cc:3060] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.479687 11239 raft_consensus.cc:2468] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.480620 11240 raft_consensus.cc:2468] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
W20260925 01:49:45.480803 11314 leader_election.cc:343] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 6837562b484242e5bf2b4eb085de7ac4
I20260925 01:49:45.480976 11314 leader_election.cc:304] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.481438 11886 raft_consensus.cc:2749] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.481595 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f43d73b46d5e439aa7bc235e82b6d1a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:45.481946 11314 leader_election.cc:304] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.482247 11886 raft_consensus.cc:2804] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:49:45.482402 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f43d73b46d5e439aa7bc235e82b6d1a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:45.482769 11886 raft_consensus.cc:697] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:45.483098 11886 consensus_queue.cc:237] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.484309 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be" } modify_external_catalogs: true
I20260925 01:49:45.484577 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be" } modify_external_catalogs: true
I20260925 01:49:45.486773 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:45.489073 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7f0be4abc90a407dbc377d4fbe092f08" } modify_external_catalogs: true
I20260925 01:49:45.489296 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7f0be4abc90a407dbc377d4fbe092f08" } modify_external_catalogs: true
I20260925 01:49:45.491994 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 018525730c4e4134ab3a0506f1a0a6fa (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]). Expected version 1 got 0
I20260925 01:49:45.455189 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9884d7af60324a24ad06d6fa5db358b2" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.492357 11522 raft_consensus.cc:2468] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.474452 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9884d7af60324a24ad06d6fa5db358b2" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.492720 11521 raft_consensus.cc:3060] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.480450 11456 leader_election.cc:304] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:45.493137 11908 raft_consensus.cc:493] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.493302 11908 raft_consensus.cc:515] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.494242 11908 leader_election.cc:290] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.494453 11908 raft_consensus.cc:2804] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.494592 11908 raft_consensus.cc:697] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.494879 11908 consensus_queue.cc:237] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.496158 11521 raft_consensus.cc:2468] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.496691 11456 leader_election.cc:304] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:45.497078 11895 raft_consensus.cc:2804] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.497283 11895 raft_consensus.cc:697] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.497594 11895 consensus_queue.cc:237] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.497869 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4683df170284c228a08df5422e37d16" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.498119 11379 raft_consensus.cc:2468] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.498667 11457 leader_election.cc:304] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.498960 11887 raft_consensus.cc:2804] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.499056 11887 raft_consensus.cc:493] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.499092 11753 ts_tablet_manager.cc:1403] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.214s user 0.004s sys 0.004s
I20260925 01:49:45.499176 11887 raft_consensus.cc:3060] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.499987 11753 raft_consensus.cc:359] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.500164 11753 raft_consensus.cc:385] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.500257 11753 raft_consensus.cc:740] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.500487 11753 consensus_queue.cc:260] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.501017 11753 ts_tablet_manager.cc:1434] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:45.502731 11887 raft_consensus.cc:515] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.513233 11753 tablet_bootstrap.cc:492] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.514477 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4683df170284c228a08df5422e37d16" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.514766 11379 raft_consensus.cc:3060] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.517418 11753 tablet_bootstrap.cc:654] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.517923 11379 raft_consensus.cc:2468] T e4683df170284c228a08df5422e37d16 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.527122 10999 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Refusing update from remote peer 17a1694989f748dfa9cdb2c10f3f1de5: Log matching property violated. Preceding OpId in replica: term: 3 index: 166. Preceding OpId from leader: term: 4 index: 169. (index mismatch)
I20260925 01:49:45.528112 11874 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 168, Last known committed idx: 166, Time since last communication: 0.000s
I20260925 01:49:45.529052 11755 tablet_bootstrap.cc:492] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.529277 11755 ts_tablet_manager.cc:1403] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.081s user 0.033s sys 0.038s
I20260925 01:49:45.518954 11457 leader_election.cc:304] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.519115 11887 leader_election.cc:290] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.533061 11755 raft_consensus.cc:359] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.533311 11887 raft_consensus.cc:2804] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.533382 11755 raft_consensus.cc:385] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.533481 11755 raft_consensus.cc:740] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.533494 11887 raft_consensus.cc:697] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.533869 11887 consensus_queue.cc:237] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.534482 11755 consensus_queue.cc:260] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.506500 11456 leader_election.cc:304] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:45.536186 11755 ts_tablet_manager.cc:1434] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260925 01:49:45.537530 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4683df170284c228a08df5422e37d16" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.537631 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4683df170284c228a08df5422e37d16" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.537779 11240 raft_consensus.cc:2468] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.538120 11888 raft_consensus.cc:2804] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.538483 11897 raft_consensus.cc:493] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.538585 11755 tablet_bootstrap.cc:492] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.538652 11888 raft_consensus.cc:697] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.538937 11888 consensus_queue.cc:237] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.539953 11897 raft_consensus.cc:515] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.540583 11897 leader_election.cc:290] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.542518 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200caea41ba4466386b091875f017956" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.542763 11242 raft_consensus.cc:2468] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.543324 11456 leader_election.cc:304] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.543614 11897 raft_consensus.cc:2804] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.543711 11897 raft_consensus.cc:493] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.543807 11897 raft_consensus.cc:3060] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.546412 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200caea41ba4466386b091875f017956" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.546764 11379 raft_consensus.cc:2468] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.547191 11755 tablet_bootstrap.cc:654] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.549386 11897 raft_consensus.cc:515] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.550907 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200caea41ba4466386b091875f017956" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.551128 11379 raft_consensus.cc:3060] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.554757 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "200caea41ba4466386b091875f017956" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.555034 11242 raft_consensus.cc:3060] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.555990 11755 tablet_bootstrap.cc:492] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.556175 11755 ts_tablet_manager.cc:1403] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.009s
I20260925 01:49:45.557250 11755 raft_consensus.cc:359] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.557489 11755 raft_consensus.cc:385] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.557614 11755 raft_consensus.cc:740] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.557914 11755 consensus_queue.cc:260] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.558702 11379 raft_consensus.cc:2468] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.559171 11755 ts_tablet_manager.cc:1434] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:45.559291 11457 leader_election.cc:304] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.559778 11908 raft_consensus.cc:2804] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.559876 11755 tablet_bootstrap.cc:492] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.559952 11908 raft_consensus.cc:697] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.560248 11908 consensus_queue.cc:237] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.560575 11886 raft_consensus.cc:493] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.560801 11886 raft_consensus.cc:515] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.561631 11886 leader_election.cc:290] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.562143 11772 raft_consensus.cc:493] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.562220 11242 raft_consensus.cc:2468] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.562350 11772 raft_consensus.cc:515] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.562837 11897 leader_election.cc:290] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.563243 11772 leader_election.cc:290] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:49:45.564675 11176 leader_election.cc:343] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a26b7ec7373d42668f40c7c89084be47
I20260925 01:49:45.564693 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26b7ec7373d42668f40c7c89084be47" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.564980 11379 raft_consensus.cc:2468] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:49:45.565099 11314 leader_election.cc:343] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: da74fa4b6fa841b7aebb81302cab2885
I20260925 01:49:45.565649 11177 leader_election.cc:304] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
W20260925 01:49:45.565788 11314 leader_election.cc:343] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: da74fa4b6fa841b7aebb81302cab2885
I20260925 01:49:45.565977 11314 leader_election.cc:304] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.566409 11772 raft_consensus.cc:2804] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.566494 11886 raft_consensus.cc:2749] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.566555 11772 raft_consensus.cc:493] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.566704 11772 raft_consensus.cc:3060] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:45.563216 11680 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 018525730c4e4134ab3a0506f1a0a6fa (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 018525730c4e4134ab3a0506f1a0a6fa consensus state has no leader
I20260925 01:49:45.567063 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.567484 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.567754 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.568869 11886 raft_consensus.cc:493] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.569092 11886 raft_consensus.cc:515] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.569968 11886 leader_election.cc:290] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.573360 11866 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1694989f748dfa9cdb2c10f3f1de5. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:45.573690 11866 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:45.577101 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1cbf07e15440c7919a4bbcd937fb53" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.577466 11521 raft_consensus.cc:2468] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.578027 11314 leader_election.cc:304] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.578615 11886 raft_consensus.cc:2804] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.578747 11886 raft_consensus.cc:493] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.578872 11886 raft_consensus.cc:3060] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.579128 11908 raft_consensus.cc:493] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.579336 11908 raft_consensus.cc:515] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.581001 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc1cd6e88764445b0a1fdc92e0c53e5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.581311 11240 raft_consensus.cc:2468] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.581887 11456 leader_election.cc:304] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.581900 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc1cd6e88764445b0a1fdc92e0c53e5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.582331 11379 raft_consensus.cc:2468] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.582480 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1cbf07e15440c7919a4bbcd937fb53" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.582688 11242 raft_consensus.cc:2468] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
W20260925 01:49:45.582882 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 018525730c4e4134ab3a0506f1a0a6fa (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 018525730c4e4134ab3a0506f1a0a6fa consensus state has no leader
I20260925 01:49:45.583362 11908 leader_election.cc:290] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.583642 11897 raft_consensus.cc:2804] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.584399 11897 raft_consensus.cc:493] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.584908 11897 raft_consensus.cc:3060] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.587208 11886 raft_consensus.cc:515] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.585655 11772 raft_consensus.cc:515] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.589161 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a26b7ec7373d42668f40c7c89084be47" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.589551 11379 raft_consensus.cc:3060] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.593993 11379 raft_consensus.cc:2468] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:45.594838 11897 raft_consensus.cc:515] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:45.596223 11176 leader_election.cc:343] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a26b7ec7373d42668f40c7c89084be47
I20260925 01:49:45.597831 11772 leader_election.cc:290] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.598003 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1cbf07e15440c7919a4bbcd937fb53" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.598410 11242 raft_consensus.cc:3060] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.602485 11177 leader_election.cc:304] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:45.602834 11242 raft_consensus.cc:2468] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.603281 11772 raft_consensus.cc:2804] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.603608 11314 leader_election.cc:304] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.603713 11772 raft_consensus.cc:697] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:45.604001 11780 raft_consensus.cc:2804] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.603993 11772 consensus_queue.cc:237] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.599265 11886 leader_election.cc:290] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.601755 11755 tablet_bootstrap.cc:654] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.615484 11755 tablet_bootstrap.cc:492] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.615754 11755 ts_tablet_manager.cc:1403] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.005s
I20260925 01:49:45.616899 11755 raft_consensus.cc:359] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.617192 11755 raft_consensus.cc:385] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.617287 11755 raft_consensus.cc:740] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.617974 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.618556 11755 consensus_queue.cc:260] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.618955 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb with delete_type TABLET_DATA_DELETED (replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.619657 11755 ts_tablet_manager.cc:1434] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20260925 01:49:45.620283 11755 tablet_bootstrap.cc:492] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.623381 11755 tablet_bootstrap.cc:654] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.625223 11886 raft_consensus.cc:493] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.625473 11886 raft_consensus.cc:515] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.626366 11886 leader_election.cc:290] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.628173 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.599040 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1cbf07e15440c7919a4bbcd937fb53" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.629554 11521 raft_consensus.cc:3060] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.629623 11753 tablet_bootstrap.cc:492] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.629782 11753 ts_tablet_manager.cc:1403] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.117s user 0.001s sys 0.002s
I20260925 01:49:45.630832 11753 raft_consensus.cc:359] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.631078 11753 raft_consensus.cc:385] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.631155 11753 raft_consensus.cc:740] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.631479 11753 consensus_queue.cc:260] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.632176 11753 ts_tablet_manager.cc:1434] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:45.632506 11753 tablet_bootstrap.cc:492] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.632753 11521 raft_consensus.cc:2468] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.627424 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef1b5f18d074016a6dea82da8e2d2b2" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.633301 11522 raft_consensus.cc:2393] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:45.634490 11314 leader_election.cc:304] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.634878 11886 raft_consensus.cc:3060] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.636394 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc1cd6e88764445b0a1fdc92e0c53e5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.636674 11240 raft_consensus.cc:3060] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.637048 11897 leader_election.cc:290] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.639286 11886 raft_consensus.cc:2749] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.639673 11931 tablet_replica.cc:333] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:45.639808 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc1cd6e88764445b0a1fdc92e0c53e5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.640048 11379 raft_consensus.cc:3060] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.640357 11780 raft_consensus.cc:697] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:45.640599 11240 raft_consensus.cc:2468] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.641235 11456 leader_election.cc:304] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.640707 11780 consensus_queue.cc:237] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.642423 11753 tablet_bootstrap.cc:654] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.644368 11908 raft_consensus.cc:2804] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.644517 11908 raft_consensus.cc:697] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.644558 11379 raft_consensus.cc:2468] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.644799 11908 consensus_queue.cc:237] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.645779 11895 raft_consensus.cc:493] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.645924 11895 raft_consensus.cc:515] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.646612 11895 leader_election.cc:290] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.647800 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfbc1ce9db4f01bf6ec8965b62c994" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.648084 11240 raft_consensus.cc:2468] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.648116 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfbc1ce9db4f01bf6ec8965b62c994" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.648380 11379 raft_consensus.cc:2468] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.648731 11456 leader_election.cc:304] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.648734 11886 raft_consensus.cc:493] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.648926 11886 raft_consensus.cc:515] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.649479 11895 raft_consensus.cc:2804] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.649726 11895 raft_consensus.cc:493] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.649852 11895 raft_consensus.cc:3060] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:45.650807 11314 leader_election.cc:343] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: f07f754fa5b748a1a25d43e6011c5460
I20260925 01:49:45.651012 11867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:45.651239 11867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
W20260925 01:49:45.651401 11314 leader_election.cc:343] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: f07f754fa5b748a1a25d43e6011c5460
I20260925 01:49:45.651566 11314 leader_election.cc:304] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.651834 11886 leader_election.cc:290] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.652118 11886 raft_consensus.cc:2749] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:45.653615 11895 raft_consensus.cc:515] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.655155 11895 leader_election.cc:290] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.655383 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfbc1ce9db4f01bf6ec8965b62c994" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.655742 11240 raft_consensus.cc:3060] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.658919 11240 raft_consensus.cc:2468] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.659499 11456 leader_election.cc:304] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.660023 11895 raft_consensus.cc:2804] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.660171 11895 raft_consensus.cc:697] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.660432 11895 consensus_queue.cc:237] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.660518 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8f5194a1b70d43f185050d1bdb176d8b" } new_table_name: "default.Table_09e74499a02540e4b52702ff9edba4bf" modify_external_catalogs: true
I20260925 01:49:45.662760 11570 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
I20260925 01:49:45.670310 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95dfbc1ce9db4f01bf6ec8965b62c994" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.672405 11931 raft_consensus.cc:2243] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:45.673295 11289 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
I20260925 01:49:45.674192 11897 raft_consensus.cc:493] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.674431 11897 raft_consensus.cc:515] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.674849 11379 raft_consensus.cc:3060] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.675611 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e94cdafd343ee8a84c64668fe48fe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.675837 11240 raft_consensus.cc:2468] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.676281 11456 leader_election.cc:304] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.676568 11895 raft_consensus.cc:2804] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.676672 11895 raft_consensus.cc:493] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.676752 11895 raft_consensus.cc:3060] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.677784 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e94cdafd343ee8a84c64668fe48fe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.678006 11380 raft_consensus.cc:2468] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.678299 11931 raft_consensus.cc:2272] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:45.678580 11897 leader_election.cc:290] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.678929 11426 heartbeater.cc:499] Master 127.10.159.254:40913 was elected leader, sending a full tablet report...
I20260925 01:49:45.683097 11379 raft_consensus.cc:2468] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.683698 11754 tablet_bootstrap.cc:492] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.684001 11754 ts_tablet_manager.cc:1403] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.235s user 0.052s sys 0.160s
I20260925 01:49:45.684512 11755 tablet_bootstrap.cc:492] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.684666 11755 ts_tablet_manager.cc:1403] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.065s user 0.021s sys 0.001s
I20260925 01:49:45.684986 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:45.684958 11754 raft_consensus.cc:359] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.685168 11754 raft_consensus.cc:385] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.685252 11754 raft_consensus.cc:740] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.685566 11754 consensus_queue.cc:260] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.685597 11755 raft_consensus.cc:359] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.685815 11755 raft_consensus.cc:385] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.686419 11754 ts_tablet_manager.cc:1434] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:45.686667 11931 ts_tablet_manager.cc:1916] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:45.686823 11754 tablet_bootstrap.cc:492] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.685905 11755 raft_consensus.cc:740] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.688127 11897 raft_consensus.cc:493] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.688285 11897 raft_consensus.cc:515] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.688299 11755 consensus_queue.cc:260] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.688396 11866 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:45.688604 11866 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:45.688856 11755 ts_tablet_manager.cc:1434] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:49:45.689183 11755 tablet_bootstrap.cc:492] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.690970 11755 tablet_bootstrap.cc:654] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.691963 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491d790067644090aa4d25f4060cc2ec" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.692260 11379 raft_consensus.cc:2468] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.692808 11457 leader_election.cc:304] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.693111 11908 raft_consensus.cc:2804] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.693213 11908 raft_consensus.cc:493] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.693286 11908 raft_consensus.cc:3060] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.694662 11887 raft_consensus.cc:493] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.694831 11887 raft_consensus.cc:515] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.695650 11887 leader_election.cc:290] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.699594 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491d790067644090aa4d25f4060cc2ec" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.700026 11240 raft_consensus.cc:2468] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:49:45.701272 11456 leader_election.cc:343] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 4e008337914841b8a1ab4a64ecc6e181
I20260925 01:49:45.702282 11754 tablet_bootstrap.cc:654] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.701995 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e008337914841b8a1ab4a64ecc6e181" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.702654 11379 raft_consensus.cc:2468] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:45.703150 11457 leader_election.cc:304] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.703667 11931 ts_tablet_manager.cc:1929] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:45.703684 11887 raft_consensus.cc:2804] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.703809 11931 log.cc:1199] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/afc1cd6e88764445b0a1fdc92e0c53e5
I20260925 01:49:45.703800 11887 raft_consensus.cc:493] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.703887 11887 raft_consensus.cc:3060] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.704222 11931 ts_tablet_manager.cc:1950] T afc1cd6e88764445b0a1fdc92e0c53e5 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:45.704815 11897 leader_election.cc:290] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.705216 11931 tablet_replica.cc:333] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:45.705441 11931 raft_consensus.cc:2243] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:45.705612 11931 raft_consensus.cc:2272] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:45.705797 11753 tablet_bootstrap.cc:492] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.706277 11753 ts_tablet_manager.cc:1403] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.001s
I20260925 01:49:45.707187 11753 raft_consensus.cc:359] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.707368 11753 raft_consensus.cc:385] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.707465 11753 raft_consensus.cc:740] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.707685 11753 consensus_queue.cc:260] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.708225 11753 ts_tablet_manager.cc:1434] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:45.708382 11908 raft_consensus.cc:515] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.708601 11753 tablet_bootstrap.cc:492] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.709054 11908 leader_election.cc:290] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.712736 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491d790067644090aa4d25f4060cc2ec" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.713554 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "491d790067644090aa4d25f4060cc2ec" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.713832 11379 raft_consensus.cc:3060] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:45.714627 11456 leader_election.cc:343] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:45.683686 11934 raft_consensus.cc:493] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.717115 11934 raft_consensus.cc:515] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.718152 11780 raft_consensus.cc:493] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.718295 11780 raft_consensus.cc:515] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.718941 11780 leader_election.cc:290] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.719024 11934 leader_election.cc:290] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.719859 11931 ts_tablet_manager.cc:1916] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:45.722671 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6058cd7c17b4544a565a5aacfb9df92" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.722973 11240 raft_consensus.cc:2468] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.723469 11314 leader_election.cc:304] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.723886 11934 raft_consensus.cc:2804] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.723937 11755 tablet_bootstrap.cc:492] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.724009 11934 raft_consensus.cc:493] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.724117 11934 raft_consensus.cc:3060] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.724713 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018525730c4e4134ab3a0506f1a0a6fa" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:45.724934 11754 tablet_bootstrap.cc:492] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.725123 11754 ts_tablet_manager.cc:1403] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.007s
I20260925 01:49:45.724123 11755 ts_tablet_manager.cc:1403] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.010s
I20260925 01:49:45.726037 11754 raft_consensus.cc:359] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.726279 11754 raft_consensus.cc:385] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.725121 11242 raft_consensus.cc:2468] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.727022 11314 leader_election.cc:304] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.727349 11780 raft_consensus.cc:2804] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.727473 11780 raft_consensus.cc:493] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.727572 11780 raft_consensus.cc:3060] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.727617 11887 raft_consensus.cc:515] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.728065 11755 raft_consensus.cc:359] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.728250 11755 raft_consensus.cc:385] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.728317 11755 raft_consensus.cc:740] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.728609 11755 consensus_queue.cc:260] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.726382 11754 raft_consensus.cc:740] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.729243 11755 ts_tablet_manager.cc:1434] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260925 01:49:45.729432 11754 consensus_queue.cc:260] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.729707 11755 tablet_bootstrap.cc:492] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.730887 11754 ts_tablet_manager.cc:1434] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260925 01:49:45.731223 11754 tablet_bootstrap.cc:492] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.731632 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e008337914841b8a1ab4a64ecc6e181" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.731809 11380 raft_consensus.cc:3060] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:45.732213 11314 leader_election.cc:343] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:45.732607 11887 leader_election.cc:290] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.732944 11754 tablet_bootstrap.cc:654] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.732982 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018525730c4e4134ab3a0506f1a0a6fa" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.733187 11521 raft_consensus.cc:2468] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:45.736312 11753 tablet_bootstrap.cc:654] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:45.736749 11456 leader_election.cc:343] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 4e008337914841b8a1ab4a64ecc6e181
I20260925 01:49:45.736901 11934 raft_consensus.cc:515] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.737522 11934 leader_election.cc:290] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.738371 11379 raft_consensus.cc:2468] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.738687 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6058cd7c17b4544a565a5aacfb9df92" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.738900 11242 raft_consensus.cc:3060] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.739061 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet afc1cd6e88764445b0a1fdc92e0c53e5 (table default.Table_078cedcd7539492394b2472609504297 [id=df29f1da8f2e40a49c55d44c0a0e11f2]) successfully deleted
I20260925 01:49:45.739153 11946 tablet_replica.cc:333] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:45.739456 11457 leader_election.cc:304] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:45.740031 11314 leader_election.cc:343] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:45.740546 11946 raft_consensus.cc:2243] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:45.743975 11242 raft_consensus.cc:2468] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.744443 11314 leader_election.cc:304] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:45.744935 11934 raft_consensus.cc:2804] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.745465 11934 raft_consensus.cc:697] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:45.745857 11934 consensus_queue.cc:237] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.747309 11946 pending_rounds.cc:70] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:45.747385 11946 pending_rounds.cc:77] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072836589068288 op_type: NO_OP noop_request { }
I20260925 01:49:45.747535 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:45.747661 11946 raft_consensus.cc:2889] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:45.747776 11946 raft_consensus.cc:2272] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:45.748379 11887 raft_consensus.cc:2804] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.748555 11887 raft_consensus.cc:697] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.748828 11887 consensus_queue.cc:237] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.751660 11895 raft_consensus.cc:515] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.753654 11895 leader_election.cc:290] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:45.754128 11772 consensus_queue.cc:1048] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:45.754343 11946 ts_tablet_manager.cc:1916] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:45.754474 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c5021ab79dc4eaf9ed612f7125a6dca consensus state has no leader
I20260925 01:49:45.754889 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet ae497a92e49746a79cbbfe3c82b2b544 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:45.760068 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e94cdafd343ee8a84c64668fe48fe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.761475 11242 raft_consensus.cc:3060] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.763762 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d4e94cdafd343ee8a84c64668fe48fe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.765762 11379 raft_consensus.cc:3060] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.769337 11780 raft_consensus.cc:515] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.770237 11755 tablet_bootstrap.cc:654] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.770880 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 1396d679e5824c469490170d257f6a9b from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:45.771406 11931 ts_tablet_manager.cc:1929] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:45.771566 11931 log.cc:1199] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/491d790067644090aa4d25f4060cc2ec
I20260925 01:49:45.771957 11931 ts_tablet_manager.cc:1950] T 491d790067644090aa4d25f4060cc2ec P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:45.773000 11931 tablet_replica.cc:333] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:45.773116 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 491d790067644090aa4d25f4060cc2ec (table default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]) successfully deleted
I20260925 01:49:45.773204 11931 raft_consensus.cc:2243] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:45.773366 11931 raft_consensus.cc:2272] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:45.773801 11664 consensus_peers.cc:597] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 -> Peer ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823): Couldn't send request to peer ca2cee7752c249f68a372ef5c6a18bff. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:45.776427 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018525730c4e4134ab3a0506f1a0a6fa" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.776656 11522 raft_consensus.cc:3060] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.774036 11380 raft_consensus.cc:2468] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.777256 11780 leader_election.cc:290] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.777386 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b
I20260925 01:49:45.778029 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018525730c4e4134ab3a0506f1a0a6fa" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:45.778401 11240 raft_consensus.cc:3060] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.778029 11672 catalog_manager.cc:6934] ReplaceTablet: tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b deleted and replaced by tablet f892954cd22c48aaad2f0e20b1277844
I20260925 01:49:45.778614 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:45.778172 11851 raft_consensus.cc:493] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.778829 11851 raft_consensus.cc:515] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.779469 11851 leader_election.cc:290] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.780692 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.781603 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42d96d45e8c4e8e8bee374477cfb0bb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.781893 11755 tablet_bootstrap.cc:492] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.781908 11520 raft_consensus.cc:2468] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:45.782050 11755 ts_tablet_manager.cc:1403] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260925 01:49:45.782545 11176 leader_election.cc:304] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.782945 11755 raft_consensus.cc:359] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.783094 11851 raft_consensus.cc:2804] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.783145 11755 raft_consensus.cc:385] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.783179 11851 raft_consensus.cc:493] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.783241 11755 raft_consensus.cc:740] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.783283 11851 raft_consensus.cc:3060] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.783504 11755 consensus_queue.cc:260] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.783704 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42d96d45e8c4e8e8bee374477cfb0bb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.783886 11380 raft_consensus.cc:2468] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:45.784047 11755 ts_tablet_manager.cc:1434] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:45.784353 11755 tablet_bootstrap.cc:492] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.786862 11755 tablet_bootstrap.cc:654] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.787089 11457 leader_election.cc:304] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:45.788339 11522 raft_consensus.cc:2468] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.788789 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:45.789300 11895 raft_consensus.cc:2804] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.789306 11314 leader_election.cc:304] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.789435 11895 raft_consensus.cc:697] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.789703 11895 consensus_queue.cc:237] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.789813 11780 raft_consensus.cc:2804] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.789942 11780 raft_consensus.cc:697] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:45.790208 11780 consensus_queue.cc:237] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.797120 11379 raft_consensus.cc:2468] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.797683 11457 leader_election.cc:304] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:45.797972 11897 raft_consensus.cc:2804] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.798138 11897 raft_consensus.cc:697] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:45.798473 11897 consensus_queue.cc:237] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.799330 11946 ts_tablet_manager.cc:1929] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:45.799471 11946 log.cc:1199] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ae497a92e49746a79cbbfe3c82b2b544
I20260925 01:49:45.800005 11946 ts_tablet_manager.cc:1950] T ae497a92e49746a79cbbfe3c82b2b544 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:45.801296 11931 ts_tablet_manager.cc:1916] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:45.801823 11772 consensus_queue.cc:1048] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:45.809486 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ae497a92e49746a79cbbfe3c82b2b544 (table default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]) successfully deleted
W20260925 01:49:45.811602 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b already in progress: creating tablet
I20260925 01:49:45.812183 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet 31fe174270f24ff780c212eaef90ef0d from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:45.812644 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_de50999ba7d245feb33ce6cd4a90bc03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:45.813009 11753 tablet_bootstrap.cc:492] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.813205 11753 ts_tablet_manager.cc:1403] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.105s user 0.005s sys 0.002s
W20260925 01:49:45.813258 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de50999ba7d245feb33ce6cd4a90bc03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:45.814267 11753 raft_consensus.cc:359] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.814515 11753 raft_consensus.cc:385] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.814605 11753 raft_consensus.cc:740] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.814898 11753 consensus_queue.cc:260] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.815186 11240 raft_consensus.cc:2468] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:45.815590 11753 ts_tablet_manager.cc:1434] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:45.815915 11753 tablet_bootstrap.cc:492] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.818456 11753 tablet_bootstrap.cc:654] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.818445 11851 raft_consensus.cc:515] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.819669 11851 leader_election.cc:290] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.820326 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42d96d45e8c4e8e8bee374477cfb0bb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.820552 11380 raft_consensus.cc:3060] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.828168 11380 raft_consensus.cc:2468] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:45.828703 11753 tablet_bootstrap.cc:492] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.829099 11851 raft_consensus.cc:493] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:45.829332 11851 raft_consensus.cc:515] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.830132 11851 leader_election.cc:290] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.830852 11753 ts_tablet_manager.cc:1403] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.004s
I20260925 01:49:45.832011 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da92b7f256647f19faeed66b4012438" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:45.832211 11522 raft_consensus.cc:2468] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:45.832840 11176 leader_election.cc:304] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.833267 11851 raft_consensus.cc:2804] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:45.833371 11851 raft_consensus.cc:493] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:45.833492 11851 raft_consensus.cc:3060] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.838637 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet b05053f5646f4748a99647b7dbfae686 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:45.839097 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da92b7f256647f19faeed66b4012438" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:45.839632 11851 raft_consensus.cc:515] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.840039 11177 leader_election.cc:304] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:49:45.840449 11177 leader_election.cc:343] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:45.840919 11851 leader_election.cc:290] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:45.841117 11851 raft_consensus.cc:2804] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.841245 11851 raft_consensus.cc:697] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:45.841290 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da92b7f256647f19faeed66b4012438" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:45.841543 11851 consensus_queue.cc:237] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.842028 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da92b7f256647f19faeed66b4012438" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.842243 11522 raft_consensus.cc:3060] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.846153 11360 tablet_service.cc:1511] Processing CreateTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c (DEFAULT_TABLE table=default.Table_5853dcaed91a4f87b5d7b36db7a61965 [id=1b2a20dc907c4e3ca2a5c4a41fd46378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:45.846300 11931 ts_tablet_manager.cc:1929] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:45.846414 11931 log.cc:1199] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ad1cbf07e15440c7919a4bbcd937fb53
I20260925 01:49:45.846649 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:45.846800 11931 ts_tablet_manager.cc:1950] T ad1cbf07e15440c7919a4bbcd937fb53 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:45.846894 11522 raft_consensus.cc:2468] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:45.847393 11176 leader_election.cc:304] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:45.847879 11491 tablet_service.cc:1511] Processing CreateTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c (DEFAULT_TABLE table=default.Table_5853dcaed91a4f87b5d7b36db7a61965 [id=1b2a20dc907c4e3ca2a5c4a41fd46378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:45.848279 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:45.850358 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 55e9d52e3f79408a99216250aefc45c8 (DEFAULT_TABLE table=default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:45.850474 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 55e9d52e3f79408a99216250aefc45c8 (DEFAULT_TABLE table=default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:45.850761 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e9d52e3f79408a99216250aefc45c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:45.850952 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e9d52e3f79408a99216250aefc45c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:45.855468 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c42d96d45e8c4e8e8bee374477cfb0bb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:45.855758 11521 raft_consensus.cc:3060] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:45.857174 11772 raft_consensus.cc:2804] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:45.863610 11772 raft_consensus.cc:697] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:45.865674 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b05053f5646f4748a99647b7dbfae686
I20260925 01:49:45.866410 11674 catalog_manager.cc:6934] ReplaceTablet: tablet b05053f5646f4748a99647b7dbfae686 deleted and replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:49:45.866806 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e25c617f09054071828a13f1a7f5bdc7" } new_table_name: "default.Table_bf94da756bf24c42b0debbb732b59861" modify_external_catalogs: true
I20260925 01:49:45.867097 11753 raft_consensus.cc:359] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.867280 11753 raft_consensus.cc:385] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.867353 11753 raft_consensus.cc:740] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.867569 11753 consensus_queue.cc:260] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.868156 11753 ts_tablet_manager.cc:1434] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.037s user 0.000s sys 0.000s
I20260925 01:49:45.868443 11753 tablet_bootstrap.cc:492] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:45.870733 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 018525730c4e4134ab3a0506f1a0a6fa (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]). Expected version 1 got 0
I20260925 01:49:45.871033 11680 catalog_manager.cc:5838] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:45.871948 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 200caea41ba4466386b091875f017956 (table default.Table_434ed55eea774802bad516c94af8ac39 [id=9389812769844f279c1e0c5fa9707dc0]). Expected version 1 got 0
I20260925 01:49:45.872411 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 1396d679e5824c469490170d257f6a9b (table default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951]). Expected version 1 got 0
I20260925 01:49:45.872632 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]). Expected version 1 got 0
I20260925 01:49:45.872817 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 00906edfa6b648229bcba8e59d68b969 (table default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]). Expected version 1 got 0
I20260925 01:49:45.872996 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:45.873404 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 1 got 0
I20260925 01:49:45.873967 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:45.875357 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.252:44823
--webserver_interface=127.10.159.252
--webserver_port=38543
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 01:49:45.878393 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:45.879001 11680 catalog_manager.cc:5838] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:45.879709 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]). Expected version 1 got 0
I20260925 01:49:45.880507 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 5 got 0
I20260925 01:49:45.881007 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_8f5194a1b70d43f185050d1bdb176d8b [id=f3f8339a90b64cd4812637e6f997f107]). Expected version 1 got 0
I20260925 01:49:45.881361 11680 catalog_manager.cc:5838] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:45.882978 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_39b1b83f732c44ca93f0e5e37326d739 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 1 got 0
I20260925 01:49:45.883526 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_2fe9e3d572a34772b63e49e00ceec625 [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 1 got 0
I20260925 01:49:45.883863 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet b05053f5646f4748a99647b7dbfae686 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:45.884733 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet b05053f5646f4748a99647b7dbfae686 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:45.862428 11177 leader_election.cc:343] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:45.885751 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b05053f5646f4748a99647b7dbfae686 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b05053f5646f4748a99647b7dbfae686 already in progress: creating tablet
I20260925 01:49:45.886276 11753 tablet_bootstrap.cc:654] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.886617 11772 consensus_queue.cc:237] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.880147 11931 tablet_replica.cc:333] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:45.886193 11680 catalog_manager.cc:5838] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:45.890226 11242 raft_consensus.cc:2468] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:45.890892 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_98e49819b069428c81b83d226192a743 [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 1 got 0
I20260925 01:49:45.893539 11755 tablet_bootstrap.cc:492] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.893738 11755 ts_tablet_manager.cc:1403] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.109s user 0.008s sys 0.004s
I20260925 01:49:45.894299 11931 raft_consensus.cc:2243] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:45.894622 11931 raft_consensus.cc:2272] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:45.894694 11755 raft_consensus.cc:359] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.894899 11755 raft_consensus.cc:385] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.894976 11755 raft_consensus.cc:740] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.895267 11755 consensus_queue.cc:260] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.895455 11931 ts_tablet_manager.cc:1916] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:45.895939 11755 ts_tablet_manager.cc:1434] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:45.896293 11755 tablet_bootstrap.cc:492] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.900031 11755 tablet_bootstrap.cc:654] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.900273 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]). Expected version 1 got 0
W20260925 01:49:45.907198 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 59835.1us
I20260925 01:49:45.907863 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ad1cbf07e15440c7919a4bbcd937fb53 (table default.Table_00be63d6c7f14b3d9fe02213f2b47430 [id=8b010808af904c9e8948017b036169ab]) successfully deleted
I20260925 01:49:45.909022 11210 tablet_service.cc:1511] Processing CreateTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c (DEFAULT_TABLE table=default.Table_5853dcaed91a4f87b5d7b36db7a61965 [id=1b2a20dc907c4e3ca2a5c4a41fd46378]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:45.909495 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:45.909929 11755 tablet_bootstrap.cc:492] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.910115 11755 ts_tablet_manager.cc:1403] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.008s
I20260925 01:49:45.910952 11755 raft_consensus.cc:359] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.911147 11755 raft_consensus.cc:385] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.911232 11755 raft_consensus.cc:740] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.911494 11755 consensus_queue.cc:260] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.912060 11755 ts_tablet_manager.cc:1434] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:45.912369 11755 tablet_bootstrap.cc:492] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.915028 11755 tablet_bootstrap.cc:654] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.917666 11755 tablet_bootstrap.cc:492] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.917837 11755 ts_tablet_manager.cc:1403] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260925 01:49:45.918464 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 55e9d52e3f79408a99216250aefc45c8 (DEFAULT_TABLE table=default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:45.918691 11755 raft_consensus.cc:359] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.918922 11755 raft_consensus.cc:385] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.919018 11755 raft_consensus.cc:740] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.919075 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e9d52e3f79408a99216250aefc45c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:45.919371 11755 consensus_queue.cc:260] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.921595 11755 ts_tablet_manager.cc:1434] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260925 01:49:45.922698 11755 tablet_bootstrap.cc:492] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.924463 11755 tablet_bootstrap.cc:654] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.924661 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet b05053f5646f4748a99647b7dbfae686 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.926880 11754 tablet_bootstrap.cc:492] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.927078 11754 ts_tablet_manager.cc:1403] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.196s user 0.013s sys 0.036s
I20260925 01:49:45.927896 11754 raft_consensus.cc:359] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.928119 11754 raft_consensus.cc:385] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.928192 11754 raft_consensus.cc:740] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.928194 11753 tablet_bootstrap.cc:492] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:45.928352 11753 ts_tablet_manager.cc:1403] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.060s user 0.011s sys 0.000s
I20260925 01:49:45.928433 11754 consensus_queue.cc:260] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.928982 11754 ts_tablet_manager.cc:1434] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:45.929078 11753 raft_consensus.cc:359] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.929257 11753 raft_consensus.cc:385] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.929319 11753 raft_consensus.cc:740] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.929329 11754 tablet_bootstrap.cc:492] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.935390 11753 consensus_queue.cc:260] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.936903 11754 tablet_bootstrap.cc:654] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.936988 11931 ts_tablet_manager.cc:1929] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:45.937136 11931 log.cc:1199] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8d4e94cdafd343ee8a84c64668fe48fe
I20260925 01:49:45.937538 11931 ts_tablet_manager.cc:1950] T 8d4e94cdafd343ee8a84c64668fe48fe P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:45.938659 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8d4e94cdafd343ee8a84c64668fe48fe (table default.Table_691fb438533845f28d06c6bbb6f2996d [id=a3021d36f54a4fe3b92a782c075015f5]) successfully deleted
I20260925 01:49:45.938856 11755 tablet_bootstrap.cc:492] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:45.939018 11755 ts_tablet_manager.cc:1403] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.008s
I20260925 01:49:45.940245 11754 tablet_bootstrap.cc:492] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:45.940269 11755 raft_consensus.cc:359] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.940472 11755 raft_consensus.cc:385] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.940523 11754 ts_tablet_manager.cc:1403] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260925 01:49:45.940580 11755 raft_consensus.cc:740] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.940922 11755 consensus_queue.cc:260] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.941490 11755 ts_tablet_manager.cc:1434] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260925 01:49:45.941514 11754 raft_consensus.cc:359] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.941793 11754 raft_consensus.cc:385] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:45.941915 11754 raft_consensus.cc:740] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:45.942232 11754 consensus_queue.cc:260] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:45.942657 11755 tablet_bootstrap.cc:492] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:45.942854 11754 ts_tablet_manager.cc:1434] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:45.943231 11754 tablet_bootstrap.cc:492] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:45.945641 11754 tablet_bootstrap.cc:654] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.946321 11755 tablet_bootstrap.cc:654] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.948729 11931 tablet_replica.cc:333] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:45.949348 11931 raft_consensus.cc:2243] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:45.950738 11931 pending_rounds.cc:70] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:45.951606 11931 pending_rounds.cc:77] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072838010388480 op_type: NO_OP noop_request { }
I20260925 01:49:45.954674 11931 raft_consensus.cc:2889] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:45.955323 11931 raft_consensus.cc:2272] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:45.972434 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1396d679e5824c469490170d257f6a9b
I20260925 01:49:45.973212 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 1396d679e5824c469490170d257f6a9b deleted and replaced by tablet b2708108d6f04f858024542054024e1a
I20260925 01:49:45.973631 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_334a2d580acd443b905330d4680eec76" } modify_external_catalogs: true
I20260925 01:49:45.973851 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_334a2d580acd443b905330d4680eec76" } modify_external_catalogs: true
I20260925 01:49:45.975304 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 1396d679e5824c469490170d257f6a9b with delete_type TABLET_DATA_DELETED (replaced by tablet b2708108d6f04f858024542054024e1a) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:45.976858 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 1396d679e5824c469490170d257f6a9b with delete_type TABLET_DATA_DELETED (replaced by tablet b2708108d6f04f858024542054024e1a) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:45.985198 11753 ts_tablet_manager.cc:1434] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.019s user 0.002s sys 0.001s
I20260925 01:49:45.986580 11953 tablet_replica.cc:333] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:45.986570 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_46b43d62b822482c8a723d9e33935c02" } modify_external_catalogs: true
I20260925 01:49:45.986789 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_46b43d62b822482c8a723d9e33935c02" } modify_external_catalogs: true
I20260925 01:49:45.986990 11953 raft_consensus.cc:2243] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:45.987249 11953 raft_consensus.cc:2272] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:45.987896 11953 ts_tablet_manager.cc:1916] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:45.989086 11753 tablet_bootstrap.cc:492] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:45.989391 11971 consensus_queue.cc:1175] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b93565e796c94a3699eb1824383bbaeb" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260925 01:49:45.991025 11931 ts_tablet_manager.cc:1916] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:45.991351 11753 tablet_bootstrap.cc:654] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:45.992391 11897 consensus_queue.cc:1048] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260925 01:49:46.007315 11931 ts_tablet_manager.cc:1929] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:46.007550 11931 log.cc:1199] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c42d96d45e8c4e8e8bee374477cfb0bb
I20260925 01:49:46.008123 11931 ts_tablet_manager.cc:1950] T c42d96d45e8c4e8e8bee374477cfb0bb P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:46.014213 11780 consensus_queue.cc:1048] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.023283 11754 tablet_bootstrap.cc:492] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:46.023540 11754 ts_tablet_manager.cc:1403] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.080s user 0.016s sys 0.019s
I20260925 01:49:46.023715 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 1396d679e5824c469490170d257f6a9b with delete_type TABLET_DATA_DELETED (replaced by tablet b2708108d6f04f858024542054024e1a) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.024380 11754 raft_consensus.cc:359] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.024585 11754 raft_consensus.cc:385] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:49:46.024580 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1396d679e5824c469490170d257f6a9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1396d679e5824c469490170d257f6a9b already in progress: creating tablet
I20260925 01:49:46.024667 11754 raft_consensus.cc:740] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.024922 11754 consensus_queue.cc:260] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.025538 11754 ts_tablet_manager.cc:1434] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:46.026031 11754 tablet_bootstrap.cc:492] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:46.029001 11754 tablet_bootstrap.cc:654] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.035934 11753 tablet_bootstrap.cc:492] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.036170 11753 ts_tablet_manager.cc:1403] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.004s
I20260925 01:49:46.037336 11753 raft_consensus.cc:359] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.037616 11753 raft_consensus.cc:385] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.037740 11753 raft_consensus.cc:740] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.038125 11753 consensus_queue.cc:260] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.039340 11753 ts_tablet_manager.cc:1434] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:46.043217 11753 tablet_bootstrap.cc:492] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.045274 11753 tablet_bootstrap.cc:654] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.048950 11897 consensus_queue.cc:1048] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.051298 11754 tablet_bootstrap.cc:492] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:46.051471 11754 ts_tablet_manager.cc:1403] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.006s
I20260925 01:49:46.052325 11754 raft_consensus.cc:359] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.052515 11754 raft_consensus.cc:385] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.052600 11754 raft_consensus.cc:740] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.052832 11754 consensus_queue.cc:260] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.053508 11754 ts_tablet_manager.cc:1434] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:46.053802 11754 tablet_bootstrap.cc:492] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:46.056008 11754 tablet_bootstrap.cc:654] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.058365 11851 raft_consensus.cc:493] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.060791 11851 raft_consensus.cc:515] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.061072 11521 raft_consensus.cc:2468] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.061481 11851 leader_election.cc:290] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.061977 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105fd502b74d442eb5d5031f56e5cb62" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.062266 11377 raft_consensus.cc:2468] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.062271 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105fd502b74d442eb5d5031f56e5cb62" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.062486 11522 raft_consensus.cc:2468] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.062867 11177 leader_election.cc:304] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.063244 11851 raft_consensus.cc:2804] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.063369 11851 raft_consensus.cc:493] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.063472 11851 raft_consensus.cc:3060] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.063506 11753 tablet_bootstrap.cc:492] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.063665 11753 ts_tablet_manager.cc:1403] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.002s
I20260925 01:49:46.064517 11753 raft_consensus.cc:359] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.064713 11753 raft_consensus.cc:385] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.064792 11753 raft_consensus.cc:740] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.065099 11753 consensus_queue.cc:260] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.067238 11753 ts_tablet_manager.cc:1434] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:46.068532 11851 raft_consensus.cc:515] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.069268 11753 tablet_bootstrap.cc:492] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.069638 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105fd502b74d442eb5d5031f56e5cb62" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:46.069885 11377 raft_consensus.cc:3060] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.070396 11851 leader_election.cc:290] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.070698 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105fd502b74d442eb5d5031f56e5cb62" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:46.070902 11521 raft_consensus.cc:3060] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.073794 11521 raft_consensus.cc:2468] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.074249 11176 leader_election.cc:304] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.074586 11851 raft_consensus.cc:2804] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:46.074744 11851 raft_consensus.cc:697] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:46.074816 11377 raft_consensus.cc:2468] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.075055 11851 consensus_queue.cc:237] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.076823 11753 tablet_bootstrap.cc:654] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.082677 11753 tablet_bootstrap.cc:492] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.082808 11755 tablet_bootstrap.cc:492] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.082868 11753 ts_tablet_manager.cc:1403] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.003s
I20260925 01:49:46.082983 11755 ts_tablet_manager.cc:1403] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.141s user 0.032s sys 0.028s
I20260925 01:49:46.083847 11753 raft_consensus.cc:359] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.083940 11755 raft_consensus.cc:359] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.084054 11753 raft_consensus.cc:385] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.084177 11753 raft_consensus.cc:740] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.084187 11755 raft_consensus.cc:385] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.084265 11755 raft_consensus.cc:740] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.084438 11753 consensus_queue.cc:260] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.084548 11755 consensus_queue.cc:260] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.085439 11753 ts_tablet_manager.cc:1434] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:46.086036 11753 tablet_bootstrap.cc:492] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.086076 11755 ts_tablet_manager.cc:1434] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:46.086864 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 1 got 0
I20260925 01:49:46.087138 11755 tablet_bootstrap.cc:492] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.087275 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:46.087481 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:46.087652 11754 tablet_bootstrap.cc:492] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:46.087723 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 018525730c4e4134ab3a0506f1a0a6fa (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]). Expected version 1 got 0
I20260925 01:49:46.087829 11754 ts_tablet_manager.cc:1403] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.001s
I20260925 01:49:46.087873 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 200caea41ba4466386b091875f017956 (table default.Table_434ed55eea774802bad516c94af8ac39 [id=9389812769844f279c1e0c5fa9707dc0]). Expected version 1 got 0
I20260925 01:49:46.087968 11753 tablet_bootstrap.cc:654] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.088227 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]). Expected version 1 got 0
I20260925 01:49:46.088663 11754 raft_consensus.cc:359] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.088851 11754 raft_consensus.cc:385] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.088613 11678 catalog_manager.cc:5838] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:46.088932 11754 raft_consensus.cc:740] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.089429 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 5 got 0
I20260925 01:49:46.089543 11953 ts_tablet_manager.cc:1929] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.089658 11953 log.cc:1199] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8d4e94cdafd343ee8a84c64668fe48fe
I20260925 01:49:46.089776 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_98e49819b069428c81b83d226192a743 [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 1 got 0
I20260925 01:49:46.089962 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]). Expected version 1 got 0
I20260925 01:49:46.090085 11953 ts_tablet_manager.cc:1950] T 8d4e94cdafd343ee8a84c64668fe48fe P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:46.090808 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 8d4e94cdafd343ee8a84c64668fe48fe (table default.Table_691fb438533845f28d06c6bbb6f2996d [id=a3021d36f54a4fe3b92a782c075015f5]) successfully deleted
W20260925 01:49:46.091377 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b already in progress: creating tablet
W20260925 01:49:46.091612 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b05053f5646f4748a99647b7dbfae686 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b05053f5646f4748a99647b7dbfae686 already in progress: creating tablet
W20260925 01:49:46.091766 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1396d679e5824c469490170d257f6a9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1396d679e5824c469490170d257f6a9b already in progress: creating tablet
I20260925 01:49:46.092907 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_39b1b83f732c44ca93f0e5e37326d739 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 1 got 0
I20260925 01:49:46.093214 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]). Expected version 1 got 0
I20260925 01:49:46.093483 11755 tablet_bootstrap.cc:654] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.093516 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 00906edfa6b648229bcba8e59d68b969 (table default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]). Expected version 1 got 0
I20260925 01:49:46.093912 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_2fe9e3d572a34772b63e49e00ceec625 [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 1 got 0
I20260925 01:49:46.094405 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_8f5194a1b70d43f185050d1bdb176d8b [id=f3f8339a90b64cd4812637e6f997f107]). Expected version 1 got 0
I20260925 01:49:46.094805 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:46.095455 11754 consensus_queue.cc:260] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.096378 11753 tablet_bootstrap.cc:492] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.096576 11753 ts_tablet_manager.cc:1403] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260925 01:49:46.097476 11753 raft_consensus.cc:359] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.097688 11753 raft_consensus.cc:385] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.097783 11753 raft_consensus.cc:740] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.098110 11754 ts_tablet_manager.cc:1434] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:49:46.098132 11753 consensus_queue.cc:260] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.099010 11753 ts_tablet_manager.cc:1434] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:46.099334 11753 tablet_bootstrap.cc:492] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.101394 11754 tablet_bootstrap.cc:492] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:46.101701 11753 tablet_bootstrap.cc:654] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.103363 11754 tablet_bootstrap.cc:654] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.103933 11755 tablet_bootstrap.cc:492] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.104125 11755 ts_tablet_manager.cc:1403] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.005s
I20260925 01:49:46.105197 11755 raft_consensus.cc:359] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.105496 11755 raft_consensus.cc:385] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.105634 11755 raft_consensus.cc:740] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.105957 11755 consensus_queue.cc:260] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.106631 11755 ts_tablet_manager.cc:1434] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:49:46.106959 11755 tablet_bootstrap.cc:492] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.109081 11755 tablet_bootstrap.cc:654] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:46.109179 11314 consensus_peers.cc:597] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a65faada47c34cd1908970460d3d3f6b. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.114650 11753 tablet_bootstrap.cc:492] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.114861 11753 ts_tablet_manager.cc:1403] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.001s
I20260925 01:49:46.116021 11753 raft_consensus.cc:359] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.116281 11753 raft_consensus.cc:385] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.116389 11753 raft_consensus.cc:740] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.116752 11753 consensus_queue.cc:260] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.117878 11753 ts_tablet_manager.cc:1434] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:46.118237 11753 tablet_bootstrap.cc:492] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.121078 11753 tablet_bootstrap.cc:654] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.128873 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:46.129274 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 1 got 0
I20260925 01:49:46.129650 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 018525730c4e4134ab3a0506f1a0a6fa (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]). Expected version 1 got 0
I20260925 01:49:46.129880 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 200caea41ba4466386b091875f017956 (table default.Table_434ed55eea774802bad516c94af8ac39 [id=9389812769844f279c1e0c5fa9707dc0]). Expected version 1 got 0
I20260925 01:49:46.130475 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 00906edfa6b648229bcba8e59d68b969 (table default.Table_26b2dc8b995c4ade91c9644f6535dc5c [id=1c424cf98429473f9896b9c4028e11f6]). Expected version 1 got 0
I20260925 01:49:46.130896 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]). Expected version 1 got 0
I20260925 01:49:46.131179 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:46.131445 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]). Expected version 1 got 0
I20260925 01:49:46.132004 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:46.132404 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_39b1b83f732c44ca93f0e5e37326d739 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 1 got 0
I20260925 01:49:46.132875 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_2fe9e3d572a34772b63e49e00ceec625 [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 1 got 0
I20260925 01:49:46.133134 11672 catalog_manager.cc:5838] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:46.133664 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 5 got 0
I20260925 01:49:46.133908 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_8f5194a1b70d43f185050d1bdb176d8b [id=f3f8339a90b64cd4812637e6f997f107]). Expected version 1 got 0
I20260925 01:49:46.134275 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_98e49819b069428c81b83d226192a743 [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 1 got 0
I20260925 01:49:46.134538 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]). Expected version 1 got 0
I20260925 01:49:46.134888 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:49:46.136011 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3f397bb38f82466883e8e43a81afcf4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.136703 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f397bb38f82466883e8e43a81afcf4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.140017 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c42d96d45e8c4e8e8bee374477cfb0bb (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]) successfully deleted
W20260925 01:49:46.140793 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b already in progress: creating tablet
I20260925 01:49:46.141001 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.141360 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.143100 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:46.143229 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b05053f5646f4748a99647b7dbfae686 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b05053f5646f4748a99647b7dbfae686 already in progress: creating tablet
W20260925 01:49:46.144557 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1396d679e5824c469490170d257f6a9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1396d679e5824c469490170d257f6a9b already in progress: creating tablet
W20260925 01:49:46.145465 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 already in progress: creating tablet
I20260925 01:49:46.147346 11934 consensus_queue.cc:1048] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:49:46.147740 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 already in progress: creating tablet
I20260925 01:49:46.153005 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8e91b8fa674944b5a4cf4095fc5d57b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.153841 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e91b8fa674944b5a4cf4095fc5d57b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:46.154673 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 already in progress: creating tablet
I20260925 01:49:46.162202 11934 raft_consensus.cc:493] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.162451 11934 raft_consensus.cc:515] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.163744 11934 leader_election.cc:290] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.164605 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f28e49791744428729279a79b6c9f1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.164724 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f28e49791744428729279a79b6c9f1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.164882 11522 raft_consensus.cc:2468] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:46.164937 11242 raft_consensus.cc:2468] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:46.166766 11314 leader_election.cc:304] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:46.169209 11934 raft_consensus.cc:2804] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.169328 11934 raft_consensus.cc:493] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.169432 11934 raft_consensus.cc:3060] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.172399 11934 raft_consensus.cc:515] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.173348 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f28e49791744428729279a79b6c9f1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:46.173554 11242 raft_consensus.cc:3060] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.180188 11242 raft_consensus.cc:2468] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:46.180884 11314 leader_election.cc:304] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.181283 11886 raft_consensus.cc:2804] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:46.181223 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_26b2dc8b995c4ade91c9644f6535dc5c" } new_table_name: "default.Table_6ae7ffbe7b334c87a1be9c5c18761c65" modify_external_catalogs: true
I20260925 01:49:46.181407 11886 raft_consensus.cc:697] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:46.181697 11886 consensus_queue.cc:237] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.193960 11934 leader_election.cc:290] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.194084 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f28e49791744428729279a79b6c9f1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:46.194365 11521 raft_consensus.cc:3060] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.194595 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ca76f6f710d841fd8999b40e5a48693f
I20260925 01:49:46.195601 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ea9cb22dacf64efe966cbcfb02725dfe" } new_table_name: "default.Table_fdc621d947f448fca1456221c2c4326e" modify_external_catalogs: true
I20260925 01:49:46.195814 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.196434 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:46.197362 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ca76f6f710d841fd8999b40e5a48693f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca76f6f710d841fd8999b40e5a48693f already in progress: creating tablet
I20260925 01:49:46.197626 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.198902 11521 raft_consensus.cc:2468] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
W20260925 01:49:46.199196 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ca76f6f710d841fd8999b40e5a48693f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca76f6f710d841fd8999b40e5a48693f already in progress: creating tablet
W20260925 01:49:46.199766 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ca76f6f710d841fd8999b40e5a48693f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca76f6f710d841fd8999b40e5a48693f already in progress: creating tablet
I20260925 01:49:46.201131 11753 tablet_bootstrap.cc:492] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.201316 11753 ts_tablet_manager.cc:1403] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.083s user 0.012s sys 0.019s
I20260925 01:49:46.202273 11753 raft_consensus.cc:359] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.202483 11753 raft_consensus.cc:385] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.202562 11753 raft_consensus.cc:740] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.202842 11753 consensus_queue.cc:260] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.204277 11753 ts_tablet_manager.cc:1434] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:46.204885 11753 tablet_bootstrap.cc:492] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.207649 11753 tablet_bootstrap.cc:654] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.210415 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ba19192502634f8599407d923114a627
W20260925 01:49:46.210485 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99913eb35197442880a27b3c288237f4 consensus state has no leader
W20260925 01:49:46.210510 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00906edfa6b648229bcba8e59d68b969 consensus state has no leader
I20260925 01:49:46.211050 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c6503d38584945e3a845e2f96ab5a4fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.211218 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_58fdde0b3e6a47b79d42646ec2ed37ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.211501 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0523f9d0a4ec4762bf166dafb16b6f9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.211767 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6503d38584945e3a845e2f96ab5a4fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.211838 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bb98d5a38f43450c80d057d9eb2f92d1
W20260925 01:49:46.212198 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0523f9d0a4ec4762bf166dafb16b6f9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.212611 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6aeff7af2df84fee9f3046307fd12f1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.212782 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d435f3e4da774c15a1f5f56480c2d888"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.213066 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6aeff7af2df84fee9f3046307fd12f1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:46.213402 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d435f3e4da774c15a1f5f56480c2d888 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.214210 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 31fe174270f24ff780c212eaef90ef0d
W20260925 01:49:46.214429 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58fdde0b3e6a47b79d42646ec2ed37ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.215091 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_41614d44ad5844f9911213d219401534" } new_table_name: "default.Table_c8864007672442f9a84738610b63af81" modify_external_catalogs: true
W20260925 01:49:46.215505 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff92ca86767f4ba6905da62b6a4b892c consensus state has no leader
I20260925 01:49:46.216073 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8923a0ea1d1a4690b2e588ace30e22a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.216687 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8923a0ea1d1a4690b2e588ace30e22a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.218448 11851 raft_consensus.cc:493] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:46.218744 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 consensus state has no leader
I20260925 01:49:46.218686 11851 raft_consensus.cc:515] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.219120 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9cb04782490848a79ec41ab36549c475"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.219605 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cb04782490848a79ec41ab36549c475 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.219642 11851 leader_election.cc:290] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.220281 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75a4ed161734d30ab5ad2e2b00d77c9" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.220516 11521 raft_consensus.cc:2468] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.220700 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.221004 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 31fe174270f24ff780c212eaef90ef0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.221065 11176 leader_election.cc:304] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.221012 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.221702 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75a4ed161734d30ab5ad2e2b00d77c9" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.221925 11380 raft_consensus.cc:2468] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.222484 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.222812 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 31fe174270f24ff780c212eaef90ef0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.223546 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.224220 11753 tablet_bootstrap.cc:492] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.224370 11753 ts_tablet_manager.cc:1403] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20260925 01:49:46.224514 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.224786 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 31fe174270f24ff780c212eaef90ef0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.225014 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.225258 11753 raft_consensus.cc:359] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.225440 11753 raft_consensus.cc:385] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.225518 11753 raft_consensus.cc:740] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.225769 11753 consensus_queue.cc:260] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:46.226190 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ba19192502634f8599407d923114a627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba19192502634f8599407d923114a627 already in progress: creating tablet
W20260925 01:49:46.226483 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 31fe174270f24ff780c212eaef90ef0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31fe174270f24ff780c212eaef90ef0d already in progress: creating tablet
W20260925 01:49:46.226754 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bb98d5a38f43450c80d057d9eb2f92d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb98d5a38f43450c80d057d9eb2f92d1 already in progress: creating tablet
I20260925 01:49:46.227141 11851 raft_consensus.cc:2804] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.227255 11851 raft_consensus.cc:493] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.227353 11851 raft_consensus.cc:3060] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.228752 11753 ts_tablet_manager.cc:1434] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:49:46.229316 11753 tablet_bootstrap.cc:492] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:46.229346 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bb98d5a38f43450c80d057d9eb2f92d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb98d5a38f43450c80d057d9eb2f92d1 already in progress: creating tablet
I20260925 01:49:46.229497 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet ff92ca86767f4ba6905da62b6a4b892c from {username='slave'} at 127.0.0.1:60372
W20260925 01:49:46.229637 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 31fe174270f24ff780c212eaef90ef0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31fe174270f24ff780c212eaef90ef0d already in progress: creating tablet
W20260925 01:49:46.229871 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ba19192502634f8599407d923114a627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba19192502634f8599407d923114a627 already in progress: creating tablet
I20260925 01:49:46.231514 11753 tablet_bootstrap.cc:654] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.233181 11851 raft_consensus.cc:515] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.234705 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75a4ed161734d30ab5ad2e2b00d77c9" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:46.234927 11380 raft_consensus.cc:3060] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.236264 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c75a4ed161734d30ab5ad2e2b00d77c9" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:46.236553 11521 raft_consensus.cc:3060] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.238039 11380 raft_consensus.cc:2468] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.238298 11851 leader_election.cc:290] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.238822 11177 leader_election.cc:304] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.240115 11851 raft_consensus.cc:2804] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:46.240427 11755 tablet_bootstrap.cc:492] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.240423 11851 raft_consensus.cc:697] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:46.240608 11755 ts_tablet_manager.cc:1403] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.134s user 0.020s sys 0.028s
I20260925 01:49:46.240890 11851 consensus_queue.cc:237] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.241110 11521 raft_consensus.cc:2468] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.241417 11755 raft_consensus.cc:359] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.241634 11755 raft_consensus.cc:385] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.241727 11755 raft_consensus.cc:740] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.241984 11755 consensus_queue.cc:260] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:46.242509 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bb98d5a38f43450c80d057d9eb2f92d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb98d5a38f43450c80d057d9eb2f92d1 already in progress: creating tablet
I20260925 01:49:46.242586 11755 ts_tablet_manager.cc:1434] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:49:46.242899 11755 tablet_bootstrap.cc:492] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.245020 11755 tablet_bootstrap.cc:654] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:46.245786 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 31fe174270f24ff780c212eaef90ef0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31fe174270f24ff780c212eaef90ef0d already in progress: creating tablet
W20260925 01:49:46.246757 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ba19192502634f8599407d923114a627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba19192502634f8599407d923114a627 already in progress: creating tablet
W20260925 01:49:46.250689 11177 consensus_peers.cc:597] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b96b272afb8341dd9bfff9702c433026. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:46.254524 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5ad258cd4788477ea5f9e34ebcab95c7 consensus state has no leader
I20260925 01:49:46.260506 11886 raft_consensus.cc:493] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.260766 11886 raft_consensus.cc:515] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.261713 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.262463 11886 leader_election.cc:290] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:46.262651 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because the tablet was not found. No further retry: Not found: Tablet not found: 8d4e94cdafd343ee8a84c64668fe48fe
I20260925 01:49:46.263166 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:46.264065 11314 leader_election.cc:343] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:46.264904 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 357963616763428fa69c7670e760f84e consensus state has no leader
I20260925 01:49:46.265198 11671 master_service.cc:960] ReplaceTablet: received request to replace tablet 8d4e94cdafd343ee8a84c64668fe48fe from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.265305 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:46.266372 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 29f28e49791744428729279a79b6c9f1 consensus state has no leader
I20260925 01:49:46.267598 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.267899 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.268180 11953 tablet_replica.cc:333] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:46.268182 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.268460 11953 raft_consensus.cc:2243] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:49:46.268772 11314 leader_election.cc:343] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:46.268961 11314 leader_election.cc:304] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:46.267330 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b9937c3776f549dea887ace26dae492c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9937c3776f549dea887ace26dae492c already in progress: creating tablet
I20260925 01:49:46.268385 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet 31fe174270f24ff780c212eaef90ef0d from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.268970 11953 pending_rounds.cc:70] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:46.269676 11953 pending_rounds.cc:77] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072837191475200 op_type: NO_OP noop_request { }
I20260925 01:49:46.269858 11953 raft_consensus.cc:2889] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:46.270025 11953 raft_consensus.cc:2272] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.270339 11886 raft_consensus.cc:2749] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:46.271109 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.271166 11953 ts_tablet_manager.cc:1916] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.272413 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 6837562b484242e5bf2b4eb085de7ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.272547 11753 tablet_bootstrap.cc:492] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.272740 11753 ts_tablet_manager.cc:1403] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.016s
W20260925 01:49:46.272878 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 4195e3f8e93e40fe9dfd72710d319dca consensus state has no leader
I20260925 01:49:46.273646 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet f07f754fa5b748a1a25d43e6011c5460 with delete_type TABLET_DATA_DELETED (replaced by tablet fa619556e5af473998080f4bbc9e5d1e) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.273586 11753 raft_consensus.cc:359] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.273793 11753 raft_consensus.cc:385] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.273877 11753 raft_consensus.cc:740] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.274231 11753 consensus_queue.cc:260] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.274695 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.275127 11753 ts_tablet_manager.cc:1434] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260925 01:49:46.275565 11753 tablet_bootstrap.cc:492] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.277885 11753 tablet_bootstrap.cc:654] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.279098 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:46.280170 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3da92b7f256647f19faeed66b4012438 consensus state has no leader
I20260925 01:49:46.280948 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.282348 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.283357 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet bfd9645cd6644a55997eb7745c7b29f2 with delete_type TABLET_DATA_DELETED (replaced by tablet e7f421bb962e407c8b459eaad6e45b61) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.284235 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 with delete_type TABLET_DATA_DELETED (replaced by tablet 00906edfa6b648229bcba8e59d68b969) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.284755 11240 raft_consensus.cc:1275] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Refusing update from remote peer 514f31e4c2e54d9aaf6d4dd771d153b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:46.285032 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.285311 11377 raft_consensus.cc:1275] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Refusing update from remote peer 514f31e4c2e54d9aaf6d4dd771d153b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:46.285645 11887 consensus_queue.cc:1048] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.285967 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.286235 11895 consensus_queue.cc:1048] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.286482 11897 consensus_queue.cc:1048] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.290904 11755 tablet_bootstrap.cc:492] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.291061 11755 ts_tablet_manager.cc:1403] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.004s
I20260925 01:49:46.291858 11755 raft_consensus.cc:359] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.292042 11755 raft_consensus.cc:385] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.292128 11755 raft_consensus.cc:740] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.295079 11755 consensus_queue.cc:260] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.296552 11755 ts_tablet_manager.cc:1434] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:49:46.296871 11755 tablet_bootstrap.cc:492] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.297281 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.298408 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb with delete_type TABLET_DATA_DELETED (replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.299052 11755 tablet_bootstrap.cc:654] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.299512 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:46.300356 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7], current schema version=5): Not found: failed to reset TS proxy: No leader found: Tablet 5ef1b5f18d074016a6dea82da8e2d2b2 consensus state has no leader
I20260925 01:49:46.304976 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 018525730c4e4134ab3a0506f1a0a6fa from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.305693 11887 raft_consensus.cc:493] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.305896 11887 raft_consensus.cc:515] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.306792 11887 leader_election.cc:290] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.306821 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet b96b272afb8341dd9bfff9702c433026 with delete_type TABLET_DATA_DELETED (replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.307261 11946 tablet_replica.cc:333] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:46.307499 11946 raft_consensus.cc:2243] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.307694 11946 raft_consensus.cc:2272] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.308248 11946 ts_tablet_manager.cc:1916] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.308920 11753 tablet_bootstrap.cc:492] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.309103 11753 ts_tablet_manager.cc:1403] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.005s
I20260925 01:49:46.310885 11753 raft_consensus.cc:359] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.311087 11753 raft_consensus.cc:385] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.311175 11753 raft_consensus.cc:740] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:49:46.310434 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_39b1b83f732c44ca93f0e5e37326d739 [id=25512a7f4c4741d4aba6f86f1497dca4], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0fa7a3941254478c800f9e366e3f7b06 consensus state has no leader
I20260925 01:49:46.312150 11239 raft_consensus.cc:1275] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Refusing update from remote peer 514f31e4c2e54d9aaf6d4dd771d153b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260925 01:49:46.312462 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ec82ac4f3b4d48fbbb33c21f5630d749 consensus state has no leader
I20260925 01:49:46.312811 11753 consensus_queue.cc:260] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:46.313386 11680 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 1396d679e5824c469490170d257f6a9b (table default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1396d679e5824c469490170d257f6a9b consensus state has no leader
I20260925 01:49:46.313594 11754 tablet_bootstrap.cc:492] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
W20260925 01:49:46.313623 11680 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet fa619556e5af473998080f4bbc9e5d1e consensus state has no leader
I20260925 01:49:46.313750 11754 ts_tablet_manager.cc:1403] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.215s user 0.010s sys 0.016s
I20260925 01:49:46.314634 11754 raft_consensus.cc:359] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.314814 11754 raft_consensus.cc:385] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.314896 11754 raft_consensus.cc:740] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.315133 11754 consensus_queue.cc:260] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.315721 11754 ts_tablet_manager.cc:1434] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:46.315971 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 06b59e1505e246d2abada79299e09bfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.315927 11887 consensus_queue.cc:1048] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.316644 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65068a447744ec99e56489963b251c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.316769 11754 tablet_bootstrap.cc:492] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:46.319026 11754 tablet_bootstrap.cc:654] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.319959 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.321177 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.321487 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.321525 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.321820 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.322054 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.323704 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.324147 11753 ts_tablet_manager.cc:1434] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
W20260925 01:49:46.324536 11678 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_2fe9e3d572a34772b63e49e00ceec625 [id=37bc53f74b2a4f618298bde3281e0ecf], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8bf42293dd5d452aa7ed9e0eaa78f54d consensus state has no leader
I20260925 01:49:46.324663 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb with delete_type TABLET_DATA_DELETED (replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.324764 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.325707 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.326792 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.328361 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet ba19192502634f8599407d923114a627 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.329679 11753 tablet_bootstrap.cc:492] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.330451 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b59e1505e246d2abada79299e09bfe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.330499 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_455458464d54496892b32698053029f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.330708 11240 raft_consensus.cc:2468] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:49:46.331175 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_455458464d54496892b32698053029f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.331238 11456 leader_election.cc:304] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.331553 11887 raft_consensus.cc:2804] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.331674 11887 raft_consensus.cc:493] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.331815 11887 raft_consensus.cc:3060] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.332037 11753 tablet_bootstrap.cc:654] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.334836 11887 raft_consensus.cc:515] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.335775 11887 leader_election.cc:290] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.336750 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b59e1505e246d2abada79299e09bfe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:46.337033 11241 raft_consensus.cc:3060] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.341643 11241 raft_consensus.cc:2468] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:46.343034 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9f4e74bbaa2e4916a69570f511ad227f" } modify_external_catalogs: true
I20260925 01:49:46.343864 11456 leader_election.cc:304] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.344194 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9f4e74bbaa2e4916a69570f511ad227f" } modify_external_catalogs: true
I20260925 01:49:46.347579 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_196b02edd23b4384aef87a7819365849"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.348263 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_196b02edd23b4384aef87a7819365849 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.353307 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b59e1505e246d2abada79299e09bfe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.353605 11379 raft_consensus.cc:2468] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:46.353869 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06b59e1505e246d2abada79299e09bfe" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:46.354107 11886 raft_consensus.cc:493] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.356722 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.358137 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.361701 11887 raft_consensus.cc:2804] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:46.362109 11887 raft_consensus.cc:697] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:46.362536 11887 consensus_queue.cc:237] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.363312 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ff92ca86767f4ba6905da62b6a4b892c
I20260925 01:49:46.363941 11674 catalog_manager.cc:6934] ReplaceTablet: tablet ff92ca86767f4ba6905da62b6a4b892c deleted and replaced by tablet c215c3541057498db63e03c685325f48
I20260925 01:49:46.369777 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet da74fa4b6fa841b7aebb81302cab2885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.369850 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet ff92ca86767f4ba6905da62b6a4b892c with delete_type TABLET_DATA_DELETED (replaced by tablet c215c3541057498db63e03c685325f48) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.371196 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ff92ca86767f4ba6905da62b6a4b892c with delete_type TABLET_DATA_DELETED (replaced by tablet c215c3541057498db63e03c685325f48) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:46.371519 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ff92ca86767f4ba6905da62b6a4b892c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff92ca86767f4ba6905da62b6a4b892c already in progress: creating tablet
I20260925 01:49:46.373440 11886 raft_consensus.cc:515] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.374306 11886 leader_election.cc:290] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.375946 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da92b7f256647f19faeed66b4012438" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.376127 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da92b7f256647f19faeed66b4012438" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.376462 11522 raft_consensus.cc:2393] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:46.344868 11946 ts_tablet_manager.cc:1929] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.376767 11946 log.cc:1199] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b96b272afb8341dd9bfff9702c433026
I20260925 01:49:46.377676 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb4dac3099346a7975229d472a3919e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.377924 11375 raft_consensus.cc:3060] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.380770 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet b05053f5646f4748a99647b7dbfae686 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:46.384714 11176 consensus_peers.cc:597] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.389302 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.389523 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.386510 11314 leader_election.cc:304] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:46.391990 11960 mvcc.cc:204] Tried to move back new op lower bound from 7333072839805706240 to 7333072836857425920. Current Snapshot: MvccSnapshot[applied={T|T < 7333072839805706240}]
I20260925 01:49:46.394891 11946 ts_tablet_manager.cc:1950] T b96b272afb8341dd9bfff9702c433026 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:46.399986 11946 tablet_replica.cc:333] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:46.398448 12015 tablet.cc:1751] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:49:46.411950 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 31fe174270f24ff780c212eaef90ef0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.417883 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b96b272afb8341dd9bfff9702c433026 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]) successfully deleted
I20260925 01:49:46.418237 11376 raft_consensus.cc:3060] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.419205 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ec3787167585495b80752bc3468751b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.419934 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec3787167585495b80752bc3468751b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.421500 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fdc621d947f448fca1456221c2c4326e" } modify_external_catalogs: true
I20260925 01:49:46.421708 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fdc621d947f448fca1456221c2c4326e" } modify_external_catalogs: true
I20260925 01:49:46.422138 11886 raft_consensus.cc:3060] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.423949 11946 raft_consensus.cc:2243] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:46.424309 11946 pending_rounds.cc:70] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:46.424424 11946 pending_rounds.cc:77] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072840144515072 op_type: NO_OP noop_request { }
I20260925 01:49:46.424569 11946 raft_consensus.cc:2889] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:46.424718 11946 raft_consensus.cc:2272] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.426323 12024 tablet.cc:1751] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:46.427350 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.427554 11375 raft_consensus.cc:2468] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:46.427800 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 31fe174270f24ff780c212eaef90ef0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.401561 12016 tablet.cc:1751] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:49:46.428927 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_12863b20d1544e0f9c998bc0d9c032a4" } new_table_name: "default.Table_61ad0d49c2ce46bb9dae128a9ec6e57c" modify_external_catalogs: true
I20260925 01:49:46.430106 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.433103 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_95548c275bf74095b2d15cdf54943a63" } modify_external_catalogs: true
I20260925 01:49:46.433400 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_95548c275bf74095b2d15cdf54943a63" } modify_external_catalogs: true
I20260925 01:49:46.434124 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.434159 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb4dac3099346a7975229d472a3919e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.405638 11753 tablet_bootstrap.cc:492] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.437105 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.437196 11753 ts_tablet_manager.cc:1403] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.108s user 0.005s sys 0.008s
I20260925 01:49:46.437245 11755 tablet_bootstrap.cc:492] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.416637 12020 tablet.cc:1751] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:46.438778 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.440100 11671 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet b2708108d6f04f858024542054024e1a
I20260925 01:49:46.441882 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.442443 11753 raft_consensus.cc:359] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.442574 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5853dcaed91a4f87b5d7b36db7a61965" } modify_external_catalogs: true
I20260925 01:49:46.442663 11753 raft_consensus.cc:385] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.442741 11753 raft_consensus.cc:740] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.442790 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5853dcaed91a4f87b5d7b36db7a61965" } modify_external_catalogs: true
I20260925 01:49:46.442830 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76845ed48045b7b3632179be022e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.443559 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6aeff7af2df84fee9f3046307fd12f1a" } new_table_name: "default.Table_50f2a466d4b34198a9ddc948428a968b" modify_external_catalogs: true
I20260925 01:49:46.443802 11946 ts_tablet_manager.cc:1916] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.448065 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.448351 11753 consensus_queue.cc:260] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.449100 11753 ts_tablet_manager.cc:1434] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:49:46.449391 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.449331 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 039ee80a2822417898c1d1d779f52867 (DEFAULT_TABLE table=default.Table_de50999ba7d245feb33ce6cd4a90bc03 [id=b011ff7009fc4e419f245e75f8fec10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.449858 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ee80a2822417898c1d1d779f52867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.449846 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet c3289c6dc8e84a358f877a197412d901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.450385 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet b05053f5646f4748a99647b7dbfae686 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.454209 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 with delete_type TABLET_DATA_DELETED (replaced by tablet 00906edfa6b648229bcba8e59d68b969) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.454813 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.455281 11753 tablet_bootstrap.cc:492] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.455551 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet e506eeed137e42e18e4d0e340d148aa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.456676 11208 tablet_service.cc:1511] Processing CreateTablet for tablet f0157a45817246cfaa0b016afdbd59cb (DEFAULT_TABLE table=default.Table_f43d73b46d5e439aa7bc235e82b6d1a2 [id=c3bda2bcc66f4f4ea55f4a7066905c87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.457072 11753 tablet_bootstrap.cc:654] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.457156 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0157a45817246cfaa0b016afdbd59cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.462414 12016 tablet.cc:1751] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:46.465593 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 039ee80a2822417898c1d1d779f52867 (DEFAULT_TABLE table=default.Table_de50999ba7d245feb33ce6cd4a90bc03 [id=b011ff7009fc4e419f245e75f8fec10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.466730 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ee80a2822417898c1d1d779f52867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.470391 11498 tablet_service.cc:1511] Processing CreateTablet for tablet f0157a45817246cfaa0b016afdbd59cb (DEFAULT_TABLE table=default.Table_f43d73b46d5e439aa7bc235e82b6d1a2 [id=c3bda2bcc66f4f4ea55f4a7066905c87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.470863 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0157a45817246cfaa0b016afdbd59cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.474123 11953 ts_tablet_manager.cc:1929] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:46.474290 11953 log.cc:1199] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ad1cbf07e15440c7919a4bbcd937fb53
I20260925 01:49:46.474222 11959 mvcc.cc:204] Tried to move back new op lower bound from 7333072839915388928 to 7333072836036775936. Current Snapshot: MvccSnapshot[applied={T|T < 7333072839915388928}]
I20260925 01:49:46.474783 11953 ts_tablet_manager.cc:1950] T ad1cbf07e15440c7919a4bbcd937fb53 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:46.475782 11953 tablet_replica.cc:333] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:46.476030 11953 raft_consensus.cc:2243] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.476207 11953 raft_consensus.cc:2272] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.476864 11953 ts_tablet_manager.cc:1916] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.478118 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 331380a2be9a4893927c9b94a2c3e08b (DEFAULT_TABLE table=default.Table_7feb65e332c34c1db0f6aa4f98ffa8b9 [id=e59a426273844acdbd1ce81acc4132b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.478619 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331380a2be9a4893927c9b94a2c3e08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.479166 11485 tablet_service.cc:1511] Processing CreateTablet for tablet ba378e9d37c64a8ebd56894b2101ed8f (DEFAULT_TABLE table=default.Table_4cf67d6ebac74fe195aff1bffe6cde96 [id=54187dc7496e4b15a88c29718ca70f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.479564 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba378e9d37c64a8ebd56894b2101ed8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.480787 11210 tablet_service.cc:1511] Processing CreateTablet for tablet ba378e9d37c64a8ebd56894b2101ed8f (DEFAULT_TABLE table=default.Table_4cf67d6ebac74fe195aff1bffe6cde96 [id=54187dc7496e4b15a88c29718ca70f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.481175 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba378e9d37c64a8ebd56894b2101ed8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.481410 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 06b59e1505e246d2abada79299e09bfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.481410 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 1396d679e5824c469490170d257f6a9b with delete_type TABLET_DATA_DELETED (replaced by tablet b2708108d6f04f858024542054024e1a) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.482322 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.482229 12019 consensus_queue.cc:1048] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 01:49:46.490887 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 331380a2be9a4893927c9b94a2c3e08b (DEFAULT_TABLE table=default.Table_7feb65e332c34c1db0f6aa4f98ffa8b9 [id=e59a426273844acdbd1ce81acc4132b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.491267 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331380a2be9a4893927c9b94a2c3e08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.493520 11353 tablet_service.cc:1511] Processing CreateTablet for tablet f0157a45817246cfaa0b016afdbd59cb (DEFAULT_TABLE table=default.Table_f43d73b46d5e439aa7bc235e82b6d1a2 [id=c3bda2bcc66f4f4ea55f4a7066905c87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.494379 11491 tablet_service.cc:1511] Processing CreateTablet for tablet f892954cd22c48aaad2f0e20b1277844 (DEFAULT_TABLE table=default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.494736 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f892954cd22c48aaad2f0e20b1277844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.494903 11356 tablet_service.cc:1511] Processing CreateTablet for tablet ba378e9d37c64a8ebd56894b2101ed8f (DEFAULT_TABLE table=default.Table_4cf67d6ebac74fe195aff1bffe6cde96 [id=54187dc7496e4b15a88c29718ca70f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.495417 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65068a447744ec99e56489963b251c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.495662 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 039ee80a2822417898c1d1d779f52867 (DEFAULT_TABLE table=default.Table_de50999ba7d245feb33ce6cd4a90bc03 [id=b011ff7009fc4e419f245e75f8fec10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.496565 11886 raft_consensus.cc:2749] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:46.496611 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ad1cbf07e15440c7919a4bbcd937fb53 (table default.Table_00be63d6c7f14b3d9fe02213f2b47430 [id=8b010808af904c9e8948017b036169ab]) successfully deleted
I20260925 01:49:46.497780 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8923a0ea1d1a4690b2e588ace30e22a2" } new_table_name: "default.Table_86edaad42a944526bfcf613cf67660dc" modify_external_catalogs: true
I20260925 01:49:46.500850 12024 tablet.cc:1751] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:46.502012 11347 tablet_service.cc:1511] Processing CreateTablet for tablet f892954cd22c48aaad2f0e20b1277844 (DEFAULT_TABLE table=default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.503247 11755 ts_tablet_manager.cc:1403] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.141s user 0.004s sys 0.008s
I20260925 01:49:46.503247 12023 tablet.cc:1751] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:49:46.504117 11755 raft_consensus.cc:359] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.504323 11755 raft_consensus.cc:385] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.504415 11755 raft_consensus.cc:740] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.504686 11755 consensus_queue.cc:260] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.505309 11755 ts_tablet_manager.cc:1434] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:46.505679 11755 tablet_bootstrap.cc:492] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.505831 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.506186 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76845ed48045b7b3632179be022e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.506372 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.506547 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet ff92ca86767f4ba6905da62b6a4b892c with delete_type TABLET_DATA_DELETED (replaced by tablet c215c3541057498db63e03c685325f48) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.506707 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0157a45817246cfaa0b016afdbd59cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.506991 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba378e9d37c64a8ebd56894b2101ed8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.507113 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet c3289c6dc8e84a358f877a197412d901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.507282 11934 raft_consensus.cc:493] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.507434 11934 raft_consensus.cc:515] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.508128 11934 leader_election.cc:290] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.508337 11676 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet c215c3541057498db63e03c685325f48
I20260925 01:49:46.508385 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 331380a2be9a4893927c9b94a2c3e08b (DEFAULT_TABLE table=default.Table_7feb65e332c34c1db0f6aa4f98ffa8b9 [id=e59a426273844acdbd1ce81acc4132b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.508770 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331380a2be9a4893927c9b94a2c3e08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.501610 11222 tablet_service.cc:1511] Processing CreateTablet for tablet f892954cd22c48aaad2f0e20b1277844 (DEFAULT_TABLE table=default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.510046 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f892954cd22c48aaad2f0e20b1277844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.519007 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 039ee80a2822417898c1d1d779f52867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.522651 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f892954cd22c48aaad2f0e20b1277844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.523561 11755 tablet_bootstrap.cc:654] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.529877 12028 tablet.cc:1751] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:46.534639 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0f4010708b5b45fe8194002faf14225e" } modify_external_catalogs: true
I20260925 01:49:46.542906 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195e3f8e93e40fe9dfd72710d319dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.545718 11239 raft_consensus.cc:2468] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:46.546895 11314 leader_election.cc:304] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.547291 11886 raft_consensus.cc:2804] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.547381 11886 raft_consensus.cc:493] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.547483 11886 raft_consensus.cc:3060] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.547857 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65068a447744ec99e56489963b251c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.548135 11931 tablet_replica.cc:333] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:46.548334 11931 raft_consensus.cc:2243] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.548540 11931 raft_consensus.cc:2272] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.549028 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 1 got 0
I20260925 01:49:46.549137 11931 ts_tablet_manager.cc:1916] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.549531 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]). Expected version 1 got 0
I20260925 01:49:46.550088 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 200caea41ba4466386b091875f017956 (table default.Table_434ed55eea774802bad516c94af8ac39 [id=9389812769844f279c1e0c5fa9707dc0]). Expected version 1 got 0
I20260925 01:49:46.550808 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:46.551285 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 2 got 0
I20260925 01:49:46.551659 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:46.551677 11886 raft_consensus.cc:515] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.552575 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 5 got 0
I20260925 01:49:46.553027 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195e3f8e93e40fe9dfd72710d319dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:46.553098 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]). Expected version 1 got 0
I20260925 01:49:46.553268 11242 raft_consensus.cc:3060] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.553812 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d4e94cdafd343ee8a84c64668fe48fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.554601 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.555747 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0f4010708b5b45fe8194002faf14225e" } modify_external_catalogs: true
I20260925 01:49:46.556111 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet ad1cbf07e15440c7919a4bbcd937fb53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.556691 11242 raft_consensus.cc:2468] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:46.557232 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet afc1cd6e88764445b0a1fdc92e0c53e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.557616 11314 leader_election.cc:304] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.557919 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.557943 11934 raft_consensus.cc:2804] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:46.558169 11934 raft_consensus.cc:697] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:46.558466 11934 consensus_queue.cc:237] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.558609 11886 leader_election.cc:290] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.558907 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet ae497a92e49746a79cbbfe3c82b2b544 with delete_type TABLET_DATA_DELETED (replaced by tablet 60c40e2db5e2434192a359f50c02fe13) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.559583 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 95dfbc1ce9db4f01bf6ec8965b62c994 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.560606 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.562373 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 with delete_type TABLET_DATA_DELETED (replaced by tablet 00906edfa6b648229bcba8e59d68b969) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.563241 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.564007 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet b96b272afb8341dd9bfff9702c433026 with delete_type TABLET_DATA_DELETED (replaced by tablet 770ebdbd355142ba86fd9eb8eaa844f4) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.564765 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 1396d679e5824c469490170d257f6a9b with delete_type TABLET_DATA_DELETED (replaced by tablet b2708108d6f04f858024542054024e1a) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.566987 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet c42d96d45e8c4e8e8bee374477cfb0bb with delete_type TABLET_DATA_DELETED (replaced by tablet ec82ac4f3b4d48fbbb33c21f5630d749) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.567896 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.568866 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet a26b7ec7373d42668f40c7c89084be47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.569804 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet ac03ebbd455f4fad88e875b69a049bc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.570603 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.571382 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c7e15700f64a92b87a6901950c5412 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d3626880758447e9aa85f8f9070d4e3) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.572067 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet a3ec6c34d22241e5bda3ec6665a47fc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.572804 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 31fe174270f24ff780c212eaef90ef0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.573220 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.574257 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 06b59e1505e246d2abada79299e09bfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.574432 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.575169 11931 ts_tablet_manager.cc:1929] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.575289 11931 log.cc:1199] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/5b65068a447744ec99e56489963b251c
I20260925 01:49:46.562047 11953 ts_tablet_manager.cc:1929] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.575676 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.575774 11931 ts_tablet_manager.cc:1950] T 5b65068a447744ec99e56489963b251c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:46.575960 11953 log.cc:1199] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/afc1cd6e88764445b0a1fdc92e0c53e5
I20260925 01:49:46.576403 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.577054 11953 ts_tablet_manager.cc:1950] T afc1cd6e88764445b0a1fdc92e0c53e5 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:46.577265 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet c3289c6dc8e84a358f877a197412d901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.577586 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 5b65068a447744ec99e56489963b251c (table default.Table_c6206da59ecf432cb4c65623ced807f5 [id=fe56a57c1dff44e09680b6041eeafac5]) successfully deleted
I20260925 01:49:46.578300 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet c96165d1a85d4ee99748563078ae2a3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.578684 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb4dac3099346a7975229d472a3919e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.578863 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76845ed48045b7b3632179be022e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.579116 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet b05053f5646f4748a99647b7dbfae686 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.579200 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet afc1cd6e88764445b0a1fdc92e0c53e5 (table default.Table_078cedcd7539492394b2472609504297 [id=df29f1da8f2e40a49c55d44c0a0e11f2]) successfully deleted
I20260925 01:49:46.579344 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet a9e1f114c2a749d4af6a366c044f5ea5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:46.580286 11672 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.193:42829 (request call id 42) took 804 ms (client timeout 1000 ms). Trace:
W20260925 01:49:46.580693 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 176e572f77e242d799c334820579268d has no consensus state
W20260925 01:49:46.580749 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8d4e94cdafd343ee8a84c64668fe48fe because the tablet was not found. No further retry: Not found: Tablet not found: 8d4e94cdafd343ee8a84c64668fe48fe
W20260925 01:49:46.580823 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 already in progress: creating tablet
I20260925 01:49:46.581216 11755 tablet_bootstrap.cc:492] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
W20260925 01:49:46.581439 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b9937c3776f549dea887ace26dae492c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9937c3776f549dea887ace26dae492c already in progress: creating tablet
W20260925 01:49:46.580502 11672 rpcz_store.cc:269] 0925 01:49:45.775865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:45.793862 (+ 17997us) service_pool.cc:224] Handling call
0925 01:49:45.818772 (+ 24910us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00007f46ca49765d 00007f46ca497753 00007f46c7014db1 00007f46cee03acd 00007f46cef8d738 00007f46c59611f6 00007f46c5960f25 00007f46c206763e 00007f46c206651e 00007f46c206c758 00007f46c206d0bf
0925 01:49:46.580184 (+761412us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:46.230531 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:49:46.230649 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:49:46.230654 (+ 5us) write_op.cc:435] Acquired schema lock
0925 01:49:46.230657 (+ 3us) tablet.cc:662] Decoding operations
0925 01:49:46.230744 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:49:46.230752 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0925 01:49:46.230756 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0925 01:49:46.230807 (+ 51us) tablet.cc:701] Row locks acquired
0925 01:49:46.230809 (+ 2us) write_op.cc:260] PREPARE: finished
0925 01:49:46.230842 (+ 33us) write_op.cc:270] Start()
0925 01:49:46.230868 (+ 26us) write_op.cc:276] Timestamp: P: 1790300986230800 usec, L: 0
0925 01:49:46.230872 (+ 4us) op_driver.cc:348] REPLICATION: starting
0925 01:49:46.231041 (+ 169us) log.cc:844] Serialized 536 byte log entry
0925 01:49:46.257744 (+ 26703us) op_driver.cc:464] REPLICATION: finished
0925 01:49:46.259108 (+ 1364us) write_op.cc:301] APPLY: starting
0925 01:49:46.259119 (+ 11us) tablet.cc:1394] starting BulkCheckPresence
0925 01:49:46.259151 (+ 32us) tablet.cc:1397] finished BulkCheckPresence
0925 01:49:46.259170 (+ 19us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:49:46.259231 (+ 61us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:49:46.259253 (+ 22us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 01:49:46.259260 (+ 7us) write_op.cc:312] APPLY: finished
0925 01:49:46.259309 (+ 49us) log.cc:844] Serialized 23 byte log entry
0925 01:49:46.259345 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:46.259356 (+ 11us) write_op.cc:454] Released schema lock
0925 01:49:46.259360 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0925 01:49:46.259414 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:46.259417 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3603,"reported_tablets":72,"spinlock_wait_cycles":17414528,"child_traces":[["op",{"apply.queue_time_us":1330,"apply.run_cpu_time_us":300,"apply.run_wall_time_us":300,"num_ops":1,"prepare.queue_time_us":7452,"prepare.run_cpu_time_us":599,"prepare.run_wall_time_us":599,"raft.queue_time_us":279,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":26857}]]}
W20260925 01:49:46.582115 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ad1cbf07e15440c7919a4bbcd937fb53 because the tablet was not found. No further retry: Not found: Tablet not found: ad1cbf07e15440c7919a4bbcd937fb53
W20260925 01:49:46.582687 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet afc1cd6e88764445b0a1fdc92e0c53e5 because the tablet was not found. No further retry: Not found: Tablet not found: afc1cd6e88764445b0a1fdc92e0c53e5
I20260925 01:49:46.582985 11755 ts_tablet_manager.cc:1403] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.004s
I20260925 01:49:46.583205 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_39b1b83f732c44ca93f0e5e37326d739" } new_table_name: "default.Table_dfa39c6eba50463f9580070cbfd7f2c9" modify_external_catalogs: true
I20260925 01:49:46.581904 11953 tablet_replica.cc:333] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:46.583703 11953 raft_consensus.cc:2243] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.584195 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.584560 11953 raft_consensus.cc:2272] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:46.584672 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3da92b7f256647f19faeed66b4012438 consensus state has no leader
W20260925 01:49:46.584908 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 491d790067644090aa4d25f4060cc2ec because the tablet was not found. No further retry: Not found: Tablet not found: 491d790067644090aa4d25f4060cc2ec
I20260925 01:49:46.585340 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_962d7117724d4e5aa1b45a6fab966667"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.586090 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_962d7117724d4e5aa1b45a6fab966667 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.586308 11953 ts_tablet_manager.cc:1916] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.587575 11755 raft_consensus.cc:359] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.589318 11755 raft_consensus.cc:385] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.590533 11755 raft_consensus.cc:740] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.589455 12029 tablet.cc:1751] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:46.592777 11754 tablet_bootstrap.cc:492] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:46.592967 11754 ts_tablet_manager.cc:1403] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.276s user 0.010s sys 0.015s
I20260925 01:49:46.593873 11851 raft_consensus.cc:493] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.594043 11851 raft_consensus.cc:515] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.594815 11851 leader_election.cc:290] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.593768 11754 raft_consensus.cc:359] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.595182 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad258cd4788477ea5f9e34ebcab95c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.595347 11754 raft_consensus.cc:385] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.595449 11754 raft_consensus.cc:740] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.595597 11377 raft_consensus.cc:2468] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.595727 11754 consensus_queue.cc:260] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.596160 11177 leader_election.cc:304] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.596674 11851 raft_consensus.cc:2804] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.596920 11851 raft_consensus.cc:493] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.597047 11851 raft_consensus.cc:3060] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.597427 11755 consensus_queue.cc:260] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.598380 11755 ts_tablet_manager.cc:1434] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260925 01:49:46.600159 11851 raft_consensus.cc:515] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.600854 11851 leader_election.cc:290] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.601262 11755 tablet_bootstrap.cc:492] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.601967 11780 raft_consensus.cc:493] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.602156 11780 raft_consensus.cc:515] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.602548 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad258cd4788477ea5f9e34ebcab95c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:46.602763 11377 raft_consensus.cc:3060] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.602865 11780 leader_election.cc:290] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.603396 11754 ts_tablet_manager.cc:1434] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:49:46.603771 11754 tablet_bootstrap.cc:492] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:46.604804 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:46.605422 11314 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:46.607473 12021 consensus_queue.cc:1048] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.097s
W20260925 01:49:46.607721 11456 consensus_peers.cc:597] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afc1cd6e88764445b0a1fdc92e0c53e5. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.609443 11377 raft_consensus.cc:2468] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.609949 11177 leader_election.cc:304] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.610270 11851 raft_consensus.cc:2804] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:46.610476 11851 raft_consensus.cc:697] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:46.611199 11851 consensus_queue.cc:237] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.611392 12019 consensus_queue.cc:1048] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.101s
I20260925 01:49:46.612735 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:49:46.613626 11755 tablet_bootstrap.cc:654] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.616405 11931 tablet_replica.cc:333] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:46.616657 11931 raft_consensus.cc:2243] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.616828 11931 raft_consensus.cc:2272] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.617043 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 1 got 0
I20260925 01:49:46.617491 11931 ts_tablet_manager.cc:1916] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.618191 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.621064 11678 catalog_manager.cc:5838] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:46.624846 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]). Expected version 1 got 0
I20260925 01:49:46.625578 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:46.626519 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:46.621996 11953 ts_tablet_manager.cc:1929] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.620209 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.627213 11953 log.cc:1199] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/6837562b484242e5bf2b4eb085de7ac4
I20260925 01:49:46.627825 11953 ts_tablet_manager.cc:1950] T 6837562b484242e5bf2b4eb085de7ac4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:46.628022 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad258cd4788477ea5f9e34ebcab95c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.629079 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 6837562b484242e5bf2b4eb085de7ac4 (table default.Table_8855b825d776480aaf4e160d16693e45 [id=f9b577b7907e4fae8cb2e498a2f59035]) successfully deleted
I20260925 01:49:46.629422 11780 consensus_queue.cc:1048] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.629884 11953 tablet_replica.cc:333] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:46.630486 11953 raft_consensus.cc:2243] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.630889 11886 consensus_queue.cc:1048] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.631307 11886 consensus_queue.cc:1048] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.632192 11953 raft_consensus.cc:2272] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:46.632321 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 97171.1us
I20260925 01:49:46.634919 11242 raft_consensus.cc:3060] T e4683df170284c228a08df5422e37d16 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.633245 11953 ts_tablet_manager.cc:1916] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.643635 11753 tablet_bootstrap.cc:492] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:46.643841 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195e3f8e93e40fe9dfd72710d319dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.645946 11522 raft_consensus.cc:2468] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.646981 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_62819e2601e6498796cbf6ba500c43de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.647126 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 018525730c4e4134ab3a0506f1a0a6fa
I20260925 01:49:46.646755 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195e3f8e93e40fe9dfd72710d319dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:46.647620 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62819e2601e6498796cbf6ba500c43de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.647691 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 018525730c4e4134ab3a0506f1a0a6fa deleted and replaced by tablet 347a144e18ab4f6e834551044a2ac4ae
I20260925 01:49:46.647825 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad258cd4788477ea5f9e34ebcab95c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:46.648056 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cd22b64ded2d47498fba4bcaf54bc00a" } new_table_name: "default.Table_a33362d5d6de41e985d86740d8af966c" modify_external_catalogs: true
I20260925 01:49:46.648342 11753 ts_tablet_manager.cc:1403] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.189s user 0.002s sys 0.002s
W20260925 01:49:46.649439 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet efaaf48f816640e4a36627275d3ce8c9 has no consensus state
I20260925 01:49:46.647720 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.649849 11897 raft_consensus.cc:493] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.649859 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 018525730c4e4134ab3a0506f1a0a6fa with delete_type TABLET_DATA_DELETED (replaced by tablet 347a144e18ab4f6e834551044a2ac4ae) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.649838 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3134677312f34800bda02393eeaacbc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.649983 11897 raft_consensus.cc:515] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.650285 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e7623999b3c04ca69672a1e43fa6921f
I20260925 01:49:46.650992 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b00b413ef17343febe7fadd2f08ae596"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.651249 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet e7623999b3c04ca69672a1e43fa6921f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:46.651566 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b00b413ef17343febe7fadd2f08ae596 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.651757 11897 leader_election.cc:290] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.652695 11521 raft_consensus.cc:2468] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
W20260925 01:49:46.652799 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fa7a3941254478c800f9e366e3f7b06 consensus state has no leader
I20260925 01:49:46.653162 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cc61844c2cc541bfbb6e5083fb787c58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.653244 11523 raft_consensus.cc:3060] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:46.653626 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc61844c2cc541bfbb6e5083fb787c58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.653592 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet e7623999b3c04ca69672a1e43fa6921f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.654203 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet 018525730c4e4134ab3a0506f1a0a6fa with delete_type TABLET_DATA_DELETED (replaced by tablet 347a144e18ab4f6e834551044a2ac4ae) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.655109 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:46.656546 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3134677312f34800bda02393eeaacbc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.661175 11755 tablet_bootstrap.cc:492] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.661394 11755 ts_tablet_manager.cc:1403] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.001s
W20260925 01:49:46.662024 11314 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:46.662246 11314 leader_election.cc:304] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:46.662304 11755 raft_consensus.cc:359] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.662518 11755 raft_consensus.cc:385] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.662596 11755 raft_consensus.cc:740] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.662838 11755 consensus_queue.cc:260] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.663478 11965 raft_consensus.cc:493] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.663625 11965 raft_consensus.cc:515] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.663869 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195e3f8e93e40fe9dfd72710d319dca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.664425 11965 leader_election.cc:290] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.665011 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86079f22abb74d438c61ecc2a7379cbd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.665205 11375 raft_consensus.cc:2468] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.665624 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet 018525730c4e4134ab3a0506f1a0a6fa with delete_type TABLET_DATA_DELETED (replaced by tablet 347a144e18ab4f6e834551044a2ac4ae) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.665673 11177 leader_election.cc:304] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.666131 11965 raft_consensus.cc:2804] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.666246 11965 raft_consensus.cc:493] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.666334 11965 raft_consensus.cc:3060] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.669250 11965 raft_consensus.cc:515] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.670535 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86079f22abb74d438c61ecc2a7379cbd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:46.670732 11375 raft_consensus.cc:3060] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.672195 12022 raft_consensus.cc:493] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.672359 12022 raft_consensus.cc:515] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.673059 12022 leader_election.cc:290] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.674173 11375 raft_consensus.cc:2468] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:49:46.674194 11456 consensus_peers.cc:597] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 491d790067644090aa4d25f4060cc2ec. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.674798 11177 leader_election.cc:304] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.675084 11772 raft_consensus.cc:2804] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:46.675248 11772 raft_consensus.cc:697] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:46.675540 11772 consensus_queue.cc:237] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:46.675621 11457 consensus_peers.cc:597] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c96165d1a85d4ee99748563078ae2a3e. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:46.676596 11456 consensus_peers.cc:597] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b65068a447744ec99e56489963b251c. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.678560 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195e3f8e93e40fe9dfd72710d319dca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.678609 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.678853 11241 raft_consensus.cc:2393] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:46.677874 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86079f22abb74d438c61ecc2a7379cbd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:46.679402 11965 leader_election.cc:290] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:46.679500 12022 consensus_queue.cc:1048] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260925 01:49:46.680248 11457 consensus_peers.cc:597] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afc1cd6e88764445b0a1fdc92e0c53e5. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.680924 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet e7623999b3c04ca69672a1e43fa6921f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.683485 11780 raft_consensus.cc:2749] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:46.685964 11755 ts_tablet_manager.cc:1434] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.024s user 0.003s sys 0.000s
I20260925 01:49:46.689903 11755 tablet_bootstrap.cc:492] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.690860 11953 ts_tablet_manager.cc:1929] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.691052 11953 log.cc:1199] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/f07f754fa5b748a1a25d43e6011c5460
I20260925 01:49:46.691481 11953 ts_tablet_manager.cc:1950] T f07f754fa5b748a1a25d43e6011c5460 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:46.692027 11755 tablet_bootstrap.cc:654] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.692572 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet f07f754fa5b748a1a25d43e6011c5460 (table default.Table_ca31e318b1904d1cb03064d0a3d43cf2 [id=0d47af1c08a54db49e9535d5bafc23e9]) successfully deleted
I20260925 01:49:46.692755 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.693095 11953 tablet_replica.cc:333] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:46.693360 11953 raft_consensus.cc:2243] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.693602 11953 raft_consensus.cc:2272] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.694348 11953 ts_tablet_manager.cc:1916] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:46.699997 11177 consensus_peers.cc:597] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.711071 11886 raft_consensus.cc:493] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.711333 11886 raft_consensus.cc:515] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.712291 11886 leader_election.cc:290] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.714838 11953 ts_tablet_manager.cc:1929] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.716063 11953 log.cc:1199] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a26b7ec7373d42668f40c7c89084be47
I20260925 01:49:46.716542 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d208d580a2c4c27bd614ccc88088384" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.716720 11953 ts_tablet_manager.cc:1950] T a26b7ec7373d42668f40c7c89084be47 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:49:46.717427 11314 leader_election.cc:343] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:46.719875 11754 tablet_bootstrap.cc:654] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:46.721676 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2b9df8d98e5414186ef23b8b7f9cb61 has no consensus state
I20260925 01:49:46.722167 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6485a2bca5c748b2b999b93e8f115290"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.722916 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6485a2bca5c748b2b999b93e8f115290 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.726850 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_553188612c2849459f15c537d8a3e1fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.727484 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_553188612c2849459f15c537d8a3e1fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.732486 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a26b7ec7373d42668f40c7c89084be47 (table default.Table_4ed532a0734c4f35949fe170b6a3d36c [id=0974d15f11e64c96987f3a0a03dd2561]) successfully deleted
I20260925 01:49:46.734043 11755 tablet_bootstrap.cc:492] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.734261 11755 ts_tablet_manager.cc:1403] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.009s
I20260925 01:49:46.735091 11755 raft_consensus.cc:359] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.735293 11755 raft_consensus.cc:385] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.735386 11755 raft_consensus.cc:740] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.735733 11755 consensus_queue.cc:260] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.737867 11953 tablet_replica.cc:333] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:46.738135 11953 raft_consensus.cc:2243] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.738334 11953 raft_consensus.cc:2272] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.738925 11953 ts_tablet_manager.cc:1916] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.739235 11755 ts_tablet_manager.cc:1434] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:49:46.740479 11755 tablet_bootstrap.cc:492] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.742400 11755 tablet_bootstrap.cc:654] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.744455 11931 ts_tablet_manager.cc:1929] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.744589 11931 log.cc:1199] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ae497a92e49746a79cbbfe3c82b2b544
I20260925 01:49:46.744899 11931 ts_tablet_manager.cc:1950] T ae497a92e49746a79cbbfe3c82b2b544 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:46.749847 11754 tablet_bootstrap.cc:492] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:46.752458 11754 ts_tablet_manager.cc:1403] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.149s user 0.002s sys 0.003s
I20260925 01:49:46.753471 11754 raft_consensus.cc:359] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.753719 11754 raft_consensus.cc:385] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.753844 11754 raft_consensus.cc:740] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.754369 11754 consensus_queue.cc:260] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.754609 11521 raft_consensus.cc:2468] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:46.755029 12019 consensus_queue.cc:1048] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260925 01:49:46.755369 11754 ts_tablet_manager.cc:1434] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:46.755888 11754 tablet_bootstrap.cc:492] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:46.756731 11897 raft_consensus.cc:493] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:46.758585 11456 leader_election.cc:343] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:46.758765 12021 raft_consensus.cc:493] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.759644 11897 raft_consensus.cc:515] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.760062 11755 tablet_bootstrap.cc:492] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.760236 11755 ts_tablet_manager.cc:1403] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.003s
I20260925 01:49:46.760288 11897 leader_election.cc:290] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:46.761089 11754 tablet_bootstrap.cc:654] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.760986 11755 raft_consensus.cc:359] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.761215 11755 raft_consensus.cc:385] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.761287 11755 raft_consensus.cc:740] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.761582 11755 consensus_queue.cc:260] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.762310 11931 tablet_replica.cc:333] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:46.762526 11931 raft_consensus.cc:2243] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.762639 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ae497a92e49746a79cbbfe3c82b2b544 (table default.Table_11e017cb9d974161828f12b912b86015 [id=c1fc61615cb94ec0a11a62d39662937b]) successfully deleted
I20260925 01:49:46.762694 11931 raft_consensus.cc:2272] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.763216 11931 ts_tablet_manager.cc:1916] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.763150 12022 consensus_queue.cc:1048] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260925 01:49:46.766741 11755 ts_tablet_manager.cc:1434] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 01:49:46.774196 11755 tablet_bootstrap.cc:492] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.775877 11755 tablet_bootstrap.cc:654] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.776424 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.777197 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.778692 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bc79315e26e64754b7ae9ce08ba0a88d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:46.779263 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc79315e26e64754b7ae9ce08ba0a88d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.779943 11953 ts_tablet_manager.cc:1929] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.780082 11953 log.cc:1199] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/95dfbc1ce9db4f01bf6ec8965b62c994
I20260925 01:49:46.780448 11953 ts_tablet_manager.cc:1950] T 95dfbc1ce9db4f01bf6ec8965b62c994 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:46.781070 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_196b02edd23b4384aef87a7819365849" } modify_external_catalogs: true
I20260925 01:49:46.781284 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_196b02edd23b4384aef87a7819365849" } modify_external_catalogs: true
I20260925 01:49:46.781571 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 95dfbc1ce9db4f01bf6ec8965b62c994 (table default.Table_7cc3b8c6b31b42e4813477df8a30a4a2 [id=1250f31018b04ced9587bb443f4091ea]) successfully deleted
I20260925 01:49:46.782012 11953 tablet_replica.cc:333] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:46.782289 11953 raft_consensus.cc:2243] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:46.783463 11754 tablet_bootstrap.cc:492] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:46.783650 11754 ts_tablet_manager.cc:1403] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.002s
I20260925 01:49:46.784515 11754 raft_consensus.cc:359] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.784804 11754 raft_consensus.cc:385] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.784884 11754 raft_consensus.cc:740] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.785281 11754 consensus_queue.cc:260] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.786948 11754 ts_tablet_manager.cc:1434] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260925 01:49:46.787290 11754 tablet_bootstrap.cc:492] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:46.800393 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]). Expected version 1 got 0
I20260925 01:49:46.800688 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_12863b20d1544e0f9c998bc0d9c032a4 [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 1 got 0
I20260925 01:49:46.800735 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86079f22abb74d438c61ecc2a7379cbd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:46.800943 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 5ef1b5f18d074016a6dea82da8e2d2b2 (table default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7]). Expected version 5 got 0
I20260925 01:49:46.801205 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 200caea41ba4466386b091875f017956 (table default.Table_434ed55eea774802bad516c94af8ac39 [id=9389812769844f279c1e0c5fa9707dc0]). Expected version 1 got 0
I20260925 01:49:46.801391 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]). Expected version 2 got 0
I20260925 01:49:46.801575 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:46.802286 11851 consensus_queue.cc:1048] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:49:46.802547 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 53232.3us
I20260925 01:49:46.803433 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 (DEFAULT_TABLE table=default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b [id=4598ed1a6ec844ec8c3930fb1d54cf01]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:46.803789 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 79537.8us
I20260925 01:49:46.803900 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.804054 11456 leader_election.cc:304] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:46.805493 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c40e2db5e2434192a359f50c02fe13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.805697 11239 raft_consensus.cc:2468] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:46.806440 11357 tablet_service.cc:1511] Processing CreateTablet for tablet f6e9bc6f6c7346bfadbd79b8d494641e (DEFAULT_TABLE table=default.Table_455458464d54496892b32698053029f7 [id=f0acdfabaee64c329976f1cf227f0668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.806883 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e9bc6f6c7346bfadbd79b8d494641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.801836 11676 catalog_manager.cc:5838] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:46.807730 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:46.809909 11946 ts_tablet_manager.cc:1929] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:46.810105 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]). Expected version 1 got 0
W20260925 01:49:46.811117 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ad258cd4788477ea5f9e34ebcab95c7 consensus state has no leader
I20260925 01:49:46.811024 11753 raft_consensus.cc:359] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.811254 11753 raft_consensus.cc:385] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.811504 12022 raft_consensus.cc:3060] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.811609 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.812207 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet da74fa4b6fa841b7aebb81302cab2885 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.812672 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 (DEFAULT_TABLE table=default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b [id=4598ed1a6ec844ec8c3930fb1d54cf01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.812804 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1ffecf54f1b3464eae523b831ac20bc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:46.812933 11208 tablet_service.cc:1511] Processing CreateTablet for tablet f6e9bc6f6c7346bfadbd79b8d494641e (DEFAULT_TABLE table=default.Table_455458464d54496892b32698053029f7 [id=f0acdfabaee64c329976f1cf227f0668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.812963 11222 tablet_service.cc:1511] Processing CreateTablet for tablet b98ad0f02eb74eba897040401a164f5c (DEFAULT_TABLE table=default.Table_d435f3e4da774c15a1f5f56480c2d888 [id=ded734199b0246ab9f10a405170b0091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.813210 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.813442 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98ad0f02eb74eba897040401a164f5c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:46.813454 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ffecf54f1b3464eae523b831ac20bc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:46.814644 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e9bc6f6c7346bfadbd79b8d494641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.819427 11934 raft_consensus.cc:493] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.819630 11934 raft_consensus.cc:515] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.820120 11348 tablet_service.cc:1511] Processing CreateTablet for tablet b98ad0f02eb74eba897040401a164f5c (DEFAULT_TABLE table=default.Table_d435f3e4da774c15a1f5f56480c2d888 [id=ded734199b0246ab9f10a405170b0091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.820384 11934 leader_election.cc:290] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.821105 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8d208d580a2c4c27bd614ccc88088384
I20260925 01:49:46.821400 11753 raft_consensus.cc:740] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.821723 11753 consensus_queue.cc:260] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.821888 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 200caea41ba4466386b091875f017956 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.821946 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d208d580a2c4c27bd614ccc88088384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:46.822384 11753 ts_tablet_manager.cc:1434] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.174s user 0.001s sys 0.001s
I20260925 01:49:46.822742 11753 tablet_bootstrap.cc:492] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:46.822989 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 644b28192e3b45e7b5370d55804cb043 (DEFAULT_TABLE table=default.Table_58fdde0b3e6a47b79d42646ec2ed37ef [id=70a49de4b7e04789bb0a1afaf2df1900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.824597 11753 tablet_bootstrap.cc:654] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:46.824815 11176 consensus_peers.cc:597] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a26b7ec7373d42668f40c7c89084be47. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.824788 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 176e572f77e242d799c334820579268d (DEFAULT_TABLE table=default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.825943 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ad8ca37e3c49a4a03fc3460bf0bc5b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.826355 11239 raft_consensus.cc:2468] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:46.826537 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d208d580a2c4c27bd614ccc88088384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:46.826772 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 176e572f77e242d799c334820579268d (DEFAULT_TABLE table=default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.826910 11314 leader_election.cc:304] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.827189 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176e572f77e242d799c334820579268d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.827234 11934 raft_consensus.cc:2804] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.827342 11934 raft_consensus.cc:493] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.827430 11934 raft_consensus.cc:3060] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.828217 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c6503d38584945e3a845e2f96ab5a4fc" } modify_external_catalogs: true
I20260925 01:49:46.828290 11350 tablet_service.cc:1511] Processing CreateTablet for tablet ca17585cd523440ca1e9b754f3aedf8a (DEFAULT_TABLE table=default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.828413 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c6503d38584945e3a845e2f96ab5a4fc" } modify_external_catalogs: true
I20260925 01:49:46.829348 11214 tablet_service.cc:1511] Processing CreateTablet for tablet ca17585cd523440ca1e9b754f3aedf8a (DEFAULT_TABLE table=default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.829746 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca17585cd523440ca1e9b754f3aedf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.831244 11934 raft_consensus.cc:515] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.832715 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ad8ca37e3c49a4a03fc3460bf0bc5b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:46.832942 11239 raft_consensus.cc:3060] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.834352 11934 leader_election.cc:290] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.835371 11754 tablet_bootstrap.cc:654] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.835372 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 38082c23d99148bb916b0ae74fd474b8 (DEFAULT_TABLE table=default.Table_c6503d38584945e3a845e2f96ab5a4fc [id=093f5fa0a0d340b381d7794eede8d93a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.835855 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38082c23d99148bb916b0ae74fd474b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.836719 11239 raft_consensus.cc:2468] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:46.837204 11314 leader_election.cc:304] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.825299 12021 raft_consensus.cc:515] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.838148 11953 pending_rounds.cc:70] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:46.838224 11953 pending_rounds.cc:77] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072837618302976 op_type: NO_OP noop_request { }
I20260925 01:49:46.838446 11953 raft_consensus.cc:2889] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:46.838851 11953 raft_consensus.cc:2272] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:46.841005 11931 ts_tablet_manager.cc:1929] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:46.841326 11755 tablet_bootstrap.cc:492] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:46.841504 11755 ts_tablet_manager.cc:1403] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.070s user 0.006s sys 0.006s
I20260925 01:49:46.841965 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98ad0f02eb74eba897040401a164f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.842427 11755 raft_consensus.cc:359] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.842610 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176e572f77e242d799c334820579268d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.843066 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca17585cd523440ca1e9b754f3aedf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.843178 11946 log.cc:1199] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/06b59e1505e246d2abada79299e09bfe
I20260925 01:49:46.843504 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644b28192e3b45e7b5370d55804cb043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.844759 11931 log.cc:1199] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/95dfbc1ce9db4f01bf6ec8965b62c994
I20260925 01:49:46.842628 11755 raft_consensus.cc:385] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.845075 11755 raft_consensus.cc:740] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.845348 11755 consensus_queue.cc:260] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.845865 11755 ts_tablet_manager.cc:1434] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:49:46.846855 11456 leader_election.cc:304] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:46.848991 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 644b28192e3b45e7b5370d55804cb043 (DEFAULT_TABLE table=default.Table_58fdde0b3e6a47b79d42646ec2ed37ef [id=70a49de4b7e04789bb0a1afaf2df1900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.849427 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644b28192e3b45e7b5370d55804cb043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.850929 11755 tablet_bootstrap.cc:492] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:46.852813 11755 tablet_bootstrap.cc:654] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:46.854249 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d208d580a2c4c27bd614ccc88088384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:46.855338 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 176e572f77e242d799c334820579268d (DEFAULT_TABLE table=default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.855719 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176e572f77e242d799c334820579268d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.858386 11484 tablet_service.cc:1511] Processing CreateTablet for tablet ca17585cd523440ca1e9b754f3aedf8a (DEFAULT_TABLE table=default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.858747 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca17585cd523440ca1e9b754f3aedf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.860996 11780 raft_consensus.cc:2804] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:49:46.862270 11456 consensus_peers.cc:597] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d4e94cdafd343ee8a84c64668fe48fe. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:46.863165 11521 raft_consensus.cc:3060] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.865947 11521 raft_consensus.cc:2468] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.866942 11498 tablet_service.cc:1511] Processing CreateTablet for tablet f6e9bc6f6c7346bfadbd79b8d494641e (DEFAULT_TABLE table=default.Table_455458464d54496892b32698053029f7 [id=f0acdfabaee64c329976f1cf227f0668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.867372 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6e9bc6f6c7346bfadbd79b8d494641e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.870383 11895 raft_consensus.cc:2804] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:46.870508 11895 raft_consensus.cc:493] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:46.870633 11895 raft_consensus.cc:3060] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:46.877130 11772 consensus_queue.cc:1048] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260925 01:49:46.879573 11485 tablet_service.cc:1511] Processing CreateTablet for tablet b98ad0f02eb74eba897040401a164f5c (DEFAULT_TABLE table=default.Table_d435f3e4da774c15a1f5f56480c2d888 [id=ded734199b0246ab9f10a405170b0091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.880043 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b98ad0f02eb74eba897040401a164f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.883064 11780 raft_consensus.cc:697] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:46.883114 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 (DEFAULT_TABLE table=default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b [id=4598ed1a6ec844ec8c3930fb1d54cf01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.883492 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.886231 11931 ts_tablet_manager.cc:1950] T 95dfbc1ce9db4f01bf6ec8965b62c994 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:46.886953 11341 tablet_service.cc:1511] Processing CreateTablet for tablet efaaf48f816640e4a36627275d3ce8c9 (DEFAULT_TABLE table=default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.887390 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efaaf48f816640e4a36627275d3ce8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.889488 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 644b28192e3b45e7b5370d55804cb043 (DEFAULT_TABLE table=default.Table_58fdde0b3e6a47b79d42646ec2ed37ef [id=70a49de4b7e04789bb0a1afaf2df1900]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.889546 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:46.889674 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 2feaab143fae4312915579fdb2ff1e40 (DEFAULT_TABLE table=default.Table_ec3787167585495b80752bc3468751b8 [id=9efec48de98e40be93706911d8bdae7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.889914 11360 tablet_service.cc:1511] Processing CreateTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 (DEFAULT_TABLE table=default.Table_a33362d5d6de41e985d86740d8af966c [id=351fd2bbafea4565a9cc4537f7f0c1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.890575 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 644b28192e3b45e7b5370d55804cb043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.891961 11931 tablet_replica.cc:333] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:46.893364 11931 raft_consensus.cc:2243] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:46.893633 11931 raft_consensus.cc:2272] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:46.896374 11456 leader_election.cc:343] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:46.896998 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 (DEFAULT_TABLE table=default.Table_196b02edd23b4384aef87a7819365849 [id=2a64ecd7c8aa4c058cf50c57d0373c3c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:46.897465 11457 leader_election.cc:343] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:46.897585 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (DEFAULT_TABLE table=default.Table_3f397bb38f82466883e8e43a81afcf4a [id=590734454eea4965a095ef821bc27366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.895699 11780 consensus_queue.cc:237] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.899324 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 38082c23d99148bb916b0ae74fd474b8 (DEFAULT_TABLE table=default.Table_c6503d38584945e3a845e2f96ab5a4fc [id=093f5fa0a0d340b381d7794eede8d93a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.900496 11754 tablet_bootstrap.cc:492] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:46.903152 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (DEFAULT_TABLE table=default.Table_3f397bb38f82466883e8e43a81afcf4a [id=590734454eea4965a095ef821bc27366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.903609 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.905406 11217 tablet_service.cc:1511] Processing CreateTablet for tablet efaaf48f816640e4a36627275d3ce8c9 (DEFAULT_TABLE table=default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.906298 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b9df8d98e5414186ef23b8b7f9cb61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.902945 11218 tablet_service.cc:1511] Processing CreateTablet for tablet e95fb28febd94a26ba9682fb9a462872 (DEFAULT_TABLE table=default.Table_8e91b8fa674944b5a4cf4095fc5d57b6 [id=50af6373aee0495788c89142a4d5c9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.906725 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efaaf48f816640e4a36627275d3ce8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.908172 11931 ts_tablet_manager.cc:1916] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:46.909029 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e95fb28febd94a26ba9682fb9a462872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.909230 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 2feaab143fae4312915579fdb2ff1e40 (DEFAULT_TABLE table=default.Table_ec3787167585495b80752bc3468751b8 [id=9efec48de98e40be93706911d8bdae7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.909703 11754 ts_tablet_manager.cc:1403] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.119s user 0.000s sys 0.004s
I20260925 01:49:46.910143 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2feaab143fae4312915579fdb2ff1e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.911602 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 95dfbc1ce9db4f01bf6ec8965b62c994 (table default.Table_7cc3b8c6b31b42e4813477df8a30a4a2 [id=1250f31018b04ced9587bb443f4091ea]) successfully deleted
I20260925 01:49:46.912381 11344 tablet_service.cc:1511] Processing CreateTablet for tablet e95fb28febd94a26ba9682fb9a462872 (DEFAULT_TABLE table=default.Table_8e91b8fa674944b5a4cf4095fc5d57b6 [id=50af6373aee0495788c89142a4d5c9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.915232 11204 tablet_service.cc:1511] Processing CreateTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 (DEFAULT_TABLE table=default.Table_a33362d5d6de41e985d86740d8af966c [id=351fd2bbafea4565a9cc4537f7f0c1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.917620 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596f8ddbcd16458aa4f287f4f11282a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.917852 11457 leader_election.cc:304] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:46.918654 12021 leader_election.cc:290] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:46.920346 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 02f9e96bcdf9418ea54dc73bf68a2be6 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:46.921290 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b9df8d98e5414186ef23b8b7f9cb61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.924232 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ca31e318b1904d1cb03064d0a3d43cf2" } new_table_name: "default.Table_829039e8b63d479fa41bd9317e0e96fd" modify_external_catalogs: true
I20260925 01:49:46.928685 11754 raft_consensus.cc:359] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.928939 11754 raft_consensus.cc:385] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:46.928138 11772 consensus_queue.cc:1048] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260925 01:49:46.931422 11754 raft_consensus.cc:740] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:46.933720 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38082c23d99148bb916b0ae74fd474b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.943912 11886 consensus_queue.cc:1048] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:46.944418 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 (DEFAULT_TABLE table=default.Table_196b02edd23b4384aef87a7819365849 [id=2a64ecd7c8aa4c058cf50c57d0373c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:46.945443 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2feaab143fae4312915579fdb2ff1e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.945571 11754 consensus_queue.cc:260] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.946768 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596f8ddbcd16458aa4f287f4f11282a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.952536 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e95fb28febd94a26ba9682fb9a462872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.955745 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:46.964653 11895 raft_consensus.cc:515] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:46.965955 11772 consensus_queue.cc:1048] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260925 01:49:46.969481 12022 raft_consensus.cc:2749] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:46.973740 11934 raft_consensus.cc:493] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.974131 11934 raft_consensus.cc:515] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.977699 11934 leader_election.cc:290] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:46.978408 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 115449us
I20260925 01:49:46.982563 12022 raft_consensus.cc:2749] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:46.984719 11946 ts_tablet_manager.cc:1950] T 06b59e1505e246d2abada79299e09bfe P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:46.986261 11946 tablet_replica.cc:333] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:46.988200 11897 raft_consensus.cc:493] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.988446 11897 raft_consensus.cc:515] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:46.989404 11897 leader_election.cc:290] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:46.989616 11895 leader_election.cc:290] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:46.994014 11523 raft_consensus.cc:2468] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:46.979475 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c40e2db5e2434192a359f50c02fe13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:46.999945 12022 raft_consensus.cc:493] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:46.981635 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c40e2db5e2434192a359f50c02fe13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:46.981937 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.000149 12022 raft_consensus.cc:515] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.000878 12022 leader_election.cc:290] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.012620 11953 ts_tablet_manager.cc:1916] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.013360 11754 ts_tablet_manager.cc:1434] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.058s user 0.001s sys 0.002s
I20260925 01:49:47.015251 11772 raft_consensus.cc:493] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.017223 11772 raft_consensus.cc:515] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.017961 11772 leader_election.cc:290] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.018708 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.020275 11380 raft_consensus.cc:2468] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:47.020774 11177 leader_election.cc:304] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:47.025899 11754 tablet_bootstrap.cc:492] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:49:47.027545 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 120581us
I20260925 01:49:47.025489 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.040163 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 38082c23d99148bb916b0ae74fd474b8 (DEFAULT_TABLE table=default.Table_c6503d38584945e3a845e2f96ab5a4fc [id=093f5fa0a0d340b381d7794eede8d93a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.043068 11755 tablet_bootstrap.cc:492] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:47.043265 11755 ts_tablet_manager.cc:1403] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.192s user 0.015s sys 0.009s
I20260925 01:49:47.048599 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38082c23d99148bb916b0ae74fd474b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.049068 11754 tablet_bootstrap.cc:654] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.049499 11502 tablet_service.cc:1511] Processing CreateTablet for tablet e95fb28febd94a26ba9682fb9a462872 (DEFAULT_TABLE table=default.Table_8e91b8fa674944b5a4cf4095fc5d57b6 [id=50af6373aee0495788c89142a4d5c9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.050009 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (DEFAULT_TABLE table=default.Table_3f397bb38f82466883e8e43a81afcf4a [id=590734454eea4965a095ef821bc27366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.050443 11946 raft_consensus.cc:2243] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:47.058627 11239 raft_consensus.cc:2468] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:47.062449 11314 leader_election.cc:304] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:47.064080 11772 raft_consensus.cc:2804] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:47.067559 11934 raft_consensus.cc:2804] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:47.067821 11934 raft_consensus.cc:493] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:47.067994 11934 raft_consensus.cc:3060] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.072050 11934 raft_consensus.cc:515] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.078750 11772 raft_consensus.cc:493] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:47.084434 11772 raft_consensus.cc:3060] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.084756 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3134677312f34800bda02393eeaacbc1" } modify_external_catalogs: true
I20260925 01:49:47.085044 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3134677312f34800bda02393eeaacbc1" } modify_external_catalogs: true
I20260925 01:49:47.100124 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 596f8ddbcd16458aa4f287f4f11282a1
I20260925 01:49:47.105355 11772 raft_consensus.cc:515] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.107288 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c42a2d0957624d578f66a1c0268d2ef2" } new_table_name: "default.Table_8a3eca1199d84ef283c1a1578f44c935" modify_external_catalogs: true
I20260925 01:49:47.108333 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.112864 12070 tablet.cc:1751] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:47.120091 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:47.120515 11375 raft_consensus.cc:2393] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b93565e796c94a3699eb1824383bbaeb in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:47.121435 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.044337 11755 raft_consensus.cc:359] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.082266 12028 tablet.cc:1751] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:47.122702 11755 raft_consensus.cc:385] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.122857 11755 raft_consensus.cc:740] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.123231 11755 consensus_queue.cc:260] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.124200 11755 ts_tablet_manager.cc:1434] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.081s user 0.001s sys 0.001s
I20260925 01:49:47.124650 11755 tablet_bootstrap.cc:492] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:47.129468 11772 leader_election.cc:290] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.135237 11934 leader_election.cc:290] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.138883 11946 raft_consensus.cc:2272] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.139523 11503 tablet_service.cc:1511] Processing CreateTablet for tablet efaaf48f816640e4a36627275d3ce8c9 (DEFAULT_TABLE table=default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.141615 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e95fb28febd94a26ba9682fb9a462872. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.144606 11484 tablet_service.cc:1511] Processing CreateTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 (DEFAULT_TABLE table=default.Table_a33362d5d6de41e985d86740d8af966c [id=351fd2bbafea4565a9cc4537f7f0c1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.145972 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_34d61a42397f4e9ca0d0364c26827c95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.146639 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 2feaab143fae4312915579fdb2ff1e40 (DEFAULT_TABLE table=default.Table_ec3787167585495b80752bc3468751b8 [id=9efec48de98e40be93706911d8bdae7b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:47.146735 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34d61a42397f4e9ca0d0364c26827c95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.147630 11755 tablet_bootstrap.cc:654] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.147647 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:47.148370 11176 leader_election.cc:343] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.150337 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efaaf48f816640e4a36627275d3ce8c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.151232 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d208d580a2c4c27bd614ccc88088384" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.152251 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.148541 11176 leader_election.cc:304] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:47.153617 11946 ts_tablet_manager.cc:1916] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:47.153661 11176 leader_election.cc:343] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.154024 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2feaab143fae4312915579fdb2ff1e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.157699 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ad8ca37e3c49a4a03fc3460bf0bc5b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.157949 11522 raft_consensus.cc:2468] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:47.158325 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 38082c23d99148bb916b0ae74fd474b8
I20260925 01:49:47.159225 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f43d73b46d5e439aa7bc235e82b6d1a2" } new_table_name: "default.Table_20d10e4a47ae41e3b53b6eb8e1839997" modify_external_catalogs: true
I20260925 01:49:47.159399 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 38082c23d99148bb916b0ae74fd474b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.160409 11953 ts_tablet_manager.cc:1929] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.160573 11953 log.cc:1199] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:47.160880 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 38082c23d99148bb916b0ae74fd474b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.160996 11953 ts_tablet_manager.cc:1950] T f6058cd7c17b4544a565a5aacfb9df92 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:47.161298 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b9df8d98e5414186ef23b8b7f9cb61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.162343 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet f6058cd7c17b4544a565a5aacfb9df92 (table default.Table_2ba2a8cd4c204308b6bd353a094dafe4 [id=55b54d01f7634e9583dd4f3e1f1776fe]) successfully deleted
I20260925 01:49:47.164466 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 (DEFAULT_TABLE table=default.Table_196b02edd23b4384aef87a7819365849 [id=2a64ecd7c8aa4c058cf50c57d0373c3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.165547 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 596f8ddbcd16458aa4f287f4f11282a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.167142 11755 tablet_bootstrap.cc:492] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:47.167301 11755 ts_tablet_manager.cc:1403] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260925 01:49:47.167292 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 06b59e1505e246d2abada79299e09bfe (table default.Table_63b71c4cf1634d2aa8b517954ab683c8 [id=17b11380da7c42e0b51c4d6301d5789d]) successfully deleted
I20260925 01:49:47.167680 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.168318 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c40e2db5e2434192a359f50c02fe13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:47.168550 11241 raft_consensus.cc:3060] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.168668 11755 raft_consensus.cc:359] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.168844 11755 raft_consensus.cc:385] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.168926 11755 raft_consensus.cc:740] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.169214 11755 consensus_queue.cc:260] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.171751 11241 raft_consensus.cc:2468] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:47.172154 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ad8ca37e3c49a4a03fc3460bf0bc5b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.172549 11238 raft_consensus.cc:2393] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:47.172663 11755 ts_tablet_manager.cc:1434] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260925 01:49:47.172993 11755 tablet_bootstrap.cc:492] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:47.172559 11965 raft_consensus.cc:2749] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260925 01:49:47.176889 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa619556e5af473998080f4bbc9e5d1e consensus state has no leader
I20260925 01:49:47.177315 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_04f98162b64e4576960f91d0a60432cb" } modify_external_catalogs: true
I20260925 01:49:47.177567 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_04f98162b64e4576960f91d0a60432cb" } modify_external_catalogs: true
I20260925 01:49:47.180543 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:47.180886 11239 raft_consensus.cc:2393] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:47.182366 11953 tablet_replica.cc:333] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:47.182612 11953 raft_consensus.cc:2243] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:47.182852 11953 pending_rounds.cc:70] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
W20260925 01:49:47.183667 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67921f86c4f6422e97d7f306262569f8 consensus state has no leader
I20260925 01:49:47.183846 11953 pending_rounds.cc:77] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072837630271488 op_type: NO_OP noop_request { }
I20260925 01:49:47.184096 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2fe9e3d572a34772b63e49e00ceec625" } new_table_name: "default.Table_8b1c0d4e229f41dfa2c87392267a114d" modify_external_catalogs: true
I20260925 01:49:47.184288 11755 tablet_bootstrap.cc:654] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.189601 11931 ts_tablet_manager.cc:1929] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.189970 11931 log.cc:1199] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/9884d7af60324a24ad06d6fa5db358b2
I20260925 01:49:47.195196 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 200caea41ba4466386b091875f017956
I20260925 01:49:47.195914 11754 tablet_bootstrap.cc:492] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.196091 11675 catalog_manager.cc:6934] ReplaceTablet: tablet 200caea41ba4466386b091875f017956 deleted and replaced by tablet 17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:49:47.196101 11754 ts_tablet_manager.cc:1403] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.182s user 0.004s sys 0.002s
I20260925 01:49:47.197086 11754 raft_consensus.cc:359] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.197301 11754 raft_consensus.cc:385] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.197149 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_aac094552c1d4facaaacca78cda958e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.197368 11754 raft_consensus.cc:740] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.197609 11754 consensus_queue.cc:260] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:47.197817 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aac094552c1d4facaaacca78cda958e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.198418 11754 ts_tablet_manager.cc:1434] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:47.198717 11754 tablet_bootstrap.cc:492] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.199908 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_ae4548d7f5a946568a2f0c4515aa6107 [id=f14bcaf842ad44929f252de69d2c40a7] alter complete (version 5)
W20260925 01:49:47.200884 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0157a45817246cfaa0b016afdbd59cb consensus state has no leader
I20260925 01:49:47.200964 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 200caea41ba4466386b091875f017956 with delete_type TABLET_DATA_DELETED (replaced by tablet 17352fd6ea4e4ed9a178f1510edf4f6d) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.200620 11931 ts_tablet_manager.cc:1950] T 9884d7af60324a24ad06d6fa5db358b2 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:47.201319 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_24b699e047024e59a09f3a00feb33cef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.201884 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24b699e047024e59a09f3a00feb33cef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.202301 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5c3812c0f44d4787a440618e42b85b07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.202841 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c3812c0f44d4787a440618e42b85b07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.203984 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 200caea41ba4466386b091875f017956 with delete_type TABLET_DATA_DELETED (replaced by tablet 17352fd6ea4e4ed9a178f1510edf4f6d) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.204879 11953 raft_consensus.cc:2889] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:47.205137 11953 raft_consensus.cc:2272] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.206143 11953 ts_tablet_manager.cc:1916] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.206240 11753 tablet_bootstrap.cc:492] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:47.207159 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.207854 11754 tablet_bootstrap.cc:654] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.208838 11755 tablet_bootstrap.cc:492] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:47.209260 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.209522 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.210325 11755 ts_tablet_manager.cc:1403] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.004s
I20260925 01:49:47.210318 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 9884d7af60324a24ad06d6fa5db358b2 (table default.Table_fbdf63c5c7d641c58cb07c1933e7212d [id=65e9375237aa43ee950d4883b6028392]) successfully deleted
I20260925 01:49:47.210601 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ad8ca37e3c49a4a03fc3460bf0bc5b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:47.211114 11518 raft_consensus.cc:3060] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.211437 11931 tablet_replica.cc:333] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:47.212353 11931 raft_consensus.cc:2243] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:47.213987 11931 raft_consensus.cc:2272] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.217164 11772 raft_consensus.cc:493] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.217439 11772 raft_consensus.cc:515] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.218988 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.219249 11377 raft_consensus.cc:2468] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:47.219944 11177 leader_election.cc:304] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:47.220386 11851 raft_consensus.cc:2804] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:47.220518 11851 raft_consensus.cc:493] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:47.220724 11851 raft_consensus.cc:3060] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.220764 11755 raft_consensus.cc:359] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.221012 11755 raft_consensus.cc:385] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.221097 11755 raft_consensus.cc:740] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.221338 11755 consensus_queue.cc:260] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.218179 11772 leader_election.cc:290] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.217957 11931 ts_tablet_manager.cc:1916] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.226291 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:47.230137 11176 leader_election.cc:343] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:47.230283 11314 leader_election.cc:343] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.230540 11314 leader_election.cc:304] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:47.231303 11314 leader_election.cc:343] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.231920 11851 raft_consensus.cc:515] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.233139 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.233656 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:47.233963 11375 raft_consensus.cc:3060] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.234921 11851 leader_election.cc:290] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.235309 11518 raft_consensus.cc:2468] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:47.236860 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:47.235556 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9e1f114c2a749d4af6a366c044f5ea5" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:47.237739 11375 raft_consensus.cc:2468] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:49:47.238296 11457 consensus_peers.cc:597] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95dfbc1ce9db4f01bf6ec8965b62c994. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:47.238428 11176 leader_election.cc:343] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.238698 11177 leader_election.cc:304] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:47.239266 11753 ts_tablet_manager.cc:1403] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.384s user 0.010s sys 0.015s
I20260925 01:49:47.239275 11772 raft_consensus.cc:2804] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:47.239452 11772 raft_consensus.cc:697] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:47.240501 11851 consensus_queue.cc:1048] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260925 01:49:47.242813 11772 consensus_queue.cc:237] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.250273 11754 tablet_bootstrap.cc:492] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.255028 11754 ts_tablet_manager.cc:1403] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.005s
I20260925 01:49:47.256790 11934 raft_consensus.cc:2749] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.256762 11754 raft_consensus.cc:359] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.256983 11754 raft_consensus.cc:385] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.257084 11754 raft_consensus.cc:740] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.257299 12021 raft_consensus.cc:493] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.257304 11934 consensus_queue.cc:1048] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:47.263561 11931 ts_tablet_manager.cc:1929] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.263783 11931 log.cc:1199] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/105fd502b74d442eb5d5031f56e5cb62
I20260925 01:49:47.264366 11931 ts_tablet_manager.cc:1950] T 105fd502b74d442eb5d5031f56e5cb62 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:47.266202 11754 consensus_queue.cc:260] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.270902 11754 ts_tablet_manager.cc:1434] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260925 01:49:47.273350 12021 raft_consensus.cc:515] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:47.275141 11456 consensus_peers.cc:597] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95dfbc1ce9db4f01bf6ec8965b62c994. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:47.279917 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8bf42293dd5d452aa7ed9e0eaa78f54d consensus state has no leader
I20260925 01:49:47.281011 11755 ts_tablet_manager.cc:1434] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.067s user 0.001s sys 0.001s
I20260925 01:49:47.281692 12021 leader_election.cc:290] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.281644 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a51db57fcb214a8289f9ac66be21414f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.281929 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 49366.3us
W20260925 01:49:47.282330 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a51db57fcb214a8289f9ac66be21414f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.282636 11755 tablet_bootstrap.cc:492] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:47.284654 11457 consensus_peers.cc:597] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d4e94cdafd343ee8a84c64668fe48fe. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:47.285666 11456 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:47.286268 11456 consensus_peers.cc:597] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e008337914841b8a1ab4a64ecc6e181. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:47.286726 11755 tablet_bootstrap.cc:654] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.288336 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 (DEFAULT_TABLE table=default.Table_b00b413ef17343febe7fadd2f08ae596 [id=0cfde61c060841d8b99d75fa7557a258]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:47.288555 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 46680.1us
I20260925 01:49:47.288995 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7b3c65d8a64734b2c432790dae07e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.289636 11457 leader_election.cc:343] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.291368 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 (DEFAULT_TABLE table=default.Table_b00b413ef17343febe7fadd2f08ae596 [id=0cfde61c060841d8b99d75fa7557a258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.291954 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 (DEFAULT_TABLE table=default.Table_62819e2601e6498796cbf6ba500c43de [id=091267034b9049728ddece813abe0fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.292413 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7b3c65d8a64734b2c432790dae07e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.292531 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 347a144e18ab4f6e834551044a2ac4ae (DEFAULT_TABLE table=default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.292964 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347a144e18ab4f6e834551044a2ac4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.298346 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.298609 11753 raft_consensus.cc:359] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.293905 11456 leader_election.cc:304] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:47.300211 12069 raft_consensus.cc:2804] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:47.300400 12069 raft_consensus.cc:697] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:47.300768 12069 consensus_queue.cc:237] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.303532 11674 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27] alter complete (version 1)
I20260925 01:49:47.303633 11754 tablet_bootstrap.cc:492] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.304167 11753 raft_consensus.cc:385] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.304322 11753 raft_consensus.cc:740] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.305083 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 55e9d52e3f79408a99216250aefc45c8 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:47.305261 11753 consensus_queue.cc:260] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.305853 11753 ts_tablet_manager.cc:1434] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.066s user 0.002s sys 0.000s
I20260925 01:49:47.309259 11753 tablet_bootstrap.cc:492] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:47.312063 11753 tablet_bootstrap.cc:654] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.314965 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 19c718c83cfe49b9a745e06314e24409 (DEFAULT_TABLE table=default.Table_3134677312f34800bda02393eeaacbc1 [id=a1465ccb37624e9aa2abb95f1bbd1abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.315634 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c718c83cfe49b9a745e06314e24409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.315678 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet bfd9645cd6644a55997eb7745c7b29f2 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:47.318044 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 347a144e18ab4f6e834551044a2ac4ae (DEFAULT_TABLE table=default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.318573 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347a144e18ab4f6e834551044a2ac4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.320079 12081 raft_consensus.cc:493] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.320317 12081 raft_consensus.cc:515] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.321228 12081 leader_election.cc:290] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.321573 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c (DEFAULT_TABLE table=default.Table_962d7117724d4e5aa1b45a6fab966667 [id=768d79ef588e46be97ceffa64db19940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.322136 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.322441 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 19c718c83cfe49b9a745e06314e24409 (DEFAULT_TABLE table=default.Table_3134677312f34800bda02393eeaacbc1 [id=a1465ccb37624e9aa2abb95f1bbd1abd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:47.322557 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 90818.8us
I20260925 01:49:47.322906 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c718c83cfe49b9a745e06314e24409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.325103 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.326998 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c40e2db5e2434192a359f50c02fe13" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.327299 11242 raft_consensus.cc:2393] T 60c40e2db5e2434192a359f50c02fe13 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:49:47.329769 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c (DEFAULT_TABLE table=default.Table_962d7117724d4e5aa1b45a6fab966667 [id=768d79ef588e46be97ceffa64db19940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.331715 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.331893 11934 consensus_queue.cc:1048] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:47.333097 11341 tablet_service.cc:1511] Processing CreateTablet for tablet f1b6ea676a1f4d99807029d8401251ef (DEFAULT_TABLE table=default.Table_cc61844c2cc541bfbb6e5083fb787c58 [id=dba58bdd410a4b8986cf7e359a563628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.333251 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0ad8ca37e3c49a4a03fc3460bf0bc5b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.333705 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b6ea676a1f4d99807029d8401251ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.345535 11210 tablet_service.cc:1511] Processing CreateTablet for tablet f1b6ea676a1f4d99807029d8401251ef (DEFAULT_TABLE table=default.Table_cc61844c2cc541bfbb6e5083fb787c58 [id=dba58bdd410a4b8986cf7e359a563628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.346117 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b6ea676a1f4d99807029d8401251ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.318143 11457 leader_election.cc:343] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.319829 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 200caea41ba4466386b091875f017956 with delete_type TABLET_DATA_DELETED (replaced by tablet 17352fd6ea4e4ed9a178f1510edf4f6d) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.320312 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 38082c23d99148bb916b0ae74fd474b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.320770 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 (DEFAULT_TABLE table=default.Table_b00b413ef17343febe7fadd2f08ae596 [id=0cfde61c060841d8b99d75fa7557a258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.321444 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 (DEFAULT_TABLE table=default.Table_62819e2601e6498796cbf6ba500c43de [id=091267034b9049728ddece813abe0fed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:47.326236 11456 leader_election.cc:343] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.322548 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 347a144e18ab4f6e834551044a2ac4ae (DEFAULT_TABLE table=default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.336694 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 19c718c83cfe49b9a745e06314e24409 (DEFAULT_TABLE table=default.Table_3134677312f34800bda02393eeaacbc1 [id=a1465ccb37624e9aa2abb95f1bbd1abd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.376260 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cc61844c2cc541bfbb6e5083fb787c58" } new_table_name: "default.Table_0b653dec053f4999a9000498f3dfe715" modify_external_catalogs: true
I20260925 01:49:47.379874 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 105fd502b74d442eb5d5031f56e5cb62 (table default.Table_6ae7ffbe7b334c87a1be9c5c18761c65 [id=1c424cf98429473f9896b9c4028e11f6]) successfully deleted
I20260925 01:49:47.381086 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_de50999ba7d245feb33ce6cd4a90bc03" } modify_external_catalogs: true
I20260925 01:49:47.381294 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_de50999ba7d245feb33ce6cd4a90bc03" } modify_external_catalogs: true
I20260925 01:49:47.382251 11754 tablet_bootstrap.cc:654] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.382822 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c718c83cfe49b9a745e06314e24409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.382102 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 (DEFAULT_TABLE table=default.Table_62819e2601e6498796cbf6ba500c43de [id=091267034b9049728ddece813abe0fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.388499 11678 catalog_manager.cc:5838] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:47.390529 11678 catalog_manager.cc:5838] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
W20260925 01:49:47.388023 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 70189.2us
I20260925 01:49:47.392094 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_61ad0d49c2ce46bb9dae128a9ec6e57c [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 2 got 0
I20260925 01:49:47.392365 11678 catalog_manager.cc:5838] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:47.391999 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347a144e18ab4f6e834551044a2ac4ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.393471 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]). Expected version 2 got 0
I20260925 01:49:47.395143 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d7b3c65d8a64734b2c432790dae07e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.396569 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.401490 11457 leader_election.cc:343] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.402155 11946 ts_tablet_manager.cc:1929] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.402545 11457 leader_election.cc:304] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.403673 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.411623 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 19c718c83cfe49b9a745e06314e24409
W20260925 01:49:47.411978 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ba19192502634f8599407d923114a627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba19192502634f8599407d923114a627 already in progress: creating tablet
I20260925 01:49:47.413457 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 19c718c83cfe49b9a745e06314e24409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.414113 11931 tablet_replica.cc:333] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:47.414544 11931 raft_consensus.cc:2243] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:47.416085 12078 tablet.cc:1751] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:47.417011 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:47.417692 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 02f9e96bcdf9418ea54dc73bf68a2be6 deleted and replaced by tablet b60706e2087b4ec7b63f6747534a4b0f
I20260925 01:49:47.417865 11931 pending_rounds.cc:70] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:47.418025 11931 pending_rounds.cc:77] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072835178291200 op_type: NO_OP noop_request { }
I20260925 01:49:47.418114 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet e686dff5ada64f05a1c7bd914c1377a4 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:47.418205 11931 raft_consensus.cc:2889] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:47.418370 11931 raft_consensus.cc:2272] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.420007 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 with delete_type TABLET_DATA_DELETED (replaced by tablet b60706e2087b4ec7b63f6747534a4b0f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.420617 11931 ts_tablet_manager.cc:1916] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.421267 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 347a144e18ab4f6e834551044a2ac4ae
W20260925 01:49:47.424834 11676 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.194:58253 (request call id 51) took 925 ms (client timeout 1000 ms). Trace:
I20260925 01:49:47.425767 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8bc998cc6f76489db63a15330be84eec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.426615 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bc998cc6f76489db63a15330be84eec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:47.425942 11676 rpcz_store.cc:269] 0925 01:49:46.499102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.508542 (+ 9440us) service_pool.cc:224] Handling call
0925 01:49:46.513551 (+ 5009us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00007f46ca49765d 00007f46ca497753 00007f46c7014db1 00007f46cee03acd 00007f46cef8d738 00007f46c59611f6 00007f46c5960f25 00007f46c206763e 00007f46c206651e 00007f46c206c758 00007f46c206d0bf
0925 01:49:47.424781 (+911230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:47.123086 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:49:47.123248 (+ 162us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:49:47.123254 (+ 6us) write_op.cc:435] Acquired schema lock
0925 01:49:47.123256 (+ 2us) tablet.cc:662] Decoding operations
0925 01:49:47.123358 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:49:47.123371 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0925 01:49:47.123376 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0925 01:49:47.123452 (+ 76us) tablet.cc:701] Row locks acquired
0925 01:49:47.123455 (+ 3us) write_op.cc:260] PREPARE: finished
0925 01:49:47.123490 (+ 35us) write_op.cc:270] Start()
0925 01:49:47.123520 (+ 30us) write_op.cc:276] Timestamp: P: 1790300987123476 usec, L: 0
0925 01:49:47.123523 (+ 3us) op_driver.cc:348] REPLICATION: starting
0925 01:49:47.123742 (+ 219us) log.cc:844] Serialized 536 byte log entry
0925 01:49:47.127909 (+ 4167us) op_driver.cc:464] REPLICATION: finished
0925 01:49:47.128118 (+ 209us) write_op.cc:301] APPLY: starting
0925 01:49:47.128137 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0925 01:49:47.128179 (+ 42us) tablet.cc:1397] finished BulkCheckPresence
0925 01:49:47.128215 (+ 36us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:49:47.128295 (+ 80us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:49:47.128328 (+ 33us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 01:49:47.128335 (+ 7us) write_op.cc:312] APPLY: finished
0925 01:49:47.128422 (+ 87us) log.cc:844] Serialized 23 byte log entry
0925 01:49:47.128491 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:47.128513 (+ 22us) write_op.cc:454] Released schema lock
0925 01:49:47.128521 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0925 01:49:47.135920 (+ 7399us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:47.135926 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30356,"reported_tablets":18,"spinlock_wait_cycles":9294208,"child_traces":[["op",{"apply.queue_time_us":151,"apply.run_cpu_time_us":469,"apply.run_wall_time_us":469,"num_ops":1,"prepare.queue_time_us":299591,"prepare.run_cpu_time_us":807,"prepare.run_wall_time_us":12818,"raft.queue_time_us":55,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":245,"replication_time_us":4355}]]}
I20260925 01:49:47.427963 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5036ab1f1580484c8b9367dfab1a8a84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.428288 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d1c22bbeca5e4b81b4cf081fa2b71351"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.428764 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5036ab1f1580484c8b9367dfab1a8a84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:47.428848 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1c22bbeca5e4b81b4cf081fa2b71351 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.433681 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 55e9d52e3f79408a99216250aefc45c8
I20260925 01:49:47.434794 11675 catalog_manager.cc:6934] ReplaceTablet: tablet 55e9d52e3f79408a99216250aefc45c8 deleted and replaced by tablet 1c29e410731842aeb64ab8eeb4ccc3ca
W20260925 01:49:47.436662 11457 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:47.437721 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1b6ea676a1f4d99807029d8401251ef consensus state has no leader
I20260925 01:49:47.438426 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 with delete_type TABLET_DATA_DELETED (replaced by tablet b60706e2087b4ec7b63f6747534a4b0f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.438635 12065 raft_consensus.cc:2749] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.440022 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_019a828477a14ce0bc8b0cae073e0583"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.440665 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b00b413ef17343febe7fadd2f08ae596" } modify_external_catalogs: true
I20260925 01:49:47.440843 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b00b413ef17343febe7fadd2f08ae596" } modify_external_catalogs: true
W20260925 01:49:47.441018 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_019a828477a14ce0bc8b0cae073e0583 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.440249 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_84048a62c4e54c64a5e7e0dc88e0291b" } modify_external_catalogs: true
I20260925 01:49:47.442593 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_02a01489708d4d3aa218829639b66c39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.442776 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_84048a62c4e54c64a5e7e0dc88e0291b" } modify_external_catalogs: true
W20260925 01:49:47.443305 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02a01489708d4d3aa218829639b66c39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.450438 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 347a144e18ab4f6e834551044a2ac4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.454952 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 19c718c83cfe49b9a745e06314e24409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.455715 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e9d52e3f79408a99216250aefc45c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c29e410731842aeb64ab8eeb4ccc3ca) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.456252 11457 leader_election.cc:304] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.456835 12049 raft_consensus.cc:2749] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.457767 11457 leader_election.cc:304] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.469973 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 347a144e18ab4f6e834551044a2ac4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.470583 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e9d52e3f79408a99216250aefc45c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c29e410731842aeb64ab8eeb4ccc3ca) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.471232 12057 raft_consensus.cc:2749] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.475610 11772 consensus_queue.cc:1048] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:47.474205 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c (DEFAULT_TABLE table=default.Table_962d7117724d4e5aa1b45a6fab966667 [id=768d79ef588e46be97ceffa64db19940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.477907 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 039ee80a2822417898c1d1d779f52867
I20260925 01:49:47.486469 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 039ee80a2822417898c1d1d779f52867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.487313 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_434ed55eea774802bad516c94af8ac39" } new_table_name: "default.Table_ca88ffeaae4a4f1999cf9834715b791b" modify_external_catalogs: true
I20260925 01:49:47.493343 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.493427 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e686dff5ada64f05a1c7bd914c1377a4
I20260925 01:49:47.494124 11677 catalog_manager.cc:6934] ReplaceTablet: tablet e686dff5ada64f05a1c7bd914c1377a4 deleted and replaced by tablet a9944a1422d14ae2b22451e67c477d5b
I20260925 01:49:47.496251 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7feb65e332c34c1db0f6aa4f98ffa8b9" } new_table_name: "default.Table_695a3148371f44738e7ed17a0f5d2ba1" modify_external_catalogs: true
I20260925 01:49:47.496701 11931 ts_tablet_manager.cc:1929] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.496937 11931 log.cc:1199] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b96b272afb8341dd9bfff9702c433026
I20260925 01:49:47.497733 11931 ts_tablet_manager.cc:1950] T b96b272afb8341dd9bfff9702c433026 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:47.497943 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.498749 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.500243 12057 raft_consensus.cc:493] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.500715 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b96b272afb8341dd9bfff9702c433026 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]) successfully deleted
I20260925 01:49:47.500702 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet e686dff5ada64f05a1c7bd914c1377a4 with delete_type TABLET_DATA_DELETED (replaced by tablet a9944a1422d14ae2b22451e67c477d5b) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.502401 12081 raft_consensus.cc:493] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.498910 11492 tablet_service.cc:1511] Processing CreateTablet for tablet f1b6ea676a1f4d99807029d8401251ef (DEFAULT_TABLE table=default.Table_cc61844c2cc541bfbb6e5083fb787c58 [id=dba58bdd410a4b8986cf7e359a563628]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.503307 11780 raft_consensus.cc:493] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.503520 11780 raft_consensus.cc:515] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.504154 11946 log.cc:1199] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5b65068a447744ec99e56489963b251c
I20260925 01:49:47.504642 11780 leader_election.cc:290] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.504886 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 19c718c83cfe49b9a745e06314e24409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.506457 11934 raft_consensus.cc:493] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.509121 12081 raft_consensus.cc:515] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.513701 12079 raft_consensus.cc:493] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.515942 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ec6c34d22241e5bda3ec6665a47fc7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.516484 11934 raft_consensus.cc:515] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.517515 11934 leader_election.cc:290] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.517479 12057 raft_consensus.cc:515] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.518357 12057 leader_election.cc:290] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.520404 11772 consensus_queue.cc:1048] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:47.520931 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_393671d61d694438bfaf25af0b823b4c" } new_table_name: "default.Table_f6793736afa14ac5accac777fbb0e77d" modify_external_catalogs: true
I20260925 01:49:47.522298 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c8864007672442f9a84738610b63af81" } new_table_name: "default.Table_dec5804091454eb1a0d870700050c904" modify_external_catalogs: true
I20260925 01:49:47.522408 12081 leader_election.cc:290] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.523571 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7623999b3c04ca69672a1e43fa6921f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.525629 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 with delete_type TABLET_DATA_DELETED (replaced by tablet b60706e2087b4ec7b63f6747534a4b0f) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.526350 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet e686dff5ada64f05a1c7bd914c1377a4 with delete_type TABLET_DATA_DELETED (replaced by tablet a9944a1422d14ae2b22451e67c477d5b) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.526889 11946 ts_tablet_manager.cc:1950] T 5b65068a447744ec99e56489963b251c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:47.527387 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 039ee80a2822417898c1d1d779f52867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:47.529016 11314 leader_election.cc:343] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.529774 11953 ts_tablet_manager.cc:1929] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.526412 12079 raft_consensus.cc:515] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.529985 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60c40e2db5e2434192a359f50c02fe13" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.530779 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e9d52e3f79408a99216250aefc45c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c29e410731842aeb64ab8eeb4ccc3ca) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.531136 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf42293dd5d452aa7ed9e0eaa78f54d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.531550 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 347a144e18ab4f6e834551044a2ac4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.531699 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet f6058cd7c17b4544a565a5aacfb9df92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.531867 11754 tablet_bootstrap.cc:492] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.532043 11754 ts_tablet_manager.cc:1403] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.260s user 0.013s sys 0.028s
I20260925 01:49:47.533480 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.533514 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1396d679e5824c469490170d257f6a9b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:47.534420 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1396d679e5824c469490170d257f6a9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1396d679e5824c469490170d257f6a9b already in progress: creating tablet
I20260925 01:49:47.534638 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4d7b3c65d8a64734b2c432790dae07e1
W20260925 01:49:47.535435 11314 leader_election.cc:343] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:47.535696 11314 leader_election.cc:343] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:47.535957 11314 leader_election.cc:343] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.536190 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.536516 11953 log.cc:1199] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/491d790067644090aa4d25f4060cc2ec
I20260925 01:49:47.536446 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5c6b4a2e548d46b9a0d5685f61b90692"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.537101 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.537106 11953 ts_tablet_manager.cc:1950] T 491d790067644090aa4d25f4060cc2ec P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:47.537526 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 21) took 1255 ms. Trace:
I20260925 01:49:47.537659 11953 rpcz_store.cc:276] 0925 01:49:46.282220 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.282272 (+ 52us) service_pool.cc:224] Handling call
0925 01:49:47.179686 (+897414us) ts_tablet_manager.cc:1151] Deleting tablet 491d790067644090aa4d25f4060cc2ec
0925 01:49:47.179700 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.212502 (+ 32802us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.523144 (+310642us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.537461 (+ 14317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":897036}
I20260925 01:49:47.538272 11953 tablet_replica.cc:333] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:47.538439 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 491d790067644090aa4d25f4060cc2ec (table default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]) successfully deleted
I20260925 01:49:47.538528 11953 raft_consensus.cc:2243] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:47.538750 11953 raft_consensus.cc:2272] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.539404 11953 ts_tablet_manager.cc:1916] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.539670 11934 consensus_queue.cc:1048] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:47.540110 12079 leader_election.cc:290] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.543408 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.546693 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 039ee80a2822417898c1d1d779f52867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:47.548852 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c42d96d45e8c4e8e8bee374477cfb0bb because the tablet was not found. No further retry: Not found: Tablet not found: c42d96d45e8c4e8e8bee374477cfb0bb
I20260925 01:49:47.549186 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet e686dff5ada64f05a1c7bd914c1377a4 with delete_type TABLET_DATA_DELETED (replaced by tablet a9944a1422d14ae2b22451e67c477d5b) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:47.549701 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 already in progress: creating tablet
I20260925 01:49:47.550559 11754 raft_consensus.cc:359] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.551419 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9704bbf8ddbe4f129bccb5a8e30be536"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.551990 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9704bbf8ddbe4f129bccb5a8e30be536 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.553928 11754 raft_consensus.cc:385] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.554019 11754 raft_consensus.cc:740] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.553481 11931 tablet_replica.cc:333] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:47.554427 11931 raft_consensus.cc:2243] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:47.554778 11931 pending_rounds.cc:70] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:47.554939 11931 pending_rounds.cc:77] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072837039206400 op_type: NO_OP noop_request { }
I20260925 01:49:47.555143 11931 raft_consensus.cc:2889] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:47.555277 11931 raft_consensus.cc:2272] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.555883 11931 ts_tablet_manager.cc:1916] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.556734 11755 tablet_bootstrap.cc:492] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:47.556968 11755 ts_tablet_manager.cc:1403] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.276s user 0.021s sys 0.051s
I20260925 01:49:47.558964 11754 consensus_queue.cc:260] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.558100 11755 raft_consensus.cc:359] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.560597 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5acd5d878aac4261a7294e87304c9dfc
I20260925 01:49:47.560949 11755 raft_consensus.cc:385] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.561074 11755 raft_consensus.cc:740] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.561409 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1b6ea676a1f4d99807029d8401251ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.561739 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 5acd5d878aac4261a7294e87304c9dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.561722 11755 consensus_queue.cc:260] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.562282 11754 ts_tablet_manager.cc:1434] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.030s user 0.003s sys 0.000s
I20260925 01:49:47.562332 11755 ts_tablet_manager.cc:1434] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260925 01:49:47.562659 11755 tablet_bootstrap.cc:492] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:47.566030 11753 tablet_bootstrap.cc:492] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:47.565271 11754 tablet_bootstrap.cc:492] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.566298 11753 ts_tablet_manager.cc:1403] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.260s user 0.006s sys 0.000s
I20260925 01:49:47.567418 11753 raft_consensus.cc:359] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.567670 11753 raft_consensus.cc:385] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.567780 11753 raft_consensus.cc:740] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.567845 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 5acd5d878aac4261a7294e87304c9dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:47.568105 11754 tablet_bootstrap.cc:654] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.568061 11753 consensus_queue.cc:260] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.568804 11753 ts_tablet_manager.cc:1434] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:47.569247 11753 tablet_bootstrap.cc:492] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:47.570140 11456 leader_election.cc:343] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.571226 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.571532 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 5acd5d878aac4261a7294e87304c9dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.577518 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 15) took 1211 ms. Trace:
I20260925 01:49:47.577656 11946 rpcz_store.cc:276] 0925 01:49:46.315679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.316560 (+ 881us) service_pool.cc:224] Handling call
0925 01:49:46.986049 (+669489us) ts_tablet_manager.cc:1151] Deleting tablet 5b65068a447744ec99e56489963b251c
0925 01:49:46.986101 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.051434 (+ 65333us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x6160000a0c54. stack: 00007f859f5785c6 00007f859f578380 00007f859e58034d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f85ab66ca70 00007f85ac9f5583 00007f85af5c28b7 00007f85af5f5a64 00007f85af5d63a0 00007f85af5d612d 0000000000aaef9c 00007f859f5beaef 00007f859f5c1deb 00007f859f5c1c68
0925 01:49:47.293059 (+241625us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.388171 (+ 95112us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.527275 (+139104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136787328,"tablet-delete.queue_time_us":669290}
I20260925 01:49:47.578423 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5b65068a447744ec99e56489963b251c (table default.Table_c6206da59ecf432cb4c65623ced807f5 [id=fe56a57c1dff44e09680b6041eeafac5]) successfully deleted
I20260925 01:49:47.583173 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7623999b3c04ca69672a1e43fa6921f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.587740 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ec6c34d22241e5bda3ec6665a47fc7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.589145 11754 tablet_bootstrap.cc:492] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.589149 11946 tablet_replica.cc:333] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:47.589323 11754 ts_tablet_manager.cc:1403] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260925 01:49:47.589393 11946 raft_consensus.cc:2243] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:47.590173 11946 raft_consensus.cc:2272] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.593356 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf42293dd5d452aa7ed9e0eaa78f54d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.593504 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.593624 11373 raft_consensus.cc:2468] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:47.593935 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:47.593377 11314 leader_election.cc:343] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.595721 11518 raft_consensus.cc:2468] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:47.599370 11314 leader_election.cc:304] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.600224 11314 leader_election.cc:304] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.600615 11886 raft_consensus.cc:2749] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.600756 11946 ts_tablet_manager.cc:1916] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.601866 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1396d679e5824c469490170d257f6a9b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.602190 12081 raft_consensus.cc:3060] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.602224 11886 consensus_queue.cc:1048] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 01:49:47.607780 12081 raft_consensus.cc:2749] T 60c40e2db5e2434192a359f50c02fe13 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.608942 11931 ts_tablet_manager.cc:1929] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.609126 11931 log.cc:1199] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a26b7ec7373d42668f40c7c89084be47
I20260925 01:49:47.610668 11754 raft_consensus.cc:359] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.610878 11754 raft_consensus.cc:385] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.610992 11754 raft_consensus.cc:740] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.613395 11754 consensus_queue.cc:260] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.617537 11753 tablet_bootstrap.cc:654] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.620275 11754 ts_tablet_manager.cc:1434] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20260925 01:49:47.626856 11953 ts_tablet_manager.cc:1929] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:47.627339 11953 log.cc:1199] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/bfd9645cd6644a55997eb7745c7b29f2
W20260925 01:49:47.633271 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 331380a2be9a4893927c9b94a2c3e08b consensus state has no leader
W20260925 01:49:47.634704 11666 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8bf42293dd5d452aa7ed9e0eaa78f54d consensus state has no leader
I20260925 01:49:47.639747 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8bc998cc6f76489db63a15330be84eec" } modify_external_catalogs: true
I20260925 01:49:47.640089 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8bc998cc6f76489db63a15330be84eec" } modify_external_catalogs: true
I20260925 01:49:47.642263 11754 tablet_bootstrap.cc:492] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.659561 11931 ts_tablet_manager.cc:1950] T a26b7ec7373d42668f40c7c89084be47 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:47.663901 11772 raft_consensus.cc:493] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.664307 11772 raft_consensus.cc:515] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.665166 11772 leader_election.cc:290] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.667287 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:47.669912 11754 tablet_bootstrap.cc:654] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.670814 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 38) took 1102 ms. Trace:
W20260925 01:49:47.674786 11176 leader_election.cc:343] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.680636 11931 rpcz_store.cc:276] 0925 01:49:46.568740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.568800 (+ 60us) service_pool.cc:224] Handling call
0925 01:49:47.552900 (+984100us) ts_tablet_manager.cc:1151] Deleting tablet a26b7ec7373d42668f40c7c89084be47
0925 01:49:47.552910 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.586856 (+ 33946us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.608829 (+ 21973us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.670731 (+ 61902us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":983900}
I20260925 01:49:47.681458 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a26b7ec7373d42668f40c7c89084be47 (table default.Table_4ed532a0734c4f35949fe170b6a3d36c [id=0974d15f11e64c96987f3a0a03dd2561]) successfully deleted
W20260925 01:49:47.683033 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 357963616763428fa69c7670e760f84e consensus state has no leader
W20260925 01:49:47.683694 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 consensus state has no leader
I20260925 01:49:47.689129 11946 ts_tablet_manager.cc:1929] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:47.689327 11946 log.cc:1199] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c75a4ed161734d30ab5ad2e2b00d77c9
I20260925 01:49:47.691428 11931 tablet_replica.cc:333] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:47.691798 11931 raft_consensus.cc:2243] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:47.692085 11931 raft_consensus.cc:2272] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.692590 11972 consensus_queue.cc:1048] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:47.693022 11931 ts_tablet_manager.cc:1916] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.694898 11753 tablet_bootstrap.cc:492] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:47.695089 11753 ts_tablet_manager.cc:1403] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.126s user 0.003s sys 0.004s
I20260925 01:49:47.696172 11753 raft_consensus.cc:359] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.696395 11753 raft_consensus.cc:385] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.696517 11753 raft_consensus.cc:740] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.696794 11753 consensus_queue.cc:260] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.697640 11753 ts_tablet_manager.cc:1434] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260925 01:49:47.701781 11754 tablet_bootstrap.cc:492] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.702034 11754 ts_tablet_manager.cc:1403] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.000s
I20260925 01:49:47.703084 11754 raft_consensus.cc:359] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.703361 11754 raft_consensus.cc:385] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.703466 11754 raft_consensus.cc:740] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.703863 11754 consensus_queue.cc:260] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.704500 11754 ts_tablet_manager.cc:1434] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:47.705067 11754 tablet_bootstrap.cc:492] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.706460 11972 consensus_queue.cc:1048] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:47.714524 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.715473 11972 consensus_queue.cc:1048] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:49:47.716873 11177 leader_election.cc:343] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.716977 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_04449fc82e9a480cbd1dfa613ef87dbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.717067 11177 leader_election.cc:304] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:49:47.717713 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04449fc82e9a480cbd1dfa613ef87dbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.717841 11972 raft_consensus.cc:2749] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.718573 11754 tablet_bootstrap.cc:654] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.718616 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5ee00c6a9b644c778e571ff1952327d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.719408 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ee00c6a9b644c778e571ff1952327d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.721257 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_02a01489708d4d3aa218829639b66c39" } new_table_name: "default.Table_1629f46770b141d289c5bbd8855f4acc" modify_external_catalogs: true
I20260925 01:49:47.722236 11931 ts_tablet_manager.cc:1929] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:47.723131 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a33362d5d6de41e985d86740d8af966c" } modify_external_catalogs: true
I20260925 01:49:47.723412 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a33362d5d6de41e985d86740d8af966c" } modify_external_catalogs: true
I20260925 01:49:47.730948 11931 log.cc:1199] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ac03ebbd455f4fad88e875b69a049bc0
I20260925 01:49:47.731766 11931 ts_tablet_manager.cc:1950] T ac03ebbd455f4fad88e875b69a049bc0 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:47.732846 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 39) took 1163 ms. Trace:
I20260925 01:49:47.733071 11931 rpcz_store.cc:276] 0925 01:49:46.569660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.569714 (+ 54us) service_pool.cc:224] Handling call
0925 01:49:47.691333 (+1121619us) ts_tablet_manager.cc:1151] Deleting tablet ac03ebbd455f4fad88e875b69a049bc0
0925 01:49:47.691346 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.698553 (+ 7207us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.722148 (+ 23595us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.732690 (+ 10542us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1121388}
I20260925 01:49:47.733911 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ac03ebbd455f4fad88e875b69a049bc0 (table default.Table_09a5b65cdd904adcbe454a84c2a999a8 [id=3437d40bf64c4d299fea4ecb2b8c776e]) successfully deleted
I20260925 01:49:47.734531 11931 tablet_replica.cc:333] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:47.734869 11931 raft_consensus.cc:2243] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:47.735309 11931 raft_consensus.cc:2272] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.736477 11931 ts_tablet_manager.cc:1916] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.739490 11754 tablet_bootstrap.cc:492] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.739760 11754 ts_tablet_manager.cc:1403] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.000s
I20260925 01:49:47.740952 11754 raft_consensus.cc:359] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.741420 11754 raft_consensus.cc:385] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.741688 11754 raft_consensus.cc:740] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.742244 11754 consensus_queue.cc:260] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.744483 11953 ts_tablet_manager.cc:1950] T bfd9645cd6644a55997eb7745c7b29f2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:47.748030 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 2 got 0
I20260925 01:49:47.748396 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:47.749296 11673 catalog_manager.cc:5838] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:47.749864 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
W20260925 01:49:47.751537 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17352fd6ea4e4ed9a178f1510edf4f6d consensus state has no leader
I20260925 01:49:47.751521 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 927bc1194884470e9fc977ca870f1b0c (DEFAULT_TABLE table=default.Table_aac094552c1d4facaaacca78cda958e1 [id=876adf51567e47859196d02efc6f89ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.752557 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 784de8c6e6e1434a91106dd19cd9262a (DEFAULT_TABLE table=default.Table_5c3812c0f44d4787a440618e42b85b07 [id=5405c0f51c3b4db8a58b97b60ea65777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.753225 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784de8c6e6e1434a91106dd19cd9262a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.754436 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 784de8c6e6e1434a91106dd19cd9262a (DEFAULT_TABLE table=default.Table_5c3812c0f44d4787a440618e42b85b07 [id=5405c0f51c3b4db8a58b97b60ea65777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.755013 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784de8c6e6e1434a91106dd19cd9262a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.757354 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 927bc1194884470e9fc977ca870f1b0c (DEFAULT_TABLE table=default.Table_aac094552c1d4facaaacca78cda958e1 [id=876adf51567e47859196d02efc6f89ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.757848 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927bc1194884470e9fc977ca870f1b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.758416 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 85d859207bbc4aefb26c726dce404c44 (DEFAULT_TABLE table=default.Table_34d61a42397f4e9ca0d0364c26827c95 [id=547a29a570064420aa9eaaec9543cdb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.758891 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d859207bbc4aefb26c726dce404c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.760614 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 85d859207bbc4aefb26c726dce404c44 (DEFAULT_TABLE table=default.Table_34d61a42397f4e9ca0d0364c26827c95 [id=547a29a570064420aa9eaaec9543cdb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.761344 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 30a5240093dd442a93bff006a965bc41 (DEFAULT_TABLE table=default.Table_1ffecf54f1b3464eae523b831ac20bc0 [id=61d8ea1b10c44d6eb92474186b70df53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.761593 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 30a5240093dd442a93bff006a965bc41 (DEFAULT_TABLE table=default.Table_1ffecf54f1b3464eae523b831ac20bc0 [id=61d8ea1b10c44d6eb92474186b70df53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.761972 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 (DEFAULT_TABLE table=default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c [id=603d80ba3d934fc69b60ff151671e75d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.762423 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 (DEFAULT_TABLE table=default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c [id=603d80ba3d934fc69b60ff151671e75d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.763267 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 (DEFAULT_TABLE table=default.Table_bc79315e26e64754b7ae9ce08ba0a88d [id=b96d7b3ebf9544a0867e0ab08c072648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.763300 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 85d859207bbc4aefb26c726dce404c44 (DEFAULT_TABLE table=default.Table_34d61a42397f4e9ca0d0364c26827c95 [id=547a29a570064420aa9eaaec9543cdb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.763947 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a5240093dd442a93bff006a965bc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.764213 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d859207bbc4aefb26c726dce404c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.765677 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3a033c9e7545479130c7a3c48ac254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.766487 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 927bc1194884470e9fc977ca870f1b0c (DEFAULT_TABLE table=default.Table_aac094552c1d4facaaacca78cda958e1 [id=876adf51567e47859196d02efc6f89ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.766858 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a794ad0d87475a88efc02f5ae080f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.767323 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927bc1194884470e9fc977ca870f1b0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.769637 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 54814.3us
I20260925 01:49:47.771471 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 90647937eb364a7a973d04ea69cbc9aa (DEFAULT_TABLE table=default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.771723 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d (DEFAULT_TABLE table=default.Table_ca88ffeaae4a4f1999cf9834715b791b [id=9389812769844f279c1e0c5fa9707dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.771997 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90647937eb364a7a973d04ea69cbc9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.772330 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17352fd6ea4e4ed9a178f1510edf4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.772595 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 80fe96946b294785b8d76564e0f5fa12 (DEFAULT_TABLE table=default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.773061 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fe96946b294785b8d76564e0f5fa12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.773164 11680 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 6c9774b6e0444103bac68533af6b9ac4
I20260925 01:49:47.774045 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 30a5240093dd442a93bff006a965bc41 (DEFAULT_TABLE table=default.Table_1ffecf54f1b3464eae523b831ac20bc0 [id=61d8ea1b10c44d6eb92474186b70df53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.774874 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_019a828477a14ce0bc8b0cae073e0583" } modify_external_catalogs: true
I20260925 01:49:47.770799 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 22) took 1479 ms. Trace:
I20260925 01:49:47.775118 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_019a828477a14ce0bc8b0cae073e0583" } modify_external_catalogs: true
I20260925 01:49:47.775287 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a5240093dd442a93bff006a965bc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.776754 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 (DEFAULT_TABLE table=default.Table_bc79315e26e64754b7ae9ce08ba0a88d [id=b96d7b3ebf9544a0867e0ab08c072648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.776964 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1468fd0ad2304074b7b97fa271e71d10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.777388 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 90647937eb364a7a973d04ea69cbc9aa (DEFAULT_TABLE table=default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:47.777670 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1468fd0ad2304074b7b97fa271e71d10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.777927 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 80fe96946b294785b8d76564e0f5fa12 (DEFAULT_TABLE table=default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.778429 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d (DEFAULT_TABLE table=default.Table_ca88ffeaae4a4f1999cf9834715b791b [id=9389812769844f279c1e0c5fa9707dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.778908 11754 ts_tablet_manager.cc:1434] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.039s user 0.003s sys 0.000s
I20260925 01:49:47.779407 11754 tablet_bootstrap.cc:492] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.781226 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 (DEFAULT_TABLE table=default.Table_bc79315e26e64754b7ae9ce08ba0a88d [id=b96d7b3ebf9544a0867e0ab08c072648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.781977 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 (DEFAULT_TABLE table=default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c [id=603d80ba3d934fc69b60ff151671e75d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.782735 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e310d52dc129451da019692eab3b9328"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.783473 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e310d52dc129451da019692eab3b9328 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.783514 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 90647937eb364a7a973d04ea69cbc9aa (DEFAULT_TABLE table=default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.783514 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d (DEFAULT_TABLE table=default.Table_ca88ffeaae4a4f1999cf9834715b791b [id=9389812769844f279c1e0c5fa9707dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.804345 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a794ad0d87475a88efc02f5ae080f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.806396 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 80fe96946b294785b8d76564e0f5fa12 (DEFAULT_TABLE table=default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.807299 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17352fd6ea4e4ed9a178f1510edf4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.810986 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ef156363e7164df8bef902f6f27e3116"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.811468 11755 tablet_bootstrap.cc:700] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent opening tablet: real 0.246s user 0.001s sys 0.001s
I20260925 01:49:47.811511 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fe96946b294785b8d76564e0f5fa12. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.811700 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef156363e7164df8bef902f6f27e3116 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.811828 11953 rpcz_store.cc:276] 0925 01:49:46.283219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.283267 (+ 48us) service_pool.cc:224] Handling call
0925 01:49:47.538164 (+1254897us) ts_tablet_manager.cc:1151] Deleting tablet bfd9645cd6644a55997eb7745c7b29f2
0925 01:49:47.538176 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.597678 (+ 59502us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.617876 (+ 20198us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.762907 (+145031us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1254665}
I20260925 01:49:47.813372 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet bfd9645cd6644a55997eb7745c7b29f2 (table default.Table_e04f8a75de294166807ae892ada52d44 [id=c8513974ec3346098311c5e3f0f392a0]) successfully deleted
I20260925 01:49:47.818874 11953 tablet_replica.cc:333] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:47.819316 11755 tablet_bootstrap.cc:654] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.822626 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3a033c9e7545479130c7a3c48ac254. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.824753 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 210681us
W20260925 01:49:47.827803 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41c4a23d974f4daea7a274eccd661d5c has no consensus state
I20260925 01:49:47.828095 11754 tablet_bootstrap.cc:654] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.831518 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 784de8c6e6e1434a91106dd19cd9262a (DEFAULT_TABLE table=default.Table_5c3812c0f44d4787a440618e42b85b07 [id=5405c0f51c3b4db8a58b97b60ea65777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:47.836344 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90647937eb364a7a973d04ea69cbc9aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.837136 11314 leader_election.cc:343] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.838515 11953 raft_consensus.cc:2243] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:47.840536 11314 leader_election.cc:304] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:47.841152 11314 leader_election.cc:343] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.841377 11886 raft_consensus.cc:2749] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.841387 11314 leader_election.cc:304] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.841835 11886 raft_consensus.cc:2749] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.841953 11314 leader_election.cc:304] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.842326 11886 raft_consensus.cc:2804] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:47.842475 11886 raft_consensus.cc:493] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:47.842572 11886 raft_consensus.cc:3060] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:47.843410 11314 leader_election.cc:343] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.843621 11314 leader_election.cc:304] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.843918 12081 raft_consensus.cc:2749] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.844729 11953 raft_consensus.cc:2272] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.845196 12069 consensus_queue.cc:1048] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:49:47.845412 11457 consensus_peers.cc:597] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 491d790067644090aa4d25f4060cc2ec. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:47.846264 11457 leader_election.cc:343] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.846251 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_579fc3540ec141c1a58dac6f0cce07e1" } modify_external_catalogs: true
I20260925 01:49:47.846433 11457 leader_election.cc:304] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.846475 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_579fc3540ec141c1a58dac6f0cce07e1" } modify_external_catalogs: true
I20260925 01:49:47.846745 12069 raft_consensus.cc:2749] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:47.847091 11457 leader_election.cc:304] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:47.848245 11946 ts_tablet_manager.cc:1950] T c75a4ed161734d30ab5ad2e2b00d77c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:47.849104 12021 raft_consensus.cc:2804] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:47.849220 12021 raft_consensus.cc:493] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:47.849309 12021 raft_consensus.cc:3060] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.852319 12021 raft_consensus.cc:515] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.853125 12021 leader_election.cc:290] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.854171 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf42293dd5d452aa7ed9e0eaa78f54d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:47.854394 11236 raft_consensus.cc:3060] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.857487 11236 raft_consensus.cc:2468] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:47.858312 11456 leader_election.cc:304] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:47.858884 12021 raft_consensus.cc:2804] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:47.859280 12021 raft_consensus.cc:697] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:47.859819 12021 consensus_queue.cc:237] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.861673 11972 raft_consensus.cc:493] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.861636 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_703892f2a488412e87acffbe309416fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:47.861877 11972 raft_consensus.cc:515] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:47.862308 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_703892f2a488412e87acffbe309416fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.862802 11972 leader_election.cc:290] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.864868 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.868422 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:47.869197 11176 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.871654 11375 raft_consensus.cc:2468] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:47.872570 11177 leader_election.cc:304] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:47.873085 11972 raft_consensus.cc:2804] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:47.873214 11972 raft_consensus.cc:493] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:47.873317 11972 raft_consensus.cc:3060] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.877462 11931 ts_tablet_manager.cc:1929] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:47.877628 11931 log.cc:1199] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:47.878185 11676 catalog_manager.cc:5838] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:47.878767 11676 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 2 got 0
I20260925 01:49:47.879733 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76] alter complete (version 1)
I20260925 01:49:47.877381 11972 raft_consensus.cc:515] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.883108 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_695a3148371f44738e7ed17a0f5d2ba1" } modify_external_catalogs: true
I20260925 01:49:47.883387 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_695a3148371f44738e7ed17a0f5d2ba1" } modify_external_catalogs: true
I20260925 01:49:47.886301 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85d859207bbc4aefb26c726dce404c44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.890604 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a5240093dd442a93bff006a965bc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.891821 11953 ts_tablet_manager.cc:1916] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.868884 12105 consensus_queue.cc:1048] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260925 01:49:47.895850 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e3a033c9e7545479130c7a3c48ac254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.898335 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17352fd6ea4e4ed9a178f1510edf4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.902525 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90647937eb364a7a973d04ea69cbc9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.905110 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf42293dd5d452aa7ed9e0eaa78f54d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:47.906185 11379 raft_consensus.cc:3060] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.907357 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80fe96946b294785b8d76564e0f5fa12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.882318 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet ff92ca86767f4ba6905da62b6a4b892c with delete_type TABLET_DATA_DELETED (replaced by tablet c215c3541057498db63e03c685325f48) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.879016 11754 tablet_bootstrap.cc:492] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.911880 11754 ts_tablet_manager.cc:1403] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.133s user 0.005s sys 0.000s
I20260925 01:49:47.912985 11754 raft_consensus.cc:359] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:47.913146 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:49:47.913329 11754 raft_consensus.cc:385] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.913408 11754 raft_consensus.cc:740] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.913676 11754 consensus_queue.cc:260] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:47.915925 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:47.916649 12123 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:47.918640 11754 ts_tablet_manager.cc:1434] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260925 01:49:47.929530 11674 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 557e895b3dec42aab6ed3c54de2ae1f4
I20260925 01:49:47.929755 11754 tablet_bootstrap.cc:492] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.878043 11931 ts_tablet_manager.cc:1950] T f6058cd7c17b4544a565a5aacfb9df92 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:47.932416 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 40) took 1361 ms. Trace:
I20260925 01:49:47.932567 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet ca17585cd523440ca1e9b754f3aedf8a from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:47.932768 11931 rpcz_store.cc:276] 0925 01:49:46.570479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.570532 (+ 53us) service_pool.cc:224] Handling call
0925 01:49:47.734269 (+1163737us) ts_tablet_manager.cc:1151] Deleting tablet f6058cd7c17b4544a565a5aacfb9df92
0925 01:49:47.734280 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.833171 (+ 98891us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.877321 (+ 44150us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.932357 (+ 55036us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1163534}
I20260925 01:49:47.933156 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet b9937c3776f549dea887ace26dae492c from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:47.933526 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet f6058cd7c17b4544a565a5aacfb9df92 (table default.Table_2ba2a8cd4c204308b6bd353a094dafe4 [id=55b54d01f7634e9583dd4f3e1f1776fe]) successfully deleted
I20260925 01:49:47.933977 11931 tablet_replica.cc:333] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:47.934158 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0e71b8f12efa4591b712a486be4752b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.934825 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e71b8f12efa4591b712a486be4752b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.934975 11931 raft_consensus.cc:2243] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:47.935153 11931 raft_consensus.cc:2272] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:47.935729 11931 ts_tablet_manager.cc:1916] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:47.936347 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_716df684734d4100ba0e2266d8bdb6e8" } new_table_name: "default.Table_1a15ff4030084c1c84fadccb984297e8" modify_external_catalogs: true
I20260925 01:49:47.933037 11972 leader_election.cc:290] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:47.934682 11754 tablet_bootstrap.cc:654] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.938608 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7f229e69d1044678b1b85292293ee4e5" } new_table_name: "default.Table_5986aa81fd204416899fc953566bd2ba" modify_external_catalogs: true
I20260925 01:49:47.944044 11754 tablet_bootstrap.cc:492] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:47.944512 11754 ts_tablet_manager.cc:1403] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260925 01:49:47.945986 12105 consensus_queue.cc:1048] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260925 01:49:47.946375 11754 raft_consensus.cc:359] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.947213 11754 raft_consensus.cc:385] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:47.947868 11754 raft_consensus.cc:740] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:47.949728 11754 consensus_queue.cc:260] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.951116 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:47.952646 11314 consensus_peers.cc:597] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9884d7af60324a24ad06d6fa5db358b2. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:47.954736 11754 ts_tablet_manager.cc:1434] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260925 01:49:47.956254 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:47.956494 11372 raft_consensus.cc:3060] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.960717 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e973513b7c3d4c1dadf184056a92dad5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:47.961406 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e973513b7c3d4c1dadf184056a92dad5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:47.961807 11886 raft_consensus.cc:515] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:47.968986 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:47.969074 11754 tablet_bootstrap.cc:492] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:47.969815 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927bc1194884470e9fc977ca870f1b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.979501 11886 leader_election.cc:290] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:49:47.981503 11314 leader_election.cc:343] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.982208 11372 raft_consensus.cc:2468] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:47.982862 11177 leader_election.cc:304] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:47.983222 11965 raft_consensus.cc:2804] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:47.983410 11965 raft_consensus.cc:697] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:47.983701 12021 raft_consensus.cc:493] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:47.983764 11965 consensus_queue.cc:237] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.985146 11753 tablet_bootstrap.cc:492] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:47.985308 11754 tablet_bootstrap.cc:654] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:47.985673 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:47.987764 12021 raft_consensus.cc:515] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:47.987766 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:47.988494 12021 leader_election.cc:290] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:47.988636 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784de8c6e6e1434a91106dd19cd9262a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:47.989810 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a794ad0d87475a88efc02f5ae080f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:47.993769 11176 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.993871 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9937c3776f549dea887ace26dae492c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:47.994946 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:47.995405 11379 raft_consensus.cc:2468] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:47.995591 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 14) took 1675 ms. Trace:
W20260925 01:49:47.996100 11456 leader_election.cc:343] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:47.996708 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9937c3776f549dea887ace26dae492c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:47.997457 11518 raft_consensus.cc:3060] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:47.997999 11931 ts_tablet_manager.cc:1929] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:47.999125 11931 log.cc:1199] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/81c7e15700f64a92b87a6901950c5412
I20260925 01:49:47.999771 11886 consensus_queue.cc:1048] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 01:49:48.001886 11931 ts_tablet_manager.cc:1950] T 81c7e15700f64a92b87a6901950c5412 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:48.002879 11953 ts_tablet_manager.cc:1929] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.007107 11518 raft_consensus.cc:2468] T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:48.007484 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 41) took 1436 ms. Trace:
I20260925 01:49:48.008083 11931 rpcz_store.cc:276] 0925 01:49:46.571212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.571256 (+ 44us) service_pool.cc:224] Handling call
0925 01:49:47.933903 (+1362647us) ts_tablet_manager.cc:1151] Deleting tablet 81c7e15700f64a92b87a6901950c5412
0925 01:49:47.933915 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.951234 (+ 17319us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.997269 (+ 46035us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.007224 (+ 9955us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1362390}
I20260925 01:49:48.011114 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 81c7e15700f64a92b87a6901950c5412 (table default.Table_71172e0180b64f14a6f7c6f39f26a447 [id=b62012a0ec8349f3bacfd5a1145ba0fd]) successfully deleted
I20260925 01:49:48.014441 11772 raft_consensus.cc:493] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.014624 11772 raft_consensus.cc:515] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.015475 11772 leader_election.cc:290] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.020202 11953 log.cc:1199] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/105fd502b74d442eb5d5031f56e5cb62
I20260925 01:49:48.020645 12078 tablet.cc:1751] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:48.020779 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ec6c34d22241e5bda3ec6665a47fc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:48.021001 11372 raft_consensus.cc:2468] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:48.021562 11177 leader_election.cc:304] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.022702 11772 raft_consensus.cc:2804] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.022830 11772 raft_consensus.cc:493] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.022913 11772 raft_consensus.cc:3060] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.025942 11772 raft_consensus.cc:515] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.027638 11772 leader_election.cc:290] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.031296 11953 ts_tablet_manager.cc:1950] T 105fd502b74d442eb5d5031f56e5cb62 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:48.031786 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ec6c34d22241e5bda3ec6665a47fc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:48.032061 11372 raft_consensus.cc:3060] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:48.034832 11457 leader_election.cc:343] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.036280 11931 tablet_replica.cc:333] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.036795 11753 tablet_bootstrap.cc:654] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.036751 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ec6c34d22241e5bda3ec6665a47fc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.037230 11931 raft_consensus.cc:2243] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.038112 11931 raft_consensus.cc:2272] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:48.042376 11176 leader_election.cc:343] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.043344 11931 ts_tablet_manager.cc:1916] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.047821 11946 rpcz_store.cc:276] 0925 01:49:46.315522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.319853 (+ 4331us) service_pool.cc:224] Handling call
0925 01:49:47.578118 (+1258265us) ts_tablet_manager.cc:1151] Deleting tablet c75a4ed161734d30ab5ad2e2b00d77c9
0925 01:49:47.578130 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.672880 (+ 94750us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.688984 (+ 16104us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.990971 (+301987us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1257960}
I20260925 01:49:48.050734 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c75a4ed161734d30ab5ad2e2b00d77c9 (table default.Table_8f04a495ad294ac38a1fe39d586033d7 [id=3414ecadb9c24609b4011cc0ba7c73dd]) successfully deleted
I20260925 01:49:48.047945 11457 leader_election.cc:304] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:48.066233 11372 raft_consensus.cc:2468] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:48.066936 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 23) took 1747 ms. Trace:
I20260925 01:49:48.067152 11953 rpcz_store.cc:276] 0925 01:49:46.284093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.284142 (+ 49us) service_pool.cc:224] Handling call
0925 01:49:47.812188 (+1528046us) ts_tablet_manager.cc:1151] Deleting tablet 105fd502b74d442eb5d5031f56e5cb62
0925 01:49:47.812201 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:47.973043 (+160842us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.002793 (+ 29750us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.031727 (+ 28934us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1527831}
I20260925 01:49:48.068012 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 24) took 1783 ms. Trace:
I20260925 01:49:48.068202 11953 rpcz_store.cc:276] 0925 01:49:46.284908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.284954 (+ 46us) service_pool.cc:224] Handling call
0925 01:49:48.067789 (+1782835us) ts_tablet_manager.cc:1151] Deleting tablet ba19192502634f8599407d923114a627
0925 01:49:48.067804 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.067941 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1782641}
I20260925 01:49:48.068411 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 105fd502b74d442eb5d5031f56e5cb62 (table default.Table_6ae7ffbe7b334c87a1be9c5c18761c65 [id=1c424cf98429473f9896b9c4028e11f6]) successfully deleted
W20260925 01:49:48.068888 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ba19192502634f8599407d923114a627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba19192502634f8599407d923114a627 already in progress: creating tablet
I20260925 01:49:48.069139 11953 tablet_replica.cc:333] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:48.069487 11953 raft_consensus.cc:2243] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:48.070362 11953 raft_consensus.cc:2272] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.071601 11953 ts_tablet_manager.cc:1916] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.072858 11946 tablet_replica.cc:333] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:49:48.073156 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 66733.8us
I20260925 01:49:48.076515 11314 leader_election.cc:304] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:48.076866 11886 raft_consensus.cc:2804] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:48.079486 11886 raft_consensus.cc:697] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:48.080379 11886 consensus_queue.cc:237] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:48.074501 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ec6c34d22241e5bda3ec6665a47fc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:48.090404 11946 raft_consensus.cc:2243] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.090621 11946 raft_consensus.cc:2272] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.091239 11946 ts_tablet_manager.cc:1916] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.094086 11755 tablet_bootstrap.cc:492] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:48.094250 11755 ts_tablet_manager.cc:1403] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.532s user 0.005s sys 0.010s
I20260925 01:49:48.095027 11755 raft_consensus.cc:359] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.095214 11755 raft_consensus.cc:385] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.095304 11755 raft_consensus.cc:740] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.095561 11755 consensus_queue.cc:260] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.096118 11755 ts_tablet_manager.cc:1434] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260925 01:49:48.096417 11755 tablet_bootstrap.cc:492] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:48.104225 11177 leader_election.cc:304] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.104406 12118 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260925 01:49:48.105633 11176 leader_election.cc:343] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.109409 11946 ts_tablet_manager.cc:1929] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:48.109570 11946 log.cc:1199] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ad1cbf07e15440c7919a4bbcd937fb53
W20260925 01:49:48.110643 11177 raft_consensus.cc:2686] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:48.111392 12078 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260925 01:49:48.120260 11664 consensus_peers.cc:597] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 -> Peer ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823): Couldn't send request to peer ca2cee7752c249f68a372ef5c6a18bff. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 01:49:48.121039 12021 raft_consensus.cc:2749] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:48.126827 11755 tablet_bootstrap.cc:654] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.129711 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_95d84f6a76304a15a2eea81e724b435c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.130650 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95d84f6a76304a15a2eea81e724b435c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.131513 11851 raft_consensus.cc:493] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.137399 11851 raft_consensus.cc:515] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.131276 12132 tablet.cc:1751] T 5ad258cd4788477ea5f9e34ebcab95c7 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:48.140949 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb4dac3099346a7975229d472a3919e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:48.141052 11176 consensus_peers.cc:597] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c75a4ed161734d30ab5ad2e2b00d77c9. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:48.149091 11177 leader_election.cc:343] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.149032 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb4dac3099346a7975229d472a3919e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.149439 11851 leader_election.cc:290] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.149864 12069 consensus_queue.cc:1048] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260925 01:49:48.149915 12139 tablet.cc:1751] T 5ad258cd4788477ea5f9e34ebcab95c7 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260925 01:49:48.154737 11176 leader_election.cc:343] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.155738 11176 leader_election.cc:304] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:48.158152 11851 raft_consensus.cc:2749] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:48.160826 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4eb584e929c46f891d28ad01e6d78ae consensus state has no leader
I20260925 01:49:48.161330 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_829039e8b63d479fa41bd9317e0e96fd" } new_table_name: "default.Table_480c7744a1b04253963bcf3fd3d1ba10" modify_external_catalogs: true
I20260925 01:49:48.162351 12080 raft_consensus.cc:493] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.162528 12080 raft_consensus.cc:515] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.163237 12080 leader_election.cc:290] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.167142 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9937c3776f549dea887ace26dae492c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.167495 11517 raft_consensus.cc:2468] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:48.168371 11754 tablet_bootstrap.cc:492] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:48.168473 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9937c3776f549dea887ace26dae492c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:48.168952 11754 ts_tablet_manager.cc:1403] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.200s user 0.014s sys 0.029s
I20260925 01:49:48.170303 11754 raft_consensus.cc:359] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.170709 11754 raft_consensus.cc:385] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.170812 11754 raft_consensus.cc:740] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.171064 11314 leader_election.cc:304] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:48.171430 12080 raft_consensus.cc:2804] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.171634 12080 raft_consensus.cc:493] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.171789 12080 raft_consensus.cc:3060] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.172048 11754 consensus_queue.cc:260] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.172742 11754 ts_tablet_manager.cc:1434] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
W20260925 01:49:48.175590 11314 leader_election.cc:343] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.176761 11754 tablet_bootstrap.cc:492] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:48.110018 11946 ts_tablet_manager.cc:1950] T ad1cbf07e15440c7919a4bbcd937fb53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:48.182150 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 19) took 1861 ms. Trace:
I20260925 01:49:48.182327 11946 rpcz_store.cc:276] 0925 01:49:46.320968 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.321065 (+ 97us) service_pool.cc:224] Handling call
0925 01:49:48.051899 (+1730834us) ts_tablet_manager.cc:1151] Deleting tablet ad1cbf07e15440c7919a4bbcd937fb53
0925 01:49:48.051974 (+ 75us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.105499 (+ 53525us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.109334 (+ 3835us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.182032 (+ 72698us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1730347}
I20260925 01:49:48.182945 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ad1cbf07e15440c7919a4bbcd937fb53 (table default.Table_00be63d6c7f14b3d9fe02213f2b47430 [id=8b010808af904c9e8948017b036169ab]) successfully deleted
I20260925 01:49:48.189301 11754 tablet_bootstrap.cc:654] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.190742 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:49:48.191402 11675 catalog_manager.cc:6934] ReplaceTablet: tablet ca17585cd523440ca1e9b754f3aedf8a deleted and replaced by tablet 01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:49:48.191879 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ab792e1485f44174b025aba98b817a48" } new_table_name: "default.Table_74d6bd8f3c2f4d0eaf3681f1fcf30edb" modify_external_catalogs: true
I20260925 01:49:48.192044 11946 tablet_replica.cc:333] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:48.192277 11946 raft_consensus.cc:2243] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.192441 11931 ts_tablet_manager.cc:1929] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:48.192529 11946 raft_consensus.cc:2272] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.192631 11931 log.cc:1199] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a3ec6c34d22241e5bda3ec6665a47fc7
I20260925 01:49:48.193208 11931 ts_tablet_manager.cc:1950] T a3ec6c34d22241e5bda3ec6665a47fc7 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:48.194198 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 42) took 1622 ms. Trace:
I20260925 01:49:48.195864 11931 rpcz_store.cc:276] 0925 01:49:46.571943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.571992 (+ 49us) service_pool.cc:224] Handling call
0925 01:49:48.035897 (+1463905us) ts_tablet_manager.cc:1151] Deleting tablet a3ec6c34d22241e5bda3ec6665a47fc7
0925 01:49:48.035910 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.134649 (+ 98739us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.191126 (+ 56477us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.194149 (+ 3023us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1463606}
I20260925 01:49:48.196313 11931 tablet_replica.cc:333] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.197155 12135 consensus_queue.cc:1048] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:48.197669 11946 ts_tablet_manager.cc:1916] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.201041 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a3ec6c34d22241e5bda3ec6665a47fc7 (table default.Table_854ab4951a1b404a99eb1caa32ea46e0 [id=2df4a02c11a14e6584003a727651841e]) successfully deleted
I20260925 01:49:48.201352 11753 tablet_bootstrap.cc:492] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:48.201529 11753 ts_tablet_manager.cc:1403] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.233s user 0.003s sys 0.005s
I20260925 01:49:48.201821 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet ca17585cd523440ca1e9b754f3aedf8a with delete_type TABLET_DATA_DELETED (replaced by tablet 01d50e428bfc46caa130f96ccc7e8f40) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.202543 11753 raft_consensus.cc:359] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.202769 11753 raft_consensus.cc:385] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.202780 11965 raft_consensus.cc:493] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.202883 11753 raft_consensus.cc:740] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.202958 11965 raft_consensus.cc:515] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.203186 11753 consensus_queue.cc:260] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.203785 11965 leader_election.cc:290] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.209314 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.209517 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3da92b7f256647f19faeed66b4012438
I20260925 01:49:48.209619 11519 raft_consensus.cc:2468] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:48.210083 11176 leader_election.cc:304] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.210836 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:48.211452 11753 ts_tablet_manager.cc:1434] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260925 01:49:48.211916 11931 raft_consensus.cc:2243] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.212111 11931 raft_consensus.cc:2272] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:48.215708 11177 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.216657 11753 tablet_bootstrap.cc:492] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:48.216641 11931 ts_tablet_manager.cc:1916] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.218530 11753 tablet_bootstrap.cc:654] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:48.219972 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa619556e5af473998080f4bbc9e5d1e consensus state has no leader
I20260925 01:49:48.223098 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet ca17585cd523440ca1e9b754f3aedf8a with delete_type TABLET_DATA_DELETED (replaced by tablet 01d50e428bfc46caa130f96ccc7e8f40) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.224809 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65068a447744ec99e56489963b251c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.225492 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.226552 11965 raft_consensus.cc:2804] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.229184 11965 raft_consensus.cc:493] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.233446 11965 raft_consensus.cc:3060] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.236334 11755 tablet_bootstrap.cc:492] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:48.236675 11755 ts_tablet_manager.cc:1403] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.140s user 0.001s sys 0.002s
I20260925 01:49:48.239902 11931 ts_tablet_manager.cc:1929] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:48.240101 11931 log.cc:1199] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/31fe174270f24ff780c212eaef90ef0d
I20260925 01:49:48.240489 11946 ts_tablet_manager.cc:1929] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.240566 11931 ts_tablet_manager.cc:1950] T 31fe174270f24ff780c212eaef90ef0d P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:48.240686 11946 log.cc:1199] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/9884d7af60324a24ad06d6fa5db358b2
I20260925 01:49:48.241263 11946 ts_tablet_manager.cc:1950] T 9884d7af60324a24ad06d6fa5db358b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:48.241784 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da92b7f256647f19faeed66b4012438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.242986 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da92b7f256647f19faeed66b4012438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.245289 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 43) took 1672 ms. Trace:
I20260925 01:49:48.245390 11931 rpcz_store.cc:276] 0925 01:49:46.572674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.572721 (+ 47us) service_pool.cc:224] Handling call
0925 01:49:48.196219 (+1623498us) ts_tablet_manager.cc:1151] Deleting tablet 31fe174270f24ff780c212eaef90ef0d
0925 01:49:48.196242 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.233555 (+ 37313us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.239796 (+ 6241us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.245230 (+ 5434us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1623284}
I20260925 01:49:48.247481 11931 tablet_replica.cc:333] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.247709 11931 raft_consensus.cc:2243] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:48.248215 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 31fe174270f24ff780c212eaef90ef0d (table default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d]) successfully deleted
I20260925 01:49:48.250368 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 3da92b7f256647f19faeed66b4012438 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.251050 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet ca17585cd523440ca1e9b754f3aedf8a with delete_type TABLET_DATA_DELETED (replaced by tablet 01d50e428bfc46caa130f96ccc7e8f40) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.251264 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 105fd502b74d442eb5d5031f56e5cb62 with delete_type TABLET_DATA_DELETED (replaced by tablet 00906edfa6b648229bcba8e59d68b969) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.251842 11931 raft_consensus.cc:2272] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.256534 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 491d790067644090aa4d25f4060cc2ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.256814 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 22) took 1935 ms. Trace:
I20260925 01:49:48.256979 11946 rpcz_store.cc:276] 0925 01:49:46.321352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.321406 (+ 54us) service_pool.cc:224] Handling call
0925 01:49:48.191811 (+1870405us) ts_tablet_manager.cc:1151] Deleting tablet 9884d7af60324a24ad06d6fa5db358b2
0925 01:49:48.191824 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.236826 (+ 45002us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.240368 (+ 3542us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.256762 (+ 16394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1870207}
I20260925 01:49:48.257315 12080 raft_consensus.cc:515] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.257566 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 9884d7af60324a24ad06d6fa5db358b2 (table default.Table_fbdf63c5c7d641c58cb07c1933e7212d [id=65e9375237aa43ee950d4883b6028392]) successfully deleted
I20260925 01:49:48.258283 12080 leader_election.cc:290] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.258950 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9937c3776f549dea887ace26dae492c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:48.258952 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9937c3776f549dea887ace26dae492c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:48.259161 11519 raft_consensus.cc:3060] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.262272 12135 raft_consensus.cc:493] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.261794 11931 ts_tablet_manager.cc:1916] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.262450 12135 raft_consensus.cc:515] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.263242 11519 raft_consensus.cc:2468] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:48.263401 12135 leader_election.cc:290] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.263577 12135 raft_consensus.cc:493] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.263727 12135 raft_consensus.cc:515] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.264554 12135 leader_election.cc:290] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.264914 11753 tablet_bootstrap.cc:492] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:48.265101 11753 ts_tablet_manager.cc:1403] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.053s user 0.005s sys 0.001s
W20260925 01:49:48.266105 11314 leader_election.cc:343] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.270237 11314 leader_election.cc:304] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:48.270335 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:48.270573 11236 raft_consensus.cc:2468] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:48.270982 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d208d580a2c4c27bd614ccc88088384" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:48.271477 11753 raft_consensus.cc:359] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.271802 11753 raft_consensus.cc:385] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.271900 11456 leader_election.cc:304] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.271947 11753 raft_consensus.cc:740] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.272334 12135 raft_consensus.cc:2804] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.272470 12135 raft_consensus.cc:493] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.272557 12135 raft_consensus.cc:3060] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.272348 11753 consensus_queue.cc:260] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.273447 11753 ts_tablet_manager.cc:1434] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260925 01:49:48.273682 12080 raft_consensus.cc:2804] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:48.273955 12080 raft_consensus.cc:697] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:48.274277 11946 tablet_replica.cc:333] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:48.276970 11753 tablet_bootstrap.cc:492] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:48.283154 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d208d580a2c4c27bd614ccc88088384" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:48.284614 11965 raft_consensus.cc:515] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.283149 12080 consensus_queue.cc:237] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.286947 11380 raft_consensus.cc:2468] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:49:48.288003 11176 consensus_peers.cc:597] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:48.288559 11946 raft_consensus.cc:2243] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:48.289103 11953 ts_tablet_manager.cc:1929] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.289250 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:48.289357 11946 pending_rounds.cc:70] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
W20260925 01:49:48.289959 11456 leader_election.cc:343] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.290019 11965 leader_election.cc:290] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.290694 11457 leader_election.cc:304] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:48.291618 11457 leader_election.cc:343] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.291966 12135 raft_consensus.cc:515] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.293578 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:48.293708 11946 pending_rounds.cc:77] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072837212053504 op_type: NO_OP noop_request { }
I20260925 01:49:48.293831 11239 raft_consensus.cc:3060] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.293830 11946 raft_consensus.cc:2889] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:48.293951 11946 raft_consensus.cc:2272] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.294250 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:48.294263 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ca88ffeaae4a4f1999cf9834715b791b" } modify_external_catalogs: true
I20260925 01:49:48.294435 11519 raft_consensus.cc:3060] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.294487 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ca88ffeaae4a4f1999cf9834715b791b" } modify_external_catalogs: true
I20260925 01:49:48.294678 11946 ts_tablet_manager.cc:1916] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.295356 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_901ce728b66a4e0aa595efc09462e77c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:48.295578 11931 ts_tablet_manager.cc:1929] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.295691 11931 log.cc:1199] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c75a4ed161734d30ab5ad2e2b00d77c9
W20260925 01:49:48.296073 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_901ce728b66a4e0aa595efc09462e77c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.296104 11931 ts_tablet_manager.cc:1950] T c75a4ed161734d30ab5ad2e2b00d77c9 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:48.296995 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 22) took 1750 ms. Trace:
I20260925 01:49:48.297106 11931 rpcz_store.cc:276] 0925 01:49:46.547027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.573108 (+ 26081us) service_pool.cc:224] Handling call
0925 01:49:48.247355 (+1674247us) ts_tablet_manager.cc:1151] Deleting tablet c75a4ed161734d30ab5ad2e2b00d77c9
0925 01:49:48.247369 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.278757 (+ 31388us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.295477 (+ 16720us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.296954 (+ 1477us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1673982}
I20260925 01:49:48.297508 11931 tablet_replica.cc:333] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.297506 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_34d61a42397f4e9ca0d0364c26827c95" } new_table_name: "default.Table_b294b68c22864c009d79e9fb833ba9f1" modify_external_catalogs: true
I20260925 01:49:48.297684 11519 raft_consensus.cc:2468] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:48.297724 11931 raft_consensus.cc:2243] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.297894 11931 raft_consensus.cc:2272] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.298377 11176 leader_election.cc:304] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.298535 11931 ts_tablet_manager.cc:1916] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.298935 11753 tablet_bootstrap.cc:654] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.298946 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c75a4ed161734d30ab5ad2e2b00d77c9 (table default.Table_8f04a495ad294ac38a1fe39d586033d7 [id=3414ecadb9c24609b4011cc0ba7c73dd]) successfully deleted
I20260925 01:49:48.299355 11755 raft_consensus.cc:359] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.299401 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b6efeae552494a8a9e6f6970c7b0dce0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:48.299587 11755 raft_consensus.cc:385] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.299655 11755 raft_consensus.cc:740] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.299902 11755 consensus_queue.cc:260] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:48.299973 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6efeae552494a8a9e6f6970c7b0dce0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.300469 11755 ts_tablet_manager.cc:1434] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.064s user 0.002s sys 0.002s
I20260925 01:49:48.300817 11755 tablet_bootstrap.cc:492] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:48.301184 11239 raft_consensus.cc:2468] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:48.301746 11456 leader_election.cc:304] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.302122 12021 raft_consensus.cc:2804] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:48.302312 12021 raft_consensus.cc:697] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:48.302572 12021 consensus_queue.cc:237] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.303149 11953 log.cc:1199] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:48.305822 11953 ts_tablet_manager.cc:1950] T a65faada47c34cd1908970460d3d3f6b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:48.306820 12135 leader_election.cc:290] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.308009 12137 raft_consensus.cc:2804] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.308205 12137 raft_consensus.cc:493] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.308338 12137 raft_consensus.cc:3060] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.308669 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:49:48.309474 11457 leader_election.cc:343] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.311156 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f8618e0dcc354193b6014b7fea7f7698"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.311957 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8618e0dcc354193b6014b7fea7f7698 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.312496 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 25) took 2022 ms. Trace:
I20260925 01:49:48.313941 11953 rpcz_store.cc:276] 0925 01:49:46.285831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.285879 (+ 48us) service_pool.cc:224] Handling call
0925 01:49:48.068958 (+1783079us) ts_tablet_manager.cc:1151] Deleting tablet a65faada47c34cd1908970460d3d3f6b
0925 01:49:48.068973 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.116351 (+ 47378us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.272685 (+156334us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.308378 (+ 35693us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1782731}
I20260925 01:49:48.314257 12137 raft_consensus.cc:515] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.314402 11953 tablet_replica.cc:333] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:48.315014 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a65faada47c34cd1908970460d3d3f6b (table default.Table_27810a101f1848a1b8319368749cf79a [id=b931f965b8bf4871849dc5a4613dc04b]) successfully deleted
I20260925 01:49:48.316349 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:48.316880 11953 raft_consensus.cc:2243] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:49:48.316985 11177 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.317276 11953 raft_consensus.cc:2272] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.319110 11953 ts_tablet_manager.cc:1916] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.328794 11965 raft_consensus.cc:2804] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:48.329538 11965 raft_consensus.cc:697] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:48.330416 11965 consensus_queue.cc:237] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:48.338596 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7496a9eaa1714e9fa83d8c88bf1070fd consensus state has no leader
I20260925 01:49:48.339740 11755 tablet_bootstrap.cc:654] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.344769 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea" } modify_external_catalogs: true
I20260925 01:49:48.345170 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea" } modify_external_catalogs: true
I20260925 01:49:48.346405 12079 raft_consensus.cc:493] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.348861 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:48.349136 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 5ad258cd4788477ea5f9e34ebcab95c7 (table default.Table_61ad0d49c2ce46bb9dae128a9ec6e57c [id=11c060efa51b4e6eb7bc0a8a9af86938]). Expected version 2 got 0
I20260925 01:49:48.349371 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 2 got 0
I20260925 01:49:48.349730 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88]). Expected version 2 got 0
I20260925 01:49:48.349920 12079 raft_consensus.cc:515] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:48.350927 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9944a1422d14ae2b22451e67c477d5b has no consensus state
I20260925 01:49:48.350988 12079 leader_election.cc:290] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.351429 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1468fd0ad2304074b7b97fa271e71d10" } modify_external_catalogs: true
I20260925 01:49:48.351714 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1468fd0ad2304074b7b97fa271e71d10" } modify_external_catalogs: true
I20260925 01:49:48.352221 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:48.352871 11314 leader_election.cc:343] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.356904 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4eb401244d9d45b0b4edf95aa734f197"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:48.357697 11953 ts_tablet_manager.cc:1929] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260925 01:49:48.357743 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4eb401244d9d45b0b4edf95aa734f197 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.358296 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet c75a4ed161734d30ab5ad2e2b00d77c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.359560 11953 log.cc:1199] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/9884d7af60324a24ad06d6fa5db358b2
I20260925 01:49:48.361225 11953 ts_tablet_manager.cc:1950] T 9884d7af60324a24ad06d6fa5db358b2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:48.364732 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 75a8e09b8838443c9bfff440ff1f877d (DEFAULT_TABLE table=default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea [id=22de07c9013f4c3ab9568e926ea5b8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.365259 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a8e09b8838443c9bfff440ff1f877d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.372368 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 75a8e09b8838443c9bfff440ff1f877d (DEFAULT_TABLE table=default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea [id=22de07c9013f4c3ab9568e926ea5b8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.372748 12080 raft_consensus.cc:493] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.373101 12080 raft_consensus.cc:515] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.374473 12080 leader_election.cc:290] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.375438 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 93329036763146beb8e6a9b039cc1ec1 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.376080 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 93329036763146beb8e6a9b039cc1ec1 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.378995 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 41c4a23d974f4daea7a274eccd661d5c (DEFAULT_TABLE table=default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.379501 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]). Expected version 1 got 0
I20260925 01:49:48.379798 11671 catalog_manager.cc:5838] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:48.380227 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 2 got 0
I20260925 01:49:48.381399 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb4dac3099346a7975229d472a3919e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:48.384985 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c4a23d974f4daea7a274eccd661d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.387493 11239 raft_consensus.cc:2468] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:48.387818 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 41c4a23d974f4daea7a274eccd661d5c (DEFAULT_TABLE table=default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.388500 11314 leader_election.cc:304] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.388870 12080 raft_consensus.cc:2804] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.388980 12080 raft_consensus.cc:493] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.389103 12080 raft_consensus.cc:3060] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.392864 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93329036763146beb8e6a9b039cc1ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.392690 12080 raft_consensus.cc:515] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.393548 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93329036763146beb8e6a9b039cc1ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.394325 11218 tablet_service.cc:1511] Processing CreateTablet for tablet c28c8f00a8634ef89e4773b62e095b74 (DEFAULT_TABLE table=default.Table_a51db57fcb214a8289f9ac66be21414f [id=bb36d144a12e4176974ca7119a4681c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.394181 12080 leader_election.cc:290] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.394610 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a8e09b8838443c9bfff440ff1f877d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.395713 11755 tablet_bootstrap.cc:492] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:48.395910 11755 ts_tablet_manager.cc:1403] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.095s user 0.008s sys 0.016s
I20260925 01:49:48.395823 11360 tablet_service.cc:1511] Processing CreateTablet for tablet c28c8f00a8634ef89e4773b62e095b74 (DEFAULT_TABLE table=default.Table_a51db57fcb214a8289f9ac66be21414f [id=bb36d144a12e4176974ca7119a4681c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.397512 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c4a23d974f4daea7a274eccd661d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.397380 11755 raft_consensus.cc:359] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:48.397655 11755 raft_consensus.cc:385] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.398380 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28c8f00a8634ef89e4773b62e095b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.400681 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28c8f00a8634ef89e4773b62e095b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.402166 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc (DEFAULT_TABLE table=default.Table_24b699e047024e59a09f3a00feb33cef [id=46f2129d44b04761bcacacc0cbe6e932]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:48.405925 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 85d859207bbc4aefb26c726dce404c44 consensus state has no leader
I20260925 01:49:48.407511 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fd114e03807f4a78964e4057de720bfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.408241 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd114e03807f4a78964e4057de720bfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.409725 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_467dcbd96d384165bd59850e07759dae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.410475 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_467dcbd96d384165bd59850e07759dae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.412083 11755 raft_consensus.cc:740] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.413094 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:49:48.414753 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.415757 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.415215 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb4dac3099346a7975229d472a3919e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:48.416780 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dbc161952ab34588b1d6c6712c99d4d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.417367 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbc161952ab34588b1d6c6712c99d4d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.419878 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.420337 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 26) took 2114 ms. Trace:
I20260925 01:49:48.420526 11953 rpcz_store.cc:276] 0925 01:49:46.297123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.297183 (+ 60us) service_pool.cc:224] Handling call
0925 01:49:48.314329 (+2017146us) ts_tablet_manager.cc:1151] Deleting tablet 9884d7af60324a24ad06d6fa5db358b2
0925 01:49:48.314339 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.352975 (+ 38636us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.357615 (+ 4640us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.411837 (+ 54222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016927}
I20260925 01:49:48.420719 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ef187190ed9e4b7d910df53df764f469"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.422854 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef187190ed9e4b7d910df53df764f469 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.422248 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 9884d7af60324a24ad06d6fa5db358b2 (table default.Table_fbdf63c5c7d641c58cb07c1933e7212d [id=65e9375237aa43ee950d4883b6028392]) successfully deleted
I20260925 01:49:48.425040 11239 raft_consensus.cc:3060] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.426657 11754 tablet_bootstrap.cc:492] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:48.426838 11754 ts_tablet_manager.cc:1403] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.254s user 0.003s sys 0.019s
I20260925 01:49:48.428725 11953 tablet_replica.cc:333] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:48.429015 11953 raft_consensus.cc:2243] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.429244 11953 raft_consensus.cc:2272] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.429935 11953 ts_tablet_manager.cc:1916] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.430603 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d208d580a2c4c27bd614ccc88088384" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:48.430853 11375 raft_consensus.cc:3060] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.431360 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc (DEFAULT_TABLE table=default.Table_24b699e047024e59a09f3a00feb33cef [id=46f2129d44b04761bcacacc0cbe6e932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.431953 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.436890 11754 raft_consensus.cc:359] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:48.437124 11754 raft_consensus.cc:385] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.437222 11754 raft_consensus.cc:740] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.437474 11754 consensus_queue.cc:260] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:48.437767 11239 raft_consensus.cc:2468] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:48.438213 11754 ts_tablet_manager.cc:1434] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260925 01:49:48.438585 11754 tablet_bootstrap.cc:492] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:48.440145 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 96b68399843a422b8da3ddfab2c522e6 (DEFAULT_TABLE table=default.Table_d1c22bbeca5e4b81b4cf081fa2b71351 [id=74fd2e729fe648ab90e6e4e9876d28f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.440655 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b68399843a422b8da3ddfab2c522e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.443562 12137 leader_election.cc:290] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.448606 11314 leader_election.cc:304] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.449625 12080 raft_consensus.cc:2804] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:48.454301 11931 ts_tablet_manager.cc:1929] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:48.456254 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 93329036763146beb8e6a9b039cc1ec1 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.458477 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 1c29e410731842aeb64ab8eeb4ccc3ca (DEFAULT_TABLE table=default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.458832 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.461395 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93329036763146beb8e6a9b039cc1ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.461870 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 331380a2be9a4893927c9b94a2c3e08b
I20260925 01:49:48.462834 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet 7900db92b35048aaa200ed3183031d6b from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:48.463125 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 75a8e09b8838443c9bfff440ff1f877d (DEFAULT_TABLE table=default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea [id=22de07c9013f4c3ab9568e926ea5b8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.463356 11680 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 46613b1c704e4f2abaabbf76a51577a2
I20260925 01:49:48.463716 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet 331380a2be9a4893927c9b94a2c3e08b from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:48.465715 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb4dac3099346a7975229d472a3919e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.466799 11498 tablet_service.cc:1511] Processing CreateTablet for tablet c28c8f00a8634ef89e4773b62e095b74 (DEFAULT_TABLE table=default.Table_a51db57fcb214a8289f9ac66be21414f [id=bb36d144a12e4176974ca7119a4681c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.467460 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28c8f00a8634ef89e4773b62e095b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.475252 11755 consensus_queue.cc:260] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:48.470453 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 41c4a23d974f4daea7a274eccd661d5c (DEFAULT_TABLE table=default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.475934 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet 018525730c4e4134ab3a0506f1a0a6fa from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:48.478478 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 75a8e09b8838443c9bfff440ff1f877d
I20260925 01:49:48.478791 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8a3eca1199d84ef283c1a1578f44c935" } new_table_name: "default.Table_c33c7eb6481e4876aed3d7038afa9f93" modify_external_catalogs: true
I20260925 01:49:48.479461 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet b05053f5646f4748a99647b7dbfae686 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:48.476192 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb4dac3099346a7975229d472a3919e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:48.480175 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5d51a637d33345a78febdb5961f81e19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.481076 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d51a637d33345a78febdb5961f81e19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.481632 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c4a23d974f4daea7a274eccd661d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.482033 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a8e09b8838443c9bfff440ff1f877d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.482226 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc (DEFAULT_TABLE table=default.Table_24b699e047024e59a09f3a00feb33cef [id=46f2129d44b04761bcacacc0cbe6e932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.482762 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.474741 11375 raft_consensus.cc:2468] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:48.485999 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d208d580a2c4c27bd614ccc88088384" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:48.486451 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 331380a2be9a4893927c9b94a2c3e08b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.490130 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c29e410731842aeb64ab8eeb4ccc3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.490955 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.496186 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 75a8e09b8838443c9bfff440ff1f877d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.496971 11931 log.cc:1199] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/06b59e1505e246d2abada79299e09bfe
I20260925 01:49:48.498587 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 96b68399843a422b8da3ddfab2c522e6 (DEFAULT_TABLE table=default.Table_d1c22bbeca5e4b81b4cf081fa2b71351 [id=74fd2e729fe648ab90e6e4e9876d28f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.502818 12080 raft_consensus.cc:697] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:48.504913 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 75a8e09b8838443c9bfff440ff1f877d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.507364 11484 tablet_service.cc:1511] Processing CreateTablet for tablet b60706e2087b4ec7b63f6747534a4b0f (DEFAULT_TABLE table=default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:48.507364 11456 leader_election.cc:343] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.508534 11965 consensus_queue.cc:1048] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260925 01:49:48.508749 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 331380a2be9a4893927c9b94a2c3e08b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.505878 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 96b68399843a422b8da3ddfab2c522e6 (DEFAULT_TABLE table=default.Table_d1c22bbeca5e4b81b4cf081fa2b71351 [id=74fd2e729fe648ab90e6e4e9876d28f0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:48.515009 11314 leader_election.cc:343] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.517719 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_32aa0edcb40b42d39d7a738c77b857fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.518417 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32aa0edcb40b42d39d7a738c77b857fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.518666 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 1c29e410731842aeb64ab8eeb4ccc3ca (DEFAULT_TABLE table=default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.520771 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b68399843a422b8da3ddfab2c522e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.521274 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60706e2087b4ec7b63f6747534a4b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.523413 11214 tablet_service.cc:1511] Processing CreateTablet for tablet b60706e2087b4ec7b63f6747534a4b0f (DEFAULT_TABLE table=default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.523887 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60706e2087b4ec7b63f6747534a4b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.526134 11491 tablet_service.cc:1511] Processing CreateTablet for tablet a9944a1422d14ae2b22451e67c477d5b (DEFAULT_TABLE table=default.Table_1a15ff4030084c1c84fadccb984297e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.526515 11754 tablet_bootstrap.cc:654] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.528558 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c29e410731842aeb64ab8eeb4ccc3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.528952 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 (DEFAULT_TABLE table=default.Table_5036ab1f1580484c8b9367dfab1a8a84 [id=a7cc09b27b1b463a982f1f4266bdf7fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.529708 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9944a1422d14ae2b22451e67c477d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.530256 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1abd3c2cb34915a595ea73a8d10743. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:48.532970 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67921f86c4f6422e97d7f306262569f8 consensus state has no leader
I20260925 01:49:48.535403 11755 ts_tablet_manager.cc:1434] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.093s user 0.002s sys 0.002s
I20260925 01:49:48.538110 11210 tablet_service.cc:1511] Processing CreateTablet for tablet a9944a1422d14ae2b22451e67c477d5b (DEFAULT_TABLE table=default.Table_1a15ff4030084c1c84fadccb984297e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.542037 11314 leader_election.cc:304] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:48.543339 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 331380a2be9a4893927c9b94a2c3e08b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.543933 12080 consensus_queue.cc:237] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.545603 11755 tablet_bootstrap.cc:492] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:48.543174 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9944a1422d14ae2b22451e67c477d5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.549392 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_74d6bd8f3c2f4d0eaf3681f1fcf30edb" } new_table_name: "default.Table_f181f1f48a334b48aeda73e37c8c7a61" modify_external_catalogs: true
I20260925 01:49:48.549453 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 1c29e410731842aeb64ab8eeb4ccc3ca (DEFAULT_TABLE table=default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.551167 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dec5804091454eb1a0d870700050c904" } modify_external_catalogs: true
I20260925 01:49:48.551256 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dbc161952ab34588b1d6c6712c99d4d9" } new_table_name: "default.Table_78fa9227d15c432fb2a7b5f1bba2b14c" modify_external_catalogs: true
I20260925 01:49:48.551448 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dec5804091454eb1a0d870700050c904" } modify_external_catalogs: true
I20260925 01:49:48.552146 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b68399843a422b8da3ddfab2c522e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.552240 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_40519dcfbe2e470ca48f0351bf0ea7cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.552889 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40519dcfbe2e470ca48f0351bf0ea7cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.554097 11931 ts_tablet_manager.cc:1950] T 06b59e1505e246d2abada79299e09bfe P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:49:48.558118 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 55910.7us
I20260925 01:49:48.558130 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 (DEFAULT_TABLE table=default.Table_5036ab1f1580484c8b9367dfab1a8a84 [id=a7cc09b27b1b463a982f1f4266bdf7fd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:48.558557 11314 leader_election.cc:343] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.562168 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aac094552c1d4facaaacca78cda958e1" } new_table_name: "default.Table_260512e222a64aae83a308a6de0b4843" modify_external_catalogs: true
I20260925 01:49:48.562827 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1abd3c2cb34915a595ea73a8d10743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.568885 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 75a8e09b8838443c9bfff440ff1f877d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.569137 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c29e410731842aeb64ab8eeb4ccc3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.574406 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7900db92b35048aaa200ed3183031d6b
I20260925 01:49:48.575255 11678 catalog_manager.cc:6934] ReplaceTablet: tablet 7900db92b35048aaa200ed3183031d6b deleted and replaced by tablet bdf7f544827d4bca97aa6b63c0c48c0d
W20260925 01:49:48.578192 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f778b87d307483b9edb17dce7355a65 has no consensus state
I20260925 01:49:48.578543 12105 raft_consensus.cc:2749] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:48.579500 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7496a9eaa1714e9fa83d8c88bf1070fd consensus state has no leader
I20260925 01:49:48.580945 11341 tablet_service.cc:1511] Processing CreateTablet for tablet a9944a1422d14ae2b22451e67c477d5b (DEFAULT_TABLE table=default.Table_1a15ff4030084c1c84fadccb984297e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.581537 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9944a1422d14ae2b22451e67c477d5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:48.585215 11314 leader_election.cc:343] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.586283 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 45) took 2001 ms. Trace:
I20260925 01:49:48.586485 11931 rpcz_store.cc:276] 0925 01:49:46.574145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.574193 (+ 48us) service_pool.cc:224] Handling call
0925 01:49:48.297438 (+1723245us) ts_tablet_manager.cc:1151] Deleting tablet 06b59e1505e246d2abada79299e09bfe
0925 01:49:48.297451 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.369322 (+ 71871us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.454200 (+ 84878us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.575638 (+121438us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1723038}
I20260925 01:49:48.587036 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 (DEFAULT_TABLE table=default.Table_5036ab1f1580484c8b9367dfab1a8a84 [id=a7cc09b27b1b463a982f1f4266bdf7fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.587138 12079 raft_consensus.cc:493] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.587220 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 06b59e1505e246d2abada79299e09bfe (table default.Table_63b71c4cf1634d2aa8b517954ab683c8 [id=17b11380da7c42e0b51c4d6301d5789d]) successfully deleted
I20260925 01:49:48.587389 12079 raft_consensus.cc:515] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:48.587703 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1abd3c2cb34915a595ea73a8d10743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.590420 11351 tablet_service.cc:1511] Processing CreateTablet for tablet b60706e2087b4ec7b63f6747534a4b0f (DEFAULT_TABLE table=default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.593137 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 44) took 2019 ms. Trace:
I20260925 01:49:48.593257 11931 rpcz_store.cc:276] 0925 01:49:46.573448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.574379 (+ 931us) service_pool.cc:224] Handling call
0925 01:49:48.586877 (+2012498us) ts_tablet_manager.cc:1151] Deleting tablet ccffbe61eea34333abdc6da94612c0f6
0925 01:49:48.586893 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.593073 (+ 6180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2012318}
W20260925 01:49:48.593815 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ccffbe61eea34333abdc6da94612c0f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccffbe61eea34333abdc6da94612c0f6 already in progress: creating tablet
I20260925 01:49:48.594435 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 47) took 2018 ms. Trace:
I20260925 01:49:48.594529 11931 rpcz_store.cc:276] 0925 01:49:46.575543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.575591 (+ 48us) service_pool.cc:224] Handling call
0925 01:49:48.594250 (+2018659us) ts_tablet_manager.cc:1151] Deleting tablet bb98d5a38f43450c80d057d9eb2f92d1
0925 01:49:48.594261 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.594367 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2018440}
W20260925 01:49:48.594944 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bb98d5a38f43450c80d057d9eb2f92d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb98d5a38f43450c80d057d9eb2f92d1 already in progress: creating tablet
I20260925 01:49:48.595434 11931 tablet_replica.cc:333] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.595714 11931 raft_consensus.cc:2243] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.596014 11931 raft_consensus.cc:2272] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.596087 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 7900db92b35048aaa200ed3183031d6b with delete_type TABLET_DATA_DELETED (replaced by tablet bdf7f544827d4bca97aa6b63c0c48c0d) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:48.601042 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 927bc1194884470e9fc977ca870f1b0c consensus state has no leader
I20260925 01:49:48.601168 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60706e2087b4ec7b63f6747534a4b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.601929 12021 raft_consensus.cc:493] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.602133 12021 raft_consensus.cc:515] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.602824 12021 leader_election.cc:290] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.606359 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 7900db92b35048aaa200ed3183031d6b with delete_type TABLET_DATA_DELETED (replaced by tablet bdf7f544827d4bca97aa6b63c0c48c0d) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.608585 11931 ts_tablet_manager.cc:1916] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.610529 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5d51a637d33345a78febdb5961f81e19" } new_table_name: "default.Table_8607be532f504f14a18016d06256ba4c" modify_external_catalogs: true
I20260925 01:49:48.612660 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bb67fea9df444e16a94bb2a276fc99be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.613273 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb67fea9df444e16a94bb2a276fc99be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.615533 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fea39c1d72644363a905c7285f20a052" } modify_external_catalogs: true
I20260925 01:49:48.615922 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fea39c1d72644363a905c7285f20a052" } modify_external_catalogs: true
W20260925 01:49:48.616253 11456 leader_election.cc:343] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a3ec6c34d22241e5bda3ec6665a47fc7
I20260925 01:49:48.617761 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4adf83738ae7445bbbe57ce8e26c87ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:48.618867 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4adf83738ae7445bbbe57ce8e26c87ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:48.622745 12079 leader_election.cc:290] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.624501 11753 tablet_bootstrap.cc:492] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:48.624732 11753 ts_tablet_manager.cc:1403] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.350s user 0.004s sys 0.012s
I20260925 01:49:48.625969 11753 raft_consensus.cc:359] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.626296 11753 raft_consensus.cc:385] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:48.626477 11753 raft_consensus.cc:740] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:48.626732 11753 consensus_queue.cc:260] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.627357 11753 ts_tablet_manager.cc:1434] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:49:48.627761 11753 tablet_bootstrap.cc:492] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:48.628486 11953 ts_tablet_manager.cc:1929] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:48.628659 11953 log.cc:1199] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c42d96d45e8c4e8e8bee374477cfb0bb
I20260925 01:49:48.632220 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770ebdbd355142ba86fd9eb8eaa844f4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.632566 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3ec6c34d22241e5bda3ec6665a47fc7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:48.632820 11372 raft_consensus.cc:2393] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:48.632822 11457 leader_election.cc:304] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:48.633523 12137 raft_consensus.cc:2804] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:48.633700 12137 raft_consensus.cc:697] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:48.634042 12137 consensus_queue.cc:237] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.635190 11953 ts_tablet_manager.cc:1950] T c42d96d45e8c4e8e8bee374477cfb0bb P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:49:48.636404 11666 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 67921f86c4f6422e97d7f306262569f8 (table default.Table_c33c7eb6481e4876aed3d7038afa9f93 [id=107d0cda55154f5e84ce4dd14d36364a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 67921f86c4f6422e97d7f306262569f8 consensus state has no leader
W20260925 01:49:48.637905 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e26b1dc65fc84629a72029519919ae23 has no consensus state
I20260925 01:49:48.648442 11755 tablet_bootstrap.cc:654] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.648030 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 27) took 2337 ms. Trace:
I20260925 01:49:48.650449 11953 rpcz_store.cc:276] 0925 01:49:46.298264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.298318 (+ 54us) service_pool.cc:224] Handling call
0925 01:49:48.420852 (+2122534us) ts_tablet_manager.cc:1151] Deleting tablet c42d96d45e8c4e8e8bee374477cfb0bb
0925 01:49:48.420863 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.446136 (+ 25273us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.627577 (+181441us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.635627 (+ 8050us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2122318}
I20260925 01:49:48.651015 11953 tablet_replica.cc:333] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:48.651254 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c42d96d45e8c4e8e8bee374477cfb0bb (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]) successfully deleted
W20260925 01:49:48.651427 11314 leader_election.cc:343] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.651773 11953 raft_consensus.cc:2243] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.652004 11953 raft_consensus.cc:2272] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.653390 11946 ts_tablet_manager.cc:1929] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.653599 11953 ts_tablet_manager.cc:1916] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.654510 11372 raft_consensus.cc:1275] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Refusing update from remote peer 514f31e4c2e54d9aaf6d4dd771d153b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:48.658594 11457 leader_election.cc:304] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:48.659085 12021 raft_consensus.cc:3060] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.666426 11946 log.cc:1199] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/afc1cd6e88764445b0a1fdc92e0c53e5
I20260925 01:49:48.668267 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 7900db92b35048aaa200ed3183031d6b with delete_type TABLET_DATA_DELETED (replaced by tablet bdf7f544827d4bca97aa6b63c0c48c0d) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.673060 11946 ts_tablet_manager.cc:1950] T afc1cd6e88764445b0a1fdc92e0c53e5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:48.674114 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 20) took 2352 ms. Trace:
I20260925 01:49:48.674443 11946 rpcz_store.cc:276] 0925 01:49:46.321075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.321412 (+ 337us) service_pool.cc:224] Handling call
0925 01:49:48.272444 (+1951032us) ts_tablet_manager.cc:1151] Deleting tablet afc1cd6e88764445b0a1fdc92e0c53e5
0925 01:49:48.272460 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.343782 (+ 71322us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.516447 (+172665us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.674020 (+157573us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1950756}
I20260925 01:49:48.675364 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet afc1cd6e88764445b0a1fdc92e0c53e5 (table default.Table_078cedcd7539492394b2472609504297 [id=df29f1da8f2e40a49c55d44c0a0e11f2]) successfully deleted
I20260925 01:49:48.675901 11946 tablet_replica.cc:333] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:48.676329 11946 raft_consensus.cc:2243] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.676697 11946 raft_consensus.cc:2272] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.698127 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770ebdbd355142ba86fd9eb8eaa844f4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:48.699186 11236 raft_consensus.cc:2468] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:48.700675 11314 leader_election.cc:304] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:48.701167 12079 raft_consensus.cc:2804] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.701285 12079 raft_consensus.cc:493] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.701375 12079 raft_consensus.cc:3060] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.705837 12079 raft_consensus.cc:515] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:48.709628 11239 raft_consensus.cc:1275] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Refusing update from remote peer 514f31e4c2e54d9aaf6d4dd771d153b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:48.710410 11851 raft_consensus.cc:493] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.710728 11851 raft_consensus.cc:515] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.713310 11953 ts_tablet_manager.cc:1929] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.713485 11953 log.cc:1199] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/4e008337914841b8a1ab4a64ecc6e181
I20260925 01:49:48.714758 11953 ts_tablet_manager.cc:1950] T 4e008337914841b8a1ab4a64ecc6e181 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:48.715258 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 28) took 2415 ms. Trace:
I20260925 01:49:48.715361 11953 rpcz_store.cc:276] 0925 01:49:46.299335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.299396 (+ 61us) service_pool.cc:224] Handling call
0925 01:49:48.650929 (+2351533us) ts_tablet_manager.cc:1151] Deleting tablet 4e008337914841b8a1ab4a64ecc6e181
0925 01:49:48.650943 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.687568 (+ 36625us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.713217 (+ 25649us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.715198 (+ 1981us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2351287}
I20260925 01:49:48.715973 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 4e008337914841b8a1ab4a64ecc6e181 (table default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d [id=4936b4c5822241e78c7004d9f7ba3f78]) successfully deleted
I20260925 01:49:48.717029 11851 leader_election.cc:290] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.717222 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 357963616763428fa69c7670e760f84e
I20260925 01:49:48.717473 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:48.717592 11953 tablet_replica.cc:333] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:48.717833 11953 raft_consensus.cc:2243] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:48.718263 11177 leader_election.cc:343] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.721096 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 357963616763428fa69c7670e760f84e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.721768 11931 ts_tablet_manager.cc:1929] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.721935 11931 log.cc:1199] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b0ad8ca37e3c49a4a03fc3460bf0bc5b
I20260925 01:49:48.722148 11953 raft_consensus.cc:2272] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.723048 11953 ts_tablet_manager.cc:1916] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.727321 11675 catalog_manager.cc:5838] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:48.729389 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4195e3f8e93e40fe9dfd72710d319dca
I20260925 01:49:48.731057 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 4195e3f8e93e40fe9dfd72710d319dca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.734243 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770ebdbd355142ba86fd9eb8eaa844f4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:48.734499 11236 raft_consensus.cc:3060] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.742910 11236 raft_consensus.cc:2468] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:48.745765 11671 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_84f0f4996f3d4d609ad1b68dfa611853 [id=f8317c3550b14fe3abf468ea0d755b88] alter complete (version 2)
I20260925 01:49:48.746331 12079 leader_election.cc:290] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.744616 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 4195e3f8e93e40fe9dfd72710d319dca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.745182 11931 ts_tablet_manager.cc:1950] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:48.748678 11314 leader_election.cc:304] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:48.749570 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 48) took 2173 ms. Trace:
I20260925 01:49:48.749751 11931 rpcz_store.cc:276] 0925 01:49:46.576271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.576317 (+ 46us) service_pool.cc:224] Handling call
0925 01:49:48.595254 (+2018937us) ts_tablet_manager.cc:1151] Deleting tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b
0925 01:49:48.595265 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.690859 (+ 95594us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.709445 (+ 18586us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.749500 (+ 40055us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2018732}
I20260925 01:49:48.750736 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b (table default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]) successfully deleted
I20260925 01:49:48.750754 12079 raft_consensus.cc:2804] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:48.751560 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 49) took 2174 ms. Trace:
I20260925 01:49:48.751763 11931 rpcz_store.cc:276] 0925 01:49:46.577129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.577184 (+ 55us) service_pool.cc:224] Handling call
0925 01:49:48.751347 (+2174163us) ts_tablet_manager.cc:1151] Deleting tablet c3289c6dc8e84a358f877a197412d901
0925 01:49:48.751370 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.751494 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2173970}
I20260925 01:49:48.751134 12079 raft_consensus.cc:697] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
W20260925 01:49:48.752839 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c3289c6dc8e84a358f877a197412d901 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3289c6dc8e84a358f877a197412d901 already in progress: creating tablet
I20260925 01:49:48.753568 11931 tablet_replica.cc:333] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.753832 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff85bac0d22416987e8e3b379154b09 (DEFAULT_TABLE table=default.Table_b6efeae552494a8a9e6f6970c7b0dce0 [id=6ea8e28751c84e1181aa299006fa643f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.753929 11931 raft_consensus.cc:2243] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.754195 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff85bac0d22416987e8e3b379154b09 (DEFAULT_TABLE table=default.Table_b6efeae552494a8a9e6f6970c7b0dce0 [id=6ea8e28751c84e1181aa299006fa643f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.754298 11931 raft_consensus.cc:2272] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.754338 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff85bac0d22416987e8e3b379154b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.754874 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff85bac0d22416987e8e3b379154b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.755172 11931 ts_tablet_manager.cc:1916] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.761129 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:48.762166 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_61ad0d49c2ce46bb9dae128a9ec6e57c [id=11c060efa51b4e6eb7bc0a8a9af86938] alter complete (version 2)
I20260925 01:49:48.763681 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e008337914841b8a1ab4a64ecc6e181 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.764058 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.764567 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet a65faada47c34cd1908970460d3d3f6b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:48.765551 11931 ts_tablet_manager.cc:1929] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:48.765733 11931 log.cc:1199] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c96165d1a85d4ee99748563078ae2a3e
I20260925 01:49:48.768967 11953 ts_tablet_manager.cc:1929] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:48.770334 11931 ts_tablet_manager.cc:1950] T c96165d1a85d4ee99748563078ae2a3e P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:48.771097 11953 log.cc:1199] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/da74fa4b6fa841b7aebb81302cab2885
I20260925 01:49:48.774108 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 (DEFAULT_TABLE table=default.Table_901ce728b66a4e0aa595efc09462e77c [id=77342c106aac476884403421439b8f52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.774638 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e96576354fe46bf9bfcde18f0a53390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.773727 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 (DEFAULT_TABLE table=default.Table_901ce728b66a4e0aa595efc09462e77c [id=77342c106aac476884403421439b8f52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.776604 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e96576354fe46bf9bfcde18f0a53390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.778952 11341 tablet_service.cc:1511] Processing CreateTablet for tablet a8c46e780d4a4987ad52619e4c3b46c9 (DEFAULT_TABLE table=default.Table_e973513b7c3d4c1dadf184056a92dad5 [id=a60aa9bcded3478f908ca2bdaafd1e41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.779387 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c46e780d4a4987ad52619e4c3b46c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.780790 12079 consensus_queue.cc:237] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:48.784132 11207 tablet_service.cc:1511] Processing CreateTablet for tablet a8c46e780d4a4987ad52619e4c3b46c9 (DEFAULT_TABLE table=default.Table_e973513b7c3d4c1dadf184056a92dad5 [id=a60aa9bcded3478f908ca2bdaafd1e41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.784548 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 (DEFAULT_TABLE table=default.Table_703892f2a488412e87acffbe309416fd [id=7dc2076323334c7494e7ea4e28a558a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.784685 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c46e780d4a4987ad52619e4c3b46c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.785178 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257e6f224f99427eb68fd61fa1aadae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.787830 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 (DEFAULT_TABLE table=default.Table_703892f2a488412e87acffbe309416fd [id=7dc2076323334c7494e7ea4e28a558a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.788348 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257e6f224f99427eb68fd61fa1aadae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.788527 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 (DEFAULT_TABLE table=default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.788899 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffeb9d70374afdb72a728d7b211d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.806098 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 (DEFAULT_TABLE table=default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.806818 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffeb9d70374afdb72a728d7b211d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.808032 11204 tablet_service.cc:1511] Processing CreateTablet for tablet b306496f992f45a9b64b05b73712cb5b (DEFAULT_TABLE table=default.Table_04449fc82e9a480cbd1dfa613ef87dbd [id=5fff99035f0e4089bf06b22ac548e8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.809000 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b306496f992f45a9b64b05b73712cb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.809249 11341 tablet_service.cc:1511] Processing CreateTablet for tablet b306496f992f45a9b64b05b73712cb5b (DEFAULT_TABLE table=default.Table_04449fc82e9a480cbd1dfa613ef87dbd [id=5fff99035f0e4089bf06b22ac548e8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.809798 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b306496f992f45a9b64b05b73712cb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.810392 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 0575861dd3d6437284cc183acb87af0a (DEFAULT_TABLE table=default.Table_f8618e0dcc354193b6014b7fea7f7698 [id=1a5a59e2daad4fb78689dd25363b7086]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.811347 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0575861dd3d6437284cc183acb87af0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.812119 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 0575861dd3d6437284cc183acb87af0a (DEFAULT_TABLE table=default.Table_f8618e0dcc354193b6014b7fea7f7698 [id=1a5a59e2daad4fb78689dd25363b7086]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.812763 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0575861dd3d6437284cc183acb87af0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.815061 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 7da55c488da540048a94324fa347c1ef (DEFAULT_TABLE table=default.Table_4eb401244d9d45b0b4edf95aa734f197 [id=c97451943f104891bb63fcd9478c6a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.815822 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da55c488da540048a94324fa347c1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.817444 11222 tablet_service.cc:1511] Processing CreateTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 (DEFAULT_TABLE table=default.Table_ef156363e7164df8bef902f6f27e3116 [id=653678819a1849b2a923a6793976ae8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.817826 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be89c0911dfa4b9d83d6bd88755be2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.818847 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 7da55c488da540048a94324fa347c1ef (DEFAULT_TABLE table=default.Table_4eb401244d9d45b0b4edf95aa734f197 [id=c97451943f104891bb63fcd9478c6a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.819257 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da55c488da540048a94324fa347c1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.830150 11353 tablet_service.cc:1511] Processing CreateTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 (DEFAULT_TABLE table=default.Table_ef156363e7164df8bef902f6f27e3116 [id=653678819a1849b2a923a6793976ae8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.830796 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be89c0911dfa4b9d83d6bd88755be2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.836802 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 (DEFAULT_TABLE table=default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.837314 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d50e428bfc46caa130f96ccc7e8f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.838760 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 50) took 2260 ms. Trace:
I20260925 01:49:48.838884 11931 rpcz_store.cc:276] 0925 01:49:46.578141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.578231 (+ 90us) service_pool.cc:224] Handling call
0925 01:49:48.753481 (+2175250us) ts_tablet_manager.cc:1151] Deleting tablet c96165d1a85d4ee99748563078ae2a3e
0925 01:49:48.753495 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.759195 (+ 5700us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.765463 (+ 6268us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.838691 (+ 73228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2175047}
I20260925 01:49:48.839030 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 (DEFAULT_TABLE table=default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.839351 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c96165d1a85d4ee99748563078ae2a3e (table default.Table_9ef5c3e705a5472e95916b5b9e5a6700 [id=ca8c84b0f3fd4aac9fb747b21cfec090]) successfully deleted
I20260925 01:49:48.839805 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d50e428bfc46caa130f96ccc7e8f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.841324 11931 tablet_replica.cc:333] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.841567 11931 raft_consensus.cc:2243] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:48.841789 11931 raft_consensus.cc:2272] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.843387 11931 ts_tablet_manager.cc:1916] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.844319 11953 ts_tablet_manager.cc:1950] T da74fa4b6fa841b7aebb81302cab2885 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:48.844858 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 829d167dc0214890b722c0197500f159 (DEFAULT_TABLE table=default.Table_5ee00c6a9b644c778e571ff1952327d1 [id=83d275d67d4340e985a5c6a6e3354c45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.845374 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 829d167dc0214890b722c0197500f159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.845901 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 29) took 2497 ms. Trace:
I20260925 01:49:48.846982 11953 rpcz_store.cc:276] 0925 01:49:46.348299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.348953 (+ 654us) service_pool.cc:224] Handling call
0925 01:49:48.717487 (+2368534us) ts_tablet_manager.cc:1151] Deleting tablet da74fa4b6fa841b7aebb81302cab2885
0925 01:49:48.717499 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.727705 (+ 10206us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.768861 (+ 41156us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.845851 (+ 76990us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347509}
I20260925 01:49:48.851950 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 829d167dc0214890b722c0197500f159 (DEFAULT_TABLE table=default.Table_5ee00c6a9b644c778e571ff1952327d1 [id=83d275d67d4340e985a5c6a6e3354c45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.852428 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 829d167dc0214890b722c0197500f159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.855701 11219 tablet_service.cc:1511] Processing CreateTablet for tablet fcb56153a802427aaebbf55a8193d62b (DEFAULT_TABLE table=default.Table_95d84f6a76304a15a2eea81e724b435c [id=ab32966818e7462982dc4ecfb0d662db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.856222 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb56153a802427aaebbf55a8193d62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.858906 11354 tablet_service.cc:1511] Processing CreateTablet for tablet fcb56153a802427aaebbf55a8193d62b (DEFAULT_TABLE table=default.Table_95d84f6a76304a15a2eea81e724b435c [id=ab32966818e7462982dc4ecfb0d662db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.859485 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb56153a802427aaebbf55a8193d62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.764428 12069 consensus_queue.cc:1048] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.043s
I20260925 01:49:48.791702 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 4195e3f8e93e40fe9dfd72710d319dca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.799749 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 6ff85bac0d22416987e8e3b379154b09 (DEFAULT_TABLE table=default.Table_b6efeae552494a8a9e6f6970c7b0dce0 [id=6ea8e28751c84e1181aa299006fa643f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.862504 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ff85bac0d22416987e8e3b379154b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.820561 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 9884d7af60324a24ad06d6fa5db358b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:42 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.863831 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d (DEFAULT_TABLE table=default.Table_9704bbf8ddbe4f129bccb5a8e30be536 [id=462de86042324bc49bf8949a13d0fec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.863978 11946 ts_tablet_manager.cc:1916] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.864578 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24cd89d238bf4220a48ecdf59cca5e6d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:48.824497 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 109381us
I20260925 01:49:48.825543 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:48.864809 11517 raft_consensus.cc:2468] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:48.825726 11521 raft_consensus.cc:3060] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.868358 11176 leader_election.cc:304] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:48.869616 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d (DEFAULT_TABLE table=default.Table_9704bbf8ddbe4f129bccb5a8e30be536 [id=462de86042324bc49bf8949a13d0fec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.869861 11219 tablet_service.cc:1511] Processing CreateTablet for tablet d7f97ead49634bf6b03e292544af4d07 (DEFAULT_TABLE table=default.Table_0e71b8f12efa4591b712a486be4752b9 [id=a0cfa508705d43c0b763a35cf3b1f3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.870302 11851 raft_consensus.cc:2804] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:48.870362 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24cd89d238bf4220a48ecdf59cca5e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.870581 11851 raft_consensus.cc:493] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:48.870769 11851 raft_consensus.cc:3060] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.825898 12021 raft_consensus.cc:2749] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:48.826346 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 (DEFAULT_TABLE table=default.Table_901ce728b66a4e0aa595efc09462e77c [id=77342c106aac476884403421439b8f52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.836400 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 (DEFAULT_TABLE table=default.Table_703892f2a488412e87acffbe309416fd [id=7dc2076323334c7494e7ea4e28a558a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.874751 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 257e6f224f99427eb68fd61fa1aadae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.874742 11344 tablet_service.cc:1511] Processing CreateTablet for tablet d7f97ead49634bf6b03e292544af4d07 (DEFAULT_TABLE table=default.Table_0e71b8f12efa4591b712a486be4752b9 [id=a0cfa508705d43c0b763a35cf3b1f3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.875306 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f97ead49634bf6b03e292544af4d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.836779 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 (DEFAULT_TABLE table=default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.875720 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ffeb9d70374afdb72a728d7b211d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.839959 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 357963616763428fa69c7670e760f84e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:48.849453 11753 tablet_bootstrap.cc:654] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:48.851007 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 0575861dd3d6437284cc183acb87af0a (DEFAULT_TABLE table=default.Table_f8618e0dcc354193b6014b7fea7f7698 [id=1a5a59e2daad4fb78689dd25363b7086]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.878790 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0575861dd3d6437284cc183acb87af0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.879788 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770ebdbd355142ba86fd9eb8eaa844f4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:48.880707 11931 ts_tablet_manager.cc:1929] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:48.880829 11931 log.cc:1199] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/3eb4dac3099346a7975229d472a3919e
I20260925 01:49:48.881196 11931 ts_tablet_manager.cc:1950] T 3eb4dac3099346a7975229d472a3919e P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:48.881771 12021 consensus_queue.cc:1048] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:48.882548 11851 raft_consensus.cc:515] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.883396 11851 leader_election.cc:290] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:48.883773 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:49:48.884433 11177 leader_election.cc:343] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.884895 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:48.885138 11517 raft_consensus.cc:3060] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:48.882004 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 53) took 2303 ms. Trace:
W20260925 01:49:48.887861 11314 leader_election.cc:343] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:48.888044 11931 rpcz_store.cc:276] 0925 01:49:46.578541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.578594 (+ 53us) service_pool.cc:224] Handling call
0925 01:49:48.841223 (+2262629us) ts_tablet_manager.cc:1151] Deleting tablet 3eb4dac3099346a7975229d472a3919e
0925 01:49:48.841232 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.849454 (+ 8222us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.880618 (+ 31164us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:48.881965 (+ 1347us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2262426}
I20260925 01:49:48.888587 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 51) took 2310 ms. Trace:
I20260925 01:49:48.888702 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 3eb4dac3099346a7975229d472a3919e (table default.Table_ebef853028984518b5b550224ea8e5dc [id=4e06f81ce5a94972bd01063957cf921f]) successfully deleted
I20260925 01:49:48.888767 11931 rpcz_store.cc:276] 0925 01:49:46.578263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.578776 (+ 513us) service_pool.cc:224] Handling call
0925 01:49:48.888412 (+2309636us) ts_tablet_manager.cc:1151] Deleting tablet 2d76845ed48045b7b3632179be022e5f
0925 01:49:48.888422 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:48.888551 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2309424}
W20260925 01:49:48.889227 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2d76845ed48045b7b3632179be022e5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d76845ed48045b7b3632179be022e5f already in progress: creating tablet
I20260925 01:49:48.890668 11931 tablet_replica.cc:333] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:48.891062 11931 raft_consensus.cc:2243] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:48.891469 11931 pending_rounds.cc:70] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:48.891510 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet da74fa4b6fa841b7aebb81302cab2885 (table default.Table_d76ece082b4743ed8fac6623dcaf6bd2 [id=dc9445c2dde34bba98e731c1cdf445d8]) successfully deleted
I20260925 01:49:48.891618 11953 tablet_replica.cc:333] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:48.891664 11931 pending_rounds.cc:77] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072848210235392 op_type: NO_OP noop_request { }
I20260925 01:49:48.891841 11931 raft_consensus.cc:2889] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:48.892099 11931 raft_consensus.cc:2272] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:48.895895 11931 ts_tablet_manager.cc:1916] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:48.899447 11998 mvcc.cc:204] Tried to move back new op lower bound from 7333072849397506048 to 7333072846277459968. Current Snapshot: MvccSnapshot[applied={T|T < 7333072849397506048}]
I20260925 01:49:48.899740 12167 tablet.cc:1751] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:48.904783 11498 tablet_service.cc:1511] Processing CreateTablet for tablet b306496f992f45a9b64b05b73712cb5b (DEFAULT_TABLE table=default.Table_04449fc82e9a480cbd1dfa613ef87dbd [id=5fff99035f0e4089bf06b22ac548e8d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.910478 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 7da55c488da540048a94324fa347c1ef (DEFAULT_TABLE table=default.Table_4eb401244d9d45b0b4edf95aa734f197 [id=c97451943f104891bb63fcd9478c6a17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.911052 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da55c488da540048a94324fa347c1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.926092 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e96576354fe46bf9bfcde18f0a53390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.930905 11490 tablet_service.cc:1511] Processing CreateTablet for tablet d7f97ead49634bf6b03e292544af4d07 (DEFAULT_TABLE table=default.Table_0e71b8f12efa4591b712a486be4752b9 [id=a0cfa508705d43c0b763a35cf3b1f3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.931540 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f97ead49634bf6b03e292544af4d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.940359 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d (DEFAULT_TABLE table=default.Table_9704bbf8ddbe4f129bccb5a8e30be536 [id=462de86042324bc49bf8949a13d0fec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.940907 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24cd89d238bf4220a48ecdf59cca5e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.942899 11485 tablet_service.cc:1511] Processing CreateTablet for tablet fcb56153a802427aaebbf55a8193d62b (DEFAULT_TABLE table=default.Table_95d84f6a76304a15a2eea81e724b435c [id=ab32966818e7462982dc4ecfb0d662db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.948858 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcb56153a802427aaebbf55a8193d62b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.949352 11965 consensus_queue.cc:1048] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:48.954612 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 519d954b6a214d0b8e960e128cfcea10 (DEFAULT_TABLE table=default.Table_4adf83738ae7445bbbe57ce8e26c87ce [id=3e31f69b151b4dd69a3ac8be6e2bc48d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.959272 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 519d954b6a214d0b8e960e128cfcea10 (DEFAULT_TABLE table=default.Table_4adf83738ae7445bbbe57ce8e26c87ce [id=3e31f69b151b4dd69a3ac8be6e2bc48d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.959789 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519d954b6a214d0b8e960e128cfcea10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.959896 11210 tablet_service.cc:1511] Processing CreateTablet for tablet a9068770de0b473488bd8ea4752fb15d (DEFAULT_TABLE table=default.Table_bb67fea9df444e16a94bb2a276fc99be [id=b527a6ca23af495195c09be2d49de223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.969559 11494 tablet_service.cc:1511] Processing CreateTablet for tablet a8c46e780d4a4987ad52619e4c3b46c9 (DEFAULT_TABLE table=default.Table_e973513b7c3d4c1dadf184056a92dad5 [id=a60aa9bcded3478f908ca2bdaafd1e41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.972878 11492 tablet_service.cc:1511] Processing CreateTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 (DEFAULT_TABLE table=default.Table_ef156363e7164df8bef902f6f27e3116 [id=653678819a1849b2a923a6793976ae8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.973969 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 (DEFAULT_TABLE table=default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.974462 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f97ead49634bf6b03e292544af4d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.976102 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9068770de0b473488bd8ea4752fb15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.978418 11353 tablet_service.cc:1511] Processing CreateTablet for tablet a9068770de0b473488bd8ea4752fb15d (DEFAULT_TABLE table=default.Table_bb67fea9df444e16a94bb2a276fc99be [id=b527a6ca23af495195c09be2d49de223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:48.979077 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9068770de0b473488bd8ea4752fb15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:48.992919 12135 raft_consensus.cc:493] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:48.993197 12135 raft_consensus.cc:515] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:48.994686 12135 leader_election.cc:290] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:48.997473 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:48.999814 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 95ac080782664fca8661c188ab822e89 (DEFAULT_TABLE table=default.Table_40519dcfbe2e470ca48f0351bf0ea7cd [id=9bdac40ff34c4ea8aa4fa8da91357cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.000523 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ac080782664fca8661c188ab822e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.001869 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 829d167dc0214890b722c0197500f159 (DEFAULT_TABLE table=default.Table_5ee00c6a9b644c778e571ff1952327d1 [id=83d275d67d4340e985a5c6a6e3354c45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.019057 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 06fca09010f841c5a7b58678560065f3 (DEFAULT_TABLE table=default.Table_ef187190ed9e4b7d910df53df764f469 [id=4d572d97dbaa43e5879f88f200a962ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.019701 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fca09010f841c5a7b58678560065f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.021844 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 95ac080782664fca8661c188ab822e89 (DEFAULT_TABLE table=default.Table_40519dcfbe2e470ca48f0351bf0ea7cd [id=9bdac40ff34c4ea8aa4fa8da91357cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.025463 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c46e780d4a4987ad52619e4c3b46c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.029804 11502 tablet_service.cc:1511] Processing CreateTablet for tablet a9068770de0b473488bd8ea4752fb15d (DEFAULT_TABLE table=default.Table_bb67fea9df444e16a94bb2a276fc99be [id=b527a6ca23af495195c09be2d49de223]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.032523 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ac080782664fca8661c188ab822e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.035228 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 06fca09010f841c5a7b58678560065f3 (DEFAULT_TABLE table=default.Table_ef187190ed9e4b7d910df53df764f469 [id=4d572d97dbaa43e5879f88f200a962ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.046619 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 1f778b87d307483b9edb17dce7355a65 (DEFAULT_TABLE table=default.Table_78fa9227d15c432fb2a7b5f1bba2b14c [id=7403f961d61b4ab2b2042f88d1b80db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.042083 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 519d954b6a214d0b8e960e128cfcea10 (DEFAULT_TABLE table=default.Table_4adf83738ae7445bbbe57ce8e26c87ce [id=3e31f69b151b4dd69a3ac8be6e2bc48d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.049028 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f778b87d307483b9edb17dce7355a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.053406 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9068770de0b473488bd8ea4752fb15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.056254 11517 raft_consensus.cc:2468] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:49.063699 11341 tablet_service.cc:1511] Processing CreateTablet for tablet dfde700aff8049f4b10c46059da6907f (DEFAULT_TABLE table=default.Table_32aa0edcb40b42d39d7a738c77b857fb [id=1ee74b5ac91243c9b7f65e894bbbb7a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.064215 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfde700aff8049f4b10c46059da6907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.065704 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be89c0911dfa4b9d83d6bd88755be2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.067587 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fca09010f841c5a7b58678560065f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.067965 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d50e428bfc46caa130f96ccc7e8f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.073940 11358 tablet_service.cc:1511] Processing CreateTablet for tablet bdf7f544827d4bca97aa6b63c0c48c0d (DEFAULT_TABLE table=default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.074373 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf7f544827d4bca97aa6b63c0c48c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.093430 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 53d30f4940c44bcf900a8cf0de91a66d (DEFAULT_TABLE table=default.Table_fd114e03807f4a78964e4057de720bfa [id=a2353cff823048a2bfedf7ef1c58975b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.094100 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d30f4940c44bcf900a8cf0de91a66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.112013 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 829d167dc0214890b722c0197500f159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.115525 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519d954b6a214d0b8e960e128cfcea10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.118536 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6ae7ffbe7b334c87a1be9c5c18761c65" } modify_external_catalogs: true
I20260925 01:49:49.118948 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6ae7ffbe7b334c87a1be9c5c18761c65" } modify_external_catalogs: true
I20260925 01:49:49.123353 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 1f778b87d307483b9edb17dce7355a65 (DEFAULT_TABLE table=default.Table_78fa9227d15c432fb2a7b5f1bba2b14c [id=7403f961d61b4ab2b2042f88d1b80db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.126212 11495 tablet_service.cc:1511] Processing CreateTablet for tablet bdf7f544827d4bca97aa6b63c0c48c0d (DEFAULT_TABLE table=default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.127147 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 53d30f4940c44bcf900a8cf0de91a66d (DEFAULT_TABLE table=default.Table_fd114e03807f4a78964e4057de720bfa [id=a2353cff823048a2bfedf7ef1c58975b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.128207 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519d954b6a214d0b8e960e128cfcea10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.131183 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 00906edfa6b648229bcba8e59d68b969
I20260925 01:49:49.133446 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 357963616763428fa69c7670e760f84e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.133708 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_78fa9227d15c432fb2a7b5f1bba2b14c" } modify_external_catalogs: true
I20260925 01:49:49.133930 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_78fa9227d15c432fb2a7b5f1bba2b14c" } modify_external_catalogs: true
I20260925 01:49:49.144246 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1f778b87d307483b9edb17dce7355a65
I20260925 01:49:49.147935 11965 consensus_queue.cc:1048] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260925 01:49:49.148618 11851 raft_consensus.cc:493] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:49.148945 11851 raft_consensus.cc:515] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:49.149904 11851 leader_election.cc:290] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:49.150174 11176 leader_election.cc:304] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:49.128515 11486 tablet_service.cc:1511] Processing CreateTablet for tablet dfde700aff8049f4b10c46059da6907f (DEFAULT_TABLE table=default.Table_32aa0edcb40b42d39d7a738c77b857fb [id=1ee74b5ac91243c9b7f65e894bbbb7a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.150987 11501 tablet_service.cc:1511] Processing CreateTablet for tablet e26b1dc65fc84629a72029519919ae23 (DEFAULT_TABLE table=default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.151120 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_962d7117724d4e5aa1b45a6fab966667" } modify_external_catalogs: true
I20260925 01:49:49.151432 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_962d7117724d4e5aa1b45a6fab966667" } modify_external_catalogs: true
I20260925 01:49:49.151553 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 95ac080782664fca8661c188ab822e89 (DEFAULT_TABLE table=default.Table_40519dcfbe2e470ca48f0351bf0ea7cd [id=9bdac40ff34c4ea8aa4fa8da91357cbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.147601 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:49.153721 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_82ebda3635eb4fdbb40fd316f06241b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.154693 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82ebda3635eb4fdbb40fd316f06241b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.156610 11753 tablet_bootstrap.cc:492] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:49.156859 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf7f544827d4bca97aa6b63c0c48c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.157480 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b4bf650809e3446080a35f549aaa9964"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.158939 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4bf650809e3446080a35f549aaa9964 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.159147 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ac080782664fca8661c188ab822e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.162978 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 06fca09010f841c5a7b58678560065f3 (DEFAULT_TABLE table=default.Table_ef187190ed9e4b7d910df53df764f469 [id=4d572d97dbaa43e5879f88f200a962ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.163990 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06fca09010f841c5a7b58678560065f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.164836 11931 ts_tablet_manager.cc:1929] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:49.164906 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 1f778b87d307483b9edb17dce7355a65 (DEFAULT_TABLE table=default.Table_78fa9227d15c432fb2a7b5f1bba2b14c [id=7403f961d61b4ab2b2042f88d1b80db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.165011 11931 log.cc:1199] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b05053f5646f4748a99647b7dbfae686
I20260925 01:49:49.165700 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f778b87d307483b9edb17dce7355a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.170595 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 53d30f4940c44bcf900a8cf0de91a66d (DEFAULT_TABLE table=default.Table_fd114e03807f4a78964e4057de720bfa [id=a2353cff823048a2bfedf7ef1c58975b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.171204 11214 tablet_service.cc:1511] Processing CreateTablet for tablet dfde700aff8049f4b10c46059da6907f (DEFAULT_TABLE table=default.Table_32aa0edcb40b42d39d7a738c77b857fb [id=1ee74b5ac91243c9b7f65e894bbbb7a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.174998 11222 tablet_service.cc:1511] Processing CreateTablet for tablet e26b1dc65fc84629a72029519919ae23 (DEFAULT_TABLE table=default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.175146 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 00906edfa6b648229bcba8e59d68b969 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.174998 11209 tablet_service.cc:1511] Processing CreateTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 (DEFAULT_TABLE table=default.Table_467dcbd96d384165bd59850e07759dae [id=454ea19fdacb465b93f5761ffcdf4ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.184578 11965 raft_consensus.cc:2804] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:49.194535 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfde700aff8049f4b10c46059da6907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.196801 11753 ts_tablet_manager.cc:1403] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.529s user 0.010s sys 0.000s
I20260925 01:49:49.198328 11753 raft_consensus.cc:359] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.198855 11753 raft_consensus.cc:385] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.199077 11753 raft_consensus.cc:740] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.199698 11753 consensus_queue.cc:260] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.200735 11753 ts_tablet_manager.cc:1434] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260925 01:49:49.201328 11753 tablet_bootstrap.cc:492] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:49.214375 11314 consensus_peers.cc:597] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0ad8ca37e3c49a4a03fc3460bf0bc5b. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:49.207713 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9cd2e1bf7d3e4459a84235b9c3f5383c
W20260925 01:49:49.214594 12167 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.214s user 0.000s sys 0.000s
I20260925 01:49:49.217940 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 00906edfa6b648229bcba8e59d68b969 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:49.216674 11499 tablet_service.cc:1511] Processing CreateTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 (DEFAULT_TABLE table=default.Table_467dcbd96d384165bd59850e07759dae [id=454ea19fdacb465b93f5761ffcdf4ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.225132 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:49.225416 11517 raft_consensus.cc:2468] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:49.227116 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:49.227778 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 84808.7us
I20260925 01:49:49.228405 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_701924856dbf4c96afa419ddee50b09b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:49.228647 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f778b87d307483b9edb17dce7355a65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:49.228823 12166 tablet.cc:1751] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260925 01:49:49.229202 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_701924856dbf4c96afa419ddee50b09b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.229187 11456 leader_election.cc:304] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:49.231001 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_040b864e0371477a9619a6362779f0f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.231693 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_040b864e0371477a9619a6362779f0f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.233543 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d1c22bbeca5e4b81b4cf081fa2b71351" } new_table_name: "default.Table_7ad0a76f459148b29a5a3c029573cc5b" modify_external_catalogs: true
I20260925 01:49:49.233978 11353 tablet_service.cc:1511] Processing CreateTablet for tablet e26b1dc65fc84629a72029519919ae23 (DEFAULT_TABLE table=default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.235471 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26b1dc65fc84629a72029519919ae23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.235774 12105 consensus_queue.cc:1048] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:49.235788 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_33e82d375f274afa8be91af4b28057b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.236387 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33e82d375f274afa8be91af4b28057b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.237526 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26b1dc65fc84629a72029519919ae23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.238086 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d7ae405b0f8d420fb45d056949226f3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.238655 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7ae405b0f8d420fb45d056949226f3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.240171 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4eb401244d9d45b0b4edf95aa734f197" } new_table_name: "default.Table_14e085ebe19844c79a4ed115d2911dd2" modify_external_catalogs: true
I20260925 01:49:49.241925 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3dbfc023733e4f1ba765a6ad09ad8de8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.242810 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dbfc023733e4f1ba765a6ad09ad8de8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.248368 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7944aa1ac8f4c5d8ea3aa2acae41257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.254719 11965 raft_consensus.cc:697] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:49.255213 11931 ts_tablet_manager.cc:1950] T b05053f5646f4748a99647b7dbfae686 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:49:49.256094 12080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s user 0.001s sys 0.012s
W20260925 01:49:49.256217 12080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s user 0.001s sys 0.012s
I20260925 01:49:49.256299 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 52) took 2677 ms. Trace:
I20260925 01:49:49.256551 11207 tablet_service.cc:1511] Processing CreateTablet for tablet bdf7f544827d4bca97aa6b63c0c48c0d (DEFAULT_TABLE table=default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.258365 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d30f4940c44bcf900a8cf0de91a66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.258737 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e26b1dc65fc84629a72029519919ae23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.258854 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f778b87d307483b9edb17dce7355a65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.259095 11176 leader_election.cc:304] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:49.259572 11851 raft_consensus.cc:2804] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:49.259701 11851 raft_consensus.cc:493] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:49.259799 11851 raft_consensus.cc:3060] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:49.259842 11953 raft_consensus.cc:2243] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:49.260426 11953 pending_rounds.cc:70] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:49.260515 11953 pending_rounds.cc:77] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072849139412992 op_type: NO_OP noop_request { }
I20260925 01:49:49.260634 11953 raft_consensus.cc:2889] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:49.260756 11953 raft_consensus.cc:2272] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:49.261255 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7944aa1ac8f4c5d8ea3aa2acae41257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.262202 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.264534 11953 ts_tablet_manager.cc:1916] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:49.266178 11965 consensus_queue.cc:237] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:49.269544 11375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s user 0.009s sys 0.004s
W20260925 01:49:49.269666 11375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s user 0.009s sys 0.004s
I20260925 01:49:49.279397 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:49.280145 11177 leader_election.cc:343] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:49.280717 11177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 48373.4us
I20260925 01:49:49.281484 11931 rpcz_store.cc:276] 0925 01:49:46.578414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.579034 (+ 620us) service_pool.cc:224] Handling call
0925 01:49:48.890580 (+2311546us) ts_tablet_manager.cc:1151] Deleting tablet b05053f5646f4748a99647b7dbfae686
0925 01:49:48.890593 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.120865 (+230272us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.128525 (+ 7660us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.256250 (+127725us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2311340}
I20260925 01:49:49.282042 11931 tablet_replica.cc:333] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:49.282428 11931 raft_consensus.cc:2243] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:49.282699 11931 raft_consensus.cc:2272] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:49.283605 11931 ts_tablet_manager.cc:1916] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:49.287031 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b306496f992f45a9b64b05b73712cb5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.290489 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf7f544827d4bca97aa6b63c0c48c0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.293052 11519 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.639s user 0.003s sys 0.011s
W20260925 01:49:49.293231 11519 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s user 0.003s sys 0.011s
I20260925 01:49:49.299068 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f778b87d307483b9edb17dce7355a65. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.300176 12137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s user 0.004s sys 0.009s
I20260925 01:49:49.308763 11953 ts_tablet_manager.cc:1929] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:49.309090 11953 log.cc:1199] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/3eb4dac3099346a7975229d472a3919e
I20260925 01:49:49.313432 11953 ts_tablet_manager.cc:1950] T 3eb4dac3099346a7975229d472a3919e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:49.318202 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_24b699e047024e59a09f3a00feb33cef" } new_table_name: "default.Table_7fc62b7e76d64496818ec9146e884b17" modify_external_catalogs: true
I20260925 01:49:49.319965 11851 raft_consensus.cc:515] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:49.320860 11851 leader_election.cc:290] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:49.321550 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d30f4940c44bcf900a8cf0de91a66d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.321688 12137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s user 0.004s sys 0.009s
I20260925 01:49:49.327554 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_35c4ed0e87a84f229968365f06717746"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.328253 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35c4ed0e87a84f229968365f06717746 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:49.332264 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96b68399843a422b8da3ddfab2c522e6 consensus state has no leader
I20260925 01:49:49.332427 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet fa619556e5af473998080f4bbc9e5d1e from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:49.332610 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 00906edfa6b648229bcba8e59d68b969 from {username='slave'} at 127.0.0.1:60372
W20260925 01:49:49.333465 11457 consensus_peers.cc:597] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e008337914841b8a1ab4a64ecc6e181. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:49.334913 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet 596f8ddbcd16458aa4f287f4f11282a1 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:49.326872 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:49:49.331095 11314 consensus_peers.cc:597] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:49.337620 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7da55c488da540048a94324fa347c1ef consensus state has no leader
I20260925 01:49:49.338558 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfde700aff8049f4b10c46059da6907f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.338701 11177 leader_election.cc:343] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:49.338967 12069 raft_consensus.cc:493] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:49.339211 12080 consensus_queue.cc:1048] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:49.344774 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_58fdde0b3e6a47b79d42646ec2ed37ef" } modify_external_catalogs: true
I20260925 01:49:49.346421 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_58fdde0b3e6a47b79d42646ec2ed37ef" } modify_external_catalogs: true
I20260925 01:49:49.346513 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]). Expected version 2 got 0
I20260925 01:49:49.346818 11675 catalog_manager.cc:5838] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:49.348346 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 93329036763146beb8e6a9b039cc1ec1 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:49.349287 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_def921b326b04b85a7bd4c9e3b3b15cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.349879 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_def921b326b04b85a7bd4c9e3b3b15cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.349812 11222 tablet_service.cc:1511] Processing CreateTablet for tablet d3150980bb72435886486156aa98d342 (DEFAULT_TABLE table=default.Table_b4bf650809e3446080a35f549aaa9964 [id=374d5a46f2b2482598aec3f5cc801aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.352980 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f6793736afa14ac5accac777fbb0e77d" } new_table_name: "default.Table_205d65fa20234c96af8350d123668897" modify_external_catalogs: true
I20260925 01:49:49.354148 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_20d10e4a47ae41e3b53b6eb8e1839997" } new_table_name: "default.Table_d82fb9eb56a0497cb5f94dc964e94656" modify_external_catalogs: true
I20260925 01:49:49.355451 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e0eda87385444fd39c1cb29576fc9884"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.355897 11755 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.706s user 0.028s sys 0.031s
W20260925 01:49:49.356058 11755 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.706s user 0.028s sys 0.031s
W20260925 01:49:49.356042 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0eda87385444fd39c1cb29576fc9884 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.356940 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:49.360477 12069 raft_consensus.cc:515] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:49.362048 11755 tablet_bootstrap.cc:492] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:49.362368 11755 ts_tablet_manager.cc:1403] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.827s user 0.033s sys 0.032s
I20260925 01:49:49.363348 11755 raft_consensus.cc:359] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.363559 11755 raft_consensus.cc:385] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.363631 11755 raft_consensus.cc:740] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.363636 11753 tablet_bootstrap.cc:700] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent opening tablet: real 0.141s user 0.002s sys 0.000s
I20260925 01:49:49.363869 11755 consensus_queue.cc:260] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.364423 11755 ts_tablet_manager.cc:1434] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:49.367002 11518 raft_consensus.cc:3060] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:49.368150 11754 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.722s user 0.092s sys 0.193s
I20260925 01:49:49.368569 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a (DEFAULT_TABLE table=default.Table_82ebda3635eb4fdbb40fd316f06241b8 [id=afe7e3c8eceb40f5b1b0c3809f94e503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.370280 11488 tablet_service.cc:1511] Processing CreateTablet for tablet d3150980bb72435886486156aa98d342 (DEFAULT_TABLE table=default.Table_b4bf650809e3446080a35f549aaa9964 [id=374d5a46f2b2482598aec3f5cc801aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.382704 12167 tablet.cc:1751] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260925 01:49:49.387758 11457 leader_election.cc:343] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:49.388350 11755 tablet_bootstrap.cc:492] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:49.381332 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a (DEFAULT_TABLE table=default.Table_82ebda3635eb4fdbb40fd316f06241b8 [id=afe7e3c8eceb40f5b1b0c3809f94e503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.398993 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 30) took 3028 ms. Trace:
I20260925 01:49:49.404111 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d23c5d52faa4b6da2996fabb16bd74a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.405265 11754 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.778s user 0.092s sys 0.193s
I20260925 01:49:49.406445 11754 tablet_bootstrap.cc:492] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:49.389881 12069 leader_election.cc:290] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:49.410167 11953 rpcz_store.cc:276] 0925 01:49:46.370677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.370817 (+ 140us) service_pool.cc:224] Handling call
0925 01:49:48.891493 (+2520676us) ts_tablet_manager.cc:1151] Deleting tablet 3eb4dac3099346a7975229d472a3919e
0925 01:49:48.891503 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.260220 (+368717us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x6160001c0954. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74f24a70 00007f1c762ad583 00007f1c78e7a8b7 00007f1c78eada64 00007f1c78e8e3a0 00007f1c78e8e12d 0000000000aaef9c 00007f1c68e76aef 00007f1c68e79deb 00007f1c68e79c68
0925 01:49:49.303965 (+ 43745us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.308621 (+ 4656us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.398936 (+ 90315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846208256,"tablet-delete.queue_time_us":2513655}
I20260925 01:49:49.411054 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 31) took 3035 ms. Trace:
I20260925 01:49:49.411423 11953 rpcz_store.cc:276] 0925 01:49:46.375979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.376035 (+ 56us) service_pool.cc:224] Handling call
0925 01:49:49.410852 (+3034817us) ts_tablet_manager.cc:1151] Deleting tablet b05053f5646f4748a99647b7dbfae686
0925 01:49:49.410865 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.411001 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3029935}
I20260925 01:49:49.412196 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 34) took 3026 ms. Trace:
I20260925 01:49:49.412396 11953 rpcz_store.cc:276] 0925 01:49:46.385826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.385931 (+ 105us) service_pool.cc:224] Handling call
0925 01:49:49.411892 (+3025961us) ts_tablet_manager.cc:1151] Deleting tablet bb98d5a38f43450c80d057d9eb2f92d1
0925 01:49:49.412029 (+ 137us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.412157 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3022413}
I20260925 01:49:49.412884 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 33) took 3030 ms. Trace:
I20260925 01:49:49.413085 11953 rpcz_store.cc:276] 0925 01:49:46.382285 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.382452 (+ 167us) service_pool.cc:224] Handling call
0925 01:49:49.412745 (+3030293us) ts_tablet_manager.cc:1151] Deleting tablet ccffbe61eea34333abdc6da94612c0f6
0925 01:49:49.412754 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.412850 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3023122}
I20260925 01:49:49.413583 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 32) took 3035 ms. Trace:
I20260925 01:49:49.414006 11953 rpcz_store.cc:276] 0925 01:49:46.378192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.378284 (+ 92us) service_pool.cc:224] Handling call
0925 01:49:49.413439 (+3035155us) ts_tablet_manager.cc:1151] Deleting tablet 31fe174270f24ff780c212eaef90ef0d
0925 01:49:49.413457 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.413551 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3001313}
I20260925 01:49:49.414873 11953 tablet_replica.cc:333] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:49.414963 12177 tablet.cc:1751] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:49.415473 11953 raft_consensus.cc:2243] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:49.416294 11953 raft_consensus.cc:2272] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:49.415766 12168 raft_consensus.cc:2749] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:49.416040 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3150980bb72435886486156aa98d342. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.412352 11456 leader_election.cc:343] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:49.417619 11953 ts_tablet_manager.cc:1916] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:49.421824 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8152c9e0b0af4ab2a18c5a0080e22ffc consensus state has no leader
I20260925 01:49:49.422466 11456 leader_election.cc:304] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:49.425071 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3150980bb72435886486156aa98d342. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.425190 11457 consensus_peers.cc:597] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:49.425103 11753 tablet_bootstrap.cc:654] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.427004 11754 ts_tablet_manager.cc:1403] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.968s user 0.095s sys 0.195s
I20260925 01:49:49.430660 11754 raft_consensus.cc:359] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.436568 11754 raft_consensus.cc:385] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.436782 11754 raft_consensus.cc:740] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.437908 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_21851b803fd649039364f99310471653" } modify_external_catalogs: true
I20260925 01:49:49.438185 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_21851b803fd649039364f99310471653" } modify_external_catalogs: true
I20260925 01:49:49.446421 11754 consensus_queue.cc:260] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.447402 11754 ts_tablet_manager.cc:1434] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.020s user 0.001s sys 0.002s
I20260925 01:49:49.446209 11353 tablet_service.cc:1511] Processing CreateTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 (DEFAULT_TABLE table=default.Table_467dcbd96d384165bd59850e07759dae [id=454ea19fdacb465b93f5761ffcdf4ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.448535 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d23c5d52faa4b6da2996fabb16bd74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.450137 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 00906edfa6b648229bcba8e59d68b969 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.456046 12168 raft_consensus.cc:2749] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:49.456656 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 644b28192e3b45e7b5370d55804cb043
I20260925 01:49:49.458642 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f778b87d307483b9edb17dce7355a65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.458653 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 644b28192e3b45e7b5370d55804cb043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.459244 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 644b28192e3b45e7b5370d55804cb043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:49.459600 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.460582 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a (DEFAULT_TABLE table=default.Table_82ebda3635eb4fdbb40fd316f06241b8 [id=afe7e3c8eceb40f5b1b0c3809f94e503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.462724 11754 tablet_bootstrap.cc:492] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:49.465880 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fa619556e5af473998080f4bbc9e5d1e
I20260925 01:49:49.466687 11673 catalog_manager.cc:6934] ReplaceTablet: tablet fa619556e5af473998080f4bbc9e5d1e deleted and replaced by tablet e1001e66d2984d9187443adcc42e5856
I20260925 01:49:49.470541 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet fa619556e5af473998080f4bbc9e5d1e with delete_type TABLET_DATA_DELETED (replaced by tablet e1001e66d2984d9187443adcc42e5856) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.471740 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 93329036763146beb8e6a9b039cc1ec1
I20260925 01:49:49.472407 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 93329036763146beb8e6a9b039cc1ec1 deleted and replaced by tablet 1f1d2d998d834c21ab83694daae37520
I20260925 01:49:49.473862 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 93329036763146beb8e6a9b039cc1ec1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1d2d998d834c21ab83694daae37520) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:49.481189 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 consensus state has no leader
W20260925 01:49:49.481851 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0157a45817246cfaa0b016afdbd59cb consensus state has no leader
I20260925 01:49:49.483367 12191 tablet.cc:1751] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:49.487391 12190 tablet.cc:1751] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:49.489465 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet fa619556e5af473998080f4bbc9e5d1e with delete_type TABLET_DATA_DELETED (replaced by tablet e1001e66d2984d9187443adcc42e5856) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:49.489692 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 93329036763146beb8e6a9b039cc1ec1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1d2d998d834c21ab83694daae37520) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:49.495936 11518 raft_consensus.cc:2468] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:49.496045 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7944aa1ac8f4c5d8ea3aa2acae41257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.496786 11176 leader_election.cc:304] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:49.498302 12166 tablet.cc:1751] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:49.499651 11953 ts_tablet_manager.cc:1929] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:49.500126 11953 log.cc:1199] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/b0ad8ca37e3c49a4a03fc3460bf0bc5b
I20260925 01:49:49.500677 11953 ts_tablet_manager.cc:1950] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:49.501451 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d23c5d52faa4b6da2996fabb16bd74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.505407 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet cedc909f3c864a7cbbd12dbdfb3315ec
I20260925 01:49:49.506116 11965 raft_consensus.cc:2804] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:49.506305 11965 raft_consensus.cc:697] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:49.506587 11965 consensus_queue.cc:237] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:49.507501 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet cedc909f3c864a7cbbd12dbdfb3315ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.508965 11673 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf] alter complete (version 2)
I20260925 01:49:49.388145 12189 tablet.cc:1751] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:49.514631 11754 tablet_bootstrap.cc:654] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.517858 11755 tablet_bootstrap.cc:654] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.524194 11204 tablet_service.cc:1511] Processing CreateTablet for tablet a07f37b8469a497ba3fe504cb21105d2 (DEFAULT_TABLE table=default.Table_d7ae405b0f8d420fb45d056949226f3c [id=13d7f920892e4b7d8befdde8d52affbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.524647 12190 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:52978 (request call id 120) took 1034 ms. Trace:
I20260925 01:49:49.526389 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 8234c4d0c72541158826416e40f34031 (DEFAULT_TABLE table=default.Table_040b864e0371477a9619a6362779f0f3 [id=dfef0ea9809c46c8971e29b2f080e7df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.526269 12190 rpcz_store.cc:276] 0925 01:49:48.491249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.491386 (+ 137us) service_pool.cc:224] Handling call
0925 01:49:49.524600 (+1033214us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:48.512080 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:48.512211 (+ 131us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:48.512223 (+ 12us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:48.512232 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:48.512278 (+ 46us) alter_schema_op.cc:128] START. Timestamp: 1790300988512225
0925 01:49:48.512282 (+ 4us) op_driver.cc:348] REPLICATION: starting
0925 01:49:48.512493 (+ 211us) log.cc:844] Serialized 173 byte log entry
0925 01:49:49.389944 (+877451us) op_driver.cc:464] REPLICATION: finished
0925 01:49:49.487325 (+ 97381us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:49:49.488084 (+ 759us) log.cc:844] Serialized 5 byte log entry
0925 01:49:49.515901 (+ 27817us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.524512 (+ 8611us) log.cc:844] Serialized 14 byte log entry
0925 01:49:49.524552 (+ 40us) alter_schema_op.cc:73] Released schema lock
0925 01:49:49.524556 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":97301,"prepare.queue_time_us":75,"prepare.run_cpu_time_us":9781,"prepare.run_wall_time_us":391623,"raft.queue_time_us":1899,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":10,"replication_time_us":877621,"thread_start_us":521052,"threads_started":2,"wal-append.queue_time_us":390451}]]}
I20260925 01:49:49.529682 11358 tablet_service.cc:1511] Processing CreateTablet for tablet d3150980bb72435886486156aa98d342 (DEFAULT_TABLE table=default.Table_b4bf650809e3446080a35f549aaa9964 [id=374d5a46f2b2482598aec3f5cc801aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.530493 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet 644b28192e3b45e7b5370d55804cb043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.531124 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet fa619556e5af473998080f4bbc9e5d1e with delete_type TABLET_DATA_DELETED (replaced by tablet e1001e66d2984d9187443adcc42e5856) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.531549 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet 93329036763146beb8e6a9b039cc1ec1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1d2d998d834c21ab83694daae37520) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.528100 11210 tablet_service.cc:1511] Processing CreateTablet for tablet e87128b8baef4f9d80341f6980da519d (DEFAULT_TABLE table=default.Table_33e82d375f274afa8be91af4b28057b2 [id=03d3184bbc30406db8afae3e9f64fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.531991 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet cedc909f3c864a7cbbd12dbdfb3315ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.530218 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 48bd9071170d4f6f9ac4039020de5c00 (DEFAULT_TABLE table=default.Table_701924856dbf4c96afa419ddee50b09b [id=f368a746576a4b5f8407a13437b4b3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.532567 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 (DEFAULT_TABLE table=default.Table_3dbfc023733e4f1ba765a6ad09ad8de8 [id=751698529dcb4a9c8d8806958926ecde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.533407 11351 tablet_service.cc:1511] Processing CreateTablet for tablet a07f37b8469a497ba3fe504cb21105d2 (DEFAULT_TABLE table=default.Table_d7ae405b0f8d420fb45d056949226f3c [id=13d7f920892e4b7d8befdde8d52affbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.534216 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 8234c4d0c72541158826416e40f34031 (DEFAULT_TABLE table=default.Table_040b864e0371477a9619a6362779f0f3 [id=dfef0ea9809c46c8971e29b2f080e7df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.534803 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 (DEFAULT_TABLE table=default.Table_3dbfc023733e4f1ba765a6ad09ad8de8 [id=751698529dcb4a9c8d8806958926ecde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.535848 11359 tablet_service.cc:1511] Processing CreateTablet for tablet e87128b8baef4f9d80341f6980da519d (DEFAULT_TABLE table=default.Table_33e82d375f274afa8be91af4b28057b2 [id=03d3184bbc30406db8afae3e9f64fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.536461 12137 consensus_queue.cc:1048] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260925 01:49:49.536813 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 48bd9071170d4f6f9ac4039020de5c00 (DEFAULT_TABLE table=default.Table_701924856dbf4c96afa419ddee50b09b [id=f368a746576a4b5f8407a13437b4b3d0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:49.537086 11314 consensus_peers.cc:597] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:49.537957 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 3eb4dac3099346a7975229d472a3919e (table default.Table_ebef853028984518b5b550224ea8e5dc [id=4e06f81ce5a94972bd01063957cf921f]) successfully deleted
I20260925 01:49:49.538239 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet cedc909f3c864a7cbbd12dbdfb3315ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:49.538473 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bb98d5a38f43450c80d057d9eb2f92d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb98d5a38f43450c80d057d9eb2f92d1 already in progress: creating tablet
W20260925 01:49:49.538841 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ccffbe61eea34333abdc6da94612c0f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccffbe61eea34333abdc6da94612c0f6 already in progress: creating tablet
W20260925 01:49:49.539178 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 31fe174270f24ff780c212eaef90ef0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31fe174270f24ff780c212eaef90ef0d already in progress: creating tablet
W20260925 01:49:49.551410 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 216953us
I20260925 01:49:49.557981 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet a9e1f114c2a749d4af6a366c044f5ea5 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:49.559392 11485 tablet_service.cc:1511] Processing CreateTablet for tablet a07f37b8469a497ba3fe504cb21105d2 (DEFAULT_TABLE table=default.Table_d7ae405b0f8d420fb45d056949226f3c [id=13d7f920892e4b7d8befdde8d52affbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.562389 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 (DEFAULT_TABLE table=default.Table_3dbfc023733e4f1ba765a6ad09ad8de8 [id=751698529dcb4a9c8d8806958926ecde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.563047 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 35) took 3151 ms. Trace:
I20260925 01:49:49.563217 11953 rpcz_store.cc:276] 0925 01:49:46.411827 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.411885 (+ 58us) service_pool.cc:224] Handling call
0925 01:49:49.414811 (+3002926us) ts_tablet_manager.cc:1151] Deleting tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b
0925 01:49:49.414819 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.495920 (+ 81101us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.499573 (+ 3653us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.562980 (+ 63407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2980535}
I20260925 01:49:49.563637 11953 tablet_replica.cc:333] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:49.563824 11953 raft_consensus.cc:2243] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:49.563989 11953 raft_consensus.cc:2272] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:49.564555 11953 ts_tablet_manager.cc:1916] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:49.564756 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 8234c4d0c72541158826416e40f34031 (DEFAULT_TABLE table=default.Table_040b864e0371477a9619a6362779f0f3 [id=dfef0ea9809c46c8971e29b2f080e7df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.567077 11491 tablet_service.cc:1511] Processing CreateTablet for tablet e87128b8baef4f9d80341f6980da519d (DEFAULT_TABLE table=default.Table_33e82d375f274afa8be91af4b28057b2 [id=03d3184bbc30406db8afae3e9f64fb9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.570235 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 48bd9071170d4f6f9ac4039020de5c00 (DEFAULT_TABLE table=default.Table_701924856dbf4c96afa419ddee50b09b [id=f368a746576a4b5f8407a13437b4b3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.571669 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]). Expected version 2 got 0
I20260925 01:49:49.578738 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b (table default.Table_7abda750abd14e078780e34ba4951149 [id=8dcfe1cef923411faea69f4f694a51e6]) successfully deleted
I20260925 01:49:49.580011 11755 tablet_bootstrap.cc:492] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:49.586481 11754 tablet_bootstrap.cc:492] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:49.586694 11754 ts_tablet_manager.cc:1403] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.124s user 0.004s sys 0.013s
I20260925 01:49:49.588068 11754 raft_consensus.cc:359] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.588305 11754 raft_consensus.cc:385] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.588423 11754 raft_consensus.cc:740] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.588672 11754 consensus_queue.cc:260] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.589578 11754 ts_tablet_manager.cc:1434] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 01:49:49.590219 11755 ts_tablet_manager.cc:1403] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.208s user 0.004s sys 0.000s
I20260925 01:49:49.591673 11755 raft_consensus.cc:359] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.592033 11755 raft_consensus.cc:385] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.592206 11755 raft_consensus.cc:740] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.592612 11755 consensus_queue.cc:260] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.594105 11946 ts_tablet_manager.cc:1929] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:49.594105 11931 ts_tablet_manager.cc:1929] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:49.594259 11946 log.cc:1199] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:49.594257 11931 log.cc:1199] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a9e1f114c2a749d4af6a366c044f5ea5
I20260925 01:49:49.594623 11931 ts_tablet_manager.cc:1950] T a9e1f114c2a749d4af6a366c044f5ea5 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:49.594691 11946 ts_tablet_manager.cc:1950] T a65faada47c34cd1908970460d3d3f6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:49.595242 12188 log.cc:927] Time spent T 3d3626880758447e9aa85f8f9070d4e3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260925 01:49:49.595695 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07f37b8469a497ba3fe504cb21105d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.596215 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8234c4d0c72541158826416e40f34031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.597075 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87128b8baef4f9d80341f6980da519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.597540 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48bd9071170d4f6f9ac4039020de5c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.598572 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 54) took 3019 ms. Trace:
I20260925 01:49:49.598671 11931 rpcz_store.cc:276] 0925 01:49:46.578716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.579264 (+ 548us) service_pool.cc:224] Handling call
0925 01:49:49.281907 (+2702643us) ts_tablet_manager.cc:1151] Deleting tablet a9e1f114c2a749d4af6a366c044f5ea5
0925 01:49:49.281921 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.414415 (+132494us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.593990 (+179575us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.598515 (+ 4525us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2702434}
I20260925 01:49:49.599153 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 46) took 3024 ms. Trace:
I20260925 01:49:49.599231 11931 rpcz_store.cc:276] 0925 01:49:46.574852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.584091 (+ 9239us) service_pool.cc:224] Handling call
0925 01:49:49.598975 (+3014884us) ts_tablet_manager.cc:1151] Deleting tablet ca76f6f710d841fd8999b40e5a48693f
0925 01:49:49.598985 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.599107 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3014653}
I20260925 01:49:49.599581 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 56) took 2979 ms. Trace:
I20260925 01:49:49.599654 11931 rpcz_store.cc:276] 0925 01:49:46.620056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.620115 (+ 59us) service_pool.cc:224] Handling call
0925 01:49:49.599443 (+2979328us) ts_tablet_manager.cc:1151] Deleting tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c
0925 01:49:49.599452 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.599527 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2967732}
I20260925 01:49:49.599932 11931 tablet_replica.cc:333] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:49.600142 11931 raft_consensus.cc:2243] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:49.600317 11931 raft_consensus.cc:2272] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:49.600894 11931 ts_tablet_manager.cc:1916] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:49.601892 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a9e1f114c2a749d4af6a366c044f5ea5 (table default.Table_43fcb0af03694aafb7d0f246fb1b2815 [id=3dd1eb1f66404d10a4398f52c951bf72]) successfully deleted
I20260925 01:49:49.602396 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07f37b8469a497ba3fe504cb21105d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.602803 12189 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40776 (request call id 111) took 1067 ms. Trace:
I20260925 01:49:49.602955 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3150980bb72435886486156aa98d342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.603439 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8234c4d0c72541158826416e40f34031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.602932 12189 rpcz_store.cc:276] 0925 01:49:48.535106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.535170 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:49.602756 (+1067586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:48.550608 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:48.550737 (+ 129us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:48.550746 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:48.550754 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:48.550800 (+ 46us) alter_schema_op.cc:128] START. Timestamp: 1790300988550742
0925 01:49:48.550804 (+ 4us) op_driver.cc:348] REPLICATION: starting
0925 01:49:48.551033 (+ 229us) log.cc:844] Serialized 173 byte log entry
0925 01:49:49.384961 (+833928us) op_driver.cc:464] REPLICATION: finished
0925 01:49:49.388075 (+ 3114us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:49:49.512147 (+124072us) log.cc:844] Serialized 5 byte log entry
0925 01:49:49.602310 (+ 90163us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.602667 (+ 357us) log.cc:844] Serialized 14 byte log entry
0925 01:49:49.602706 (+ 39us) alter_schema_op.cc:73] Released schema lock
0925 01:49:49.602710 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3011,"prepare.queue_time_us":79,"prepare.run_cpu_time_us":550,"prepare.run_wall_time_us":549,"raft.queue_time_us":1107,"raft.run_cpu_time_us":749,"raft.run_wall_time_us":745,"replication_time_us":834030,"thread_start_us":2835,"threads_started":1}]]}
I20260925 01:49:49.603863 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87128b8baef4f9d80341f6980da519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.604372 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48bd9071170d4f6f9ac4039020de5c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.606401 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b11c6526dbc4177b3a54b3c952bbd31. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:49.606418 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ca76f6f710d841fd8999b40e5a48693f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca76f6f710d841fd8999b40e5a48693f already in progress: creating tablet
W20260925 01:49:49.606730 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c already in progress: creating tablet
I20260925 01:49:49.607739 11673 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107] alter complete (version 2)
I20260925 01:49:49.589915 11754 tablet_bootstrap.cc:492] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:49.609915 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b11c6526dbc4177b3a54b3c952bbd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.610952 11755 ts_tablet_manager.cc:1434] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260925 01:49:49.619624 11755 tablet_bootstrap.cc:492] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:49.620198 11754 tablet_bootstrap.cc:654] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.631407 11755 tablet_bootstrap.cc:654] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.632952 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b with delete_type TABLET_DATA_DELETED (replaced by tablet f892954cd22c48aaad2f0e20b1277844) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.634682 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:49.634568 11973 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:49:49.638475 11973 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:49:49.638702 11973 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260925 01:49:49.654960 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_205d65fa20234c96af8350d123668897 [id=56d41c65456f4cf691b9f87319014030], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 consensus state has no leader
I20260925 01:49:49.656023 11755 tablet_bootstrap.cc:492] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:49.656044 11754 tablet_bootstrap.cc:492] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:49.656234 11754 ts_tablet_manager.cc:1403] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.006s
I20260925 01:49:49.656383 11755 ts_tablet_manager.cc:1403] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.005s
I20260925 01:49:49.657284 11755 raft_consensus.cc:359] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.657292 11754 raft_consensus.cc:359] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.657579 11754 raft_consensus.cc:385] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.657622 11755 raft_consensus.cc:385] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.657677 11754 raft_consensus.cc:740] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.657797 11755 raft_consensus.cc:740] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.657980 11754 consensus_queue.cc:260] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.658136 11755 consensus_queue.cc:260] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.663072 11754 ts_tablet_manager.cc:1434] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260925 01:49:49.666334 11754 tablet_bootstrap.cc:492] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:49.666662 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 1396d679e5824c469490170d257f6a9b with delete_type TABLET_DATA_DELETED (replaced by tablet b2708108d6f04f858024542054024e1a) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.668313 11755 ts_tablet_manager.cc:1434] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260925 01:49:49.669850 11753 tablet_bootstrap.cc:492] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:49.672930 11753 ts_tablet_manager.cc:1403] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.472s user 0.007s sys 0.006s
I20260925 01:49:49.674271 11755 tablet_bootstrap.cc:492] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:49.674304 11753 raft_consensus.cc:359] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.674589 11753 raft_consensus.cc:385] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.674688 11753 raft_consensus.cc:740] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.675074 11753 consensus_queue.cc:260] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.675990 11754 tablet_bootstrap.cc:654] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.676946 11755 tablet_bootstrap.cc:654] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.683676 11753 ts_tablet_manager.cc:1434] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
W20260925 01:49:49.684587 11973 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 01:49:49.686184 11973 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:49:49.686406 11973 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 01:49:49.686575 11973 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260925 01:49:49.688911 11755 tablet_bootstrap.cc:492] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:49.689231 11755 ts_tablet_manager.cc:1403] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.002s
I20260925 01:49:49.690321 11755 raft_consensus.cc:359] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.690783 11755 raft_consensus.cc:385] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.691018 11755 raft_consensus.cc:740] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.691584 11753 tablet_bootstrap.cc:492] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:49.694085 11755 consensus_queue.cc:260] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.702507 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8234c4d0c72541158826416e40f34031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.703198 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87128b8baef4f9d80341f6980da519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.703666 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48bd9071170d4f6f9ac4039020de5c00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.704077 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07f37b8469a497ba3fe504cb21105d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.704531 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b11c6526dbc4177b3a54b3c952bbd31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.710951 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 21) took 3389 ms. Trace:
I20260925 01:49:49.711158 11946 rpcz_store.cc:276] 0925 01:49:46.321182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.321727 (+ 545us) service_pool.cc:224] Handling call
0925 01:49:48.675784 (+2354057us) ts_tablet_manager.cc:1151] Deleting tablet a65faada47c34cd1908970460d3d3f6b
0925 01:49:48.675796 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.410504 (+734708us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.593990 (+183486us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.710844 (+116854us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2353808}
I20260925 01:49:49.713868 11946 tablet_replica.cc:333] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:49.718037 11946 raft_consensus.cc:2243] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:49.718381 11946 raft_consensus.cc:2272] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:49.725203 11754 tablet_bootstrap.cc:492] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:49.725373 11754 ts_tablet_manager.cc:1403] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.002s
I20260925 01:49:49.718050 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a65faada47c34cd1908970460d3d3f6b (table default.Table_27810a101f1848a1b8319368749cf79a [id=b931f965b8bf4871849dc5a4613dc04b]) successfully deleted
I20260925 01:49:49.726612 11754 raft_consensus.cc:359] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.726953 11754 raft_consensus.cc:385] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.727068 11754 raft_consensus.cc:740] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.727366 11754 consensus_queue.cc:260] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.728097 11754 ts_tablet_manager.cc:1434] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:49.728441 11754 tablet_bootstrap.cc:492] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:49.729362 11946 ts_tablet_manager.cc:1916] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:49.746838 12168 consensus_queue.cc:1048] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260925 01:49:49.748186 11973 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.252:44823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.159.252
--webserver_port=38543
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
I20260925 01:49:49.752205 11973 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:49:49.755654 11973 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260925 01:49:49.757665 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_467dcbd96d384165bd59850e07759dae" } modify_external_catalogs: true
I20260925 01:49:49.757930 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_467dcbd96d384165bd59850e07759dae" } modify_external_catalogs: true
I20260925 01:49:49.763659 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bb67fea9df444e16a94bb2a276fc99be" } modify_external_catalogs: true
I20260925 01:49:49.764045 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_81a22cdbb608445c9146c6b95401bffc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.765501 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81a22cdbb608445c9146c6b95401bffc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.767501 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_74c3e602a0454e0e8b4e734dc8dea4c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.770258 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74c3e602a0454e0e8b4e734dc8dea4c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.772079 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bb67fea9df444e16a94bb2a276fc99be" } modify_external_catalogs: true
I20260925 01:49:49.777113 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_09e8e9221d6b40e4ad019a42371a5e5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.777760 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09e8e9221d6b40e4ad019a42371a5e5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.778293 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_465f8ad05c214b8d82f91435312f0d53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.778812 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_465f8ad05c214b8d82f91435312f0d53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.780020 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d7ae405b0f8d420fb45d056949226f3c" } new_table_name: "default.Table_d4dec575dd5543cb92d86806b588550c" modify_external_catalogs: true
I20260925 01:49:49.781666 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7df458fb50104adaac9587ce837b400b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:49.782193 12079 raft_consensus.cc:493] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:49.782333 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7df458fb50104adaac9587ce837b400b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.782382 12079 raft_consensus.cc:515] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.783092 12079 leader_election.cc:290] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:49.783316 11754 tablet_bootstrap.cc:654] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.783288 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 9feb00f881ed4518a32e08d170080a46 (DEFAULT_TABLE table=default.Table_e0eda87385444fd39c1cb29576fc9884 [id=372975f12d544860a00670c2763bbbb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.783824 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feb00f881ed4518a32e08d170080a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.783844 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d8fab09ad424478dbf94ca9d17938d66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.784407 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8fab09ad424478dbf94ca9d17938d66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.788093 11753 tablet_bootstrap.cc:654] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.788565 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_901ce728b66a4e0aa595efc09462e77c" } modify_external_catalogs: true
I20260925 01:49:49.788798 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_901ce728b66a4e0aa595efc09462e77c" } modify_external_catalogs: true
I20260925 01:49:49.790617 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a9068770de0b473488bd8ea4752fb15d
I20260925 01:49:49.791524 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5c3812c0f44d4787a440618e42b85b07" } new_table_name: "default.Table_c91274a8eb214f14b4baeb24cabdd8c6" modify_external_catalogs: true
I20260925 01:49:49.794277 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet a9068770de0b473488bd8ea4752fb15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:49.795425 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d55100401c234d6593420fe96b17dfa6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.796535 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d55100401c234d6593420fe96b17dfa6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:49.798625 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3289c6dc8e84a358f877a197412d901" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:49.799540 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet a9068770de0b473488bd8ea4752fb15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:49.799876 11314 leader_election.cc:343] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:49.805691 11498 tablet_service.cc:1511] Processing CreateTablet for tablet fbd4b231f89a48e59e5eb3cf3976385a (DEFAULT_TABLE table=default.Table_35c4ed0e87a84f229968365f06717746 [id=b28ab41a090b4b4ba73898ff85d54d07]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:49.807194 11314 consensus_peers.cc:597] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:49.808714 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c7944aa1ac8f4c5d8ea3aa2acae41257
I20260925 01:49:49.808785 11358 tablet_service.cc:1511] Processing CreateTablet for tablet fbd4b231f89a48e59e5eb3cf3976385a (DEFAULT_TABLE table=default.Table_35c4ed0e87a84f229968365f06717746 [id=b28ab41a090b4b4ba73898ff85d54d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.809919 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd4b231f89a48e59e5eb3cf3976385a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.815150 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 9feb00f881ed4518a32e08d170080a46 (DEFAULT_TABLE table=default.Table_e0eda87385444fd39c1cb29576fc9884 [id=372975f12d544860a00670c2763bbbb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.815637 11359 tablet_service.cc:1511] Processing CreateTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 (DEFAULT_TABLE table=default.Table_def921b326b04b85a7bd4c9e3b3b15cc [id=8bd966f720a046bf8c2eb5501db20fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.816149 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae948bf42ae34a7ab72112d5f1f02585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.817000 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feb00f881ed4518a32e08d170080a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.817387 11490 tablet_service.cc:1511] Processing CreateTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 (DEFAULT_TABLE table=default.Table_def921b326b04b85a7bd4c9e3b3b15cc [id=8bd966f720a046bf8c2eb5501db20fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.818653 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:49.819304 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd4b231f89a48e59e5eb3cf3976385a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.820590 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1d2d998d834c21ab83694daae37520 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.822585 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet a9068770de0b473488bd8ea4752fb15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.823227 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae948bf42ae34a7ab72112d5f1f02585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.824551 12105 raft_consensus.cc:493] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:49.824745 12105 raft_consensus.cc:515] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.825953 12105 leader_election.cc:290] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:49.828788 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:49.830535 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1d2d998d834c21ab83694daae37520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.833258 11217 tablet_service.cc:1511] Processing CreateTablet for tablet fbd4b231f89a48e59e5eb3cf3976385a (DEFAULT_TABLE table=default.Table_35c4ed0e87a84f229968365f06717746 [id=b28ab41a090b4b4ba73898ff85d54d07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.832361 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3289c6dc8e84a358f877a197412d901" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:49.833978 12105 consensus_queue.cc:1048] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:49.834489 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1d2d998d834c21ab83694daae37520 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.834689 11208 tablet_service.cc:1511] Processing CreateTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 (DEFAULT_TABLE table=default.Table_def921b326b04b85a7bd4c9e3b3b15cc [id=8bd966f720a046bf8c2eb5501db20fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.835246 11239 raft_consensus.cc:2468] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:49.836223 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1d2d998d834c21ab83694daae37520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.836275 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1d2d998d834c21ab83694daae37520 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.825073 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 9feb00f881ed4518a32e08d170080a46 (DEFAULT_TABLE table=default.Table_e0eda87385444fd39c1cb29576fc9884 [id=372975f12d544860a00670c2763bbbb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.835618 11354 tablet_service.cc:1511] Processing CreateTablet for tablet e1001e66d2984d9187443adcc42e5856 (DEFAULT_TABLE table=default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.837877 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1001e66d2984d9187443adcc42e5856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.839332 11207 tablet_service.cc:1511] Processing CreateTablet for tablet e1001e66d2984d9187443adcc42e5856 (DEFAULT_TABLE table=default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:49.841529 11456 consensus_peers.cc:597] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c96165d1a85d4ee99748563078ae2a3e. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:49.841605 11314 leader_election.cc:304] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:49.840801 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:49.843222 12105 raft_consensus.cc:2804] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:49.843266 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:49.843359 12105 raft_consensus.cc:493] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:49.843648 12105 raft_consensus.cc:3060] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:49.844164 11523 raft_consensus.cc:2393] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:49.846043 11314 leader_election.cc:304] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:49.846662 12079 raft_consensus.cc:3060] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:49.846720 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet c3289c6dc8e84a358f877a197412d901 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.845463 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:49.850174 11953 ts_tablet_manager.cc:1929] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:49.850419 11953 log.cc:1199] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/06b59e1505e246d2abada79299e09bfe
I20260925 01:49:49.851114 11953 ts_tablet_manager.cc:1950] T 06b59e1505e246d2abada79299e09bfe P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:49.851312 11755 ts_tablet_manager.cc:1434] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.153s user 0.002s sys 0.001s
I20260925 01:49:49.859448 11755 tablet_bootstrap.cc:492] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:49.862883 12168 raft_consensus.cc:493] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:49.864526 12168 raft_consensus.cc:515] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.870837 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9feb00f881ed4518a32e08d170080a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.874294 11755 tablet_bootstrap.cc:654] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.866214 12168 leader_election.cc:290] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:49.876924 11457 leader_election.cc:343] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: 3eb4dac3099346a7975229d472a3919e
W20260925 01:49:49.879079 11456 leader_election.cc:343] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 3eb4dac3099346a7975229d472a3919e
I20260925 01:49:49.879192 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b294b68c22864c009d79e9fb833ba9f1" } modify_external_catalogs: true
I20260925 01:49:49.879307 11456 leader_election.cc:304] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:49.879467 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b294b68c22864c009d79e9fb833ba9f1" } modify_external_catalogs: true
I20260925 01:49:49.880784 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ec3787167585495b80752bc3468751b8" } new_table_name: "default.Table_2f36a1cff31f4f989ec8d79514bcd65f" modify_external_catalogs: true
I20260925 01:49:49.880947 12169 raft_consensus.cc:2749] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:49.883208 11492 tablet_service.cc:1511] Processing CreateTablet for tablet e1001e66d2984d9187443adcc42e5856 (DEFAULT_TABLE table=default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:49.885227 11242 raft_consensus.cc:3060] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:49.886003 11755 tablet_bootstrap.cc:492] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:49.886209 11755 ts_tablet_manager.cc:1403] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.001s
I20260925 01:49:49.887001 11755 raft_consensus.cc:359] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.887205 11755 raft_consensus.cc:385] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.887336 11755 raft_consensus.cc:740] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.891064 11755 consensus_queue.cc:260] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.892824 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c3024aeca0894967b8d02b5871425583"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:49.893596 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3024aeca0894967b8d02b5871425583 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:49.893672 12210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:49.894028 11755 ts_tablet_manager.cc:1434] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 01:49:49.896443 11755 tablet_bootstrap.cc:492] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:49.898792 11755 tablet_bootstrap.cc:654] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.899878 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1001e66d2984d9187443adcc42e5856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.900452 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1d2d998d834c21ab83694daae37520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.904068 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae948bf42ae34a7ab72112d5f1f02585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.904901 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd4b231f89a48e59e5eb3cf3976385a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.905352 12168 consensus_queue.cc:1048] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260925 01:49:49.917963 12216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:49.899453 12105 raft_consensus.cc:515] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.920434 12105 leader_election.cc:290] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:49.900326 12079 raft_consensus.cc:2749] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:49.900666 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 36) took 3421 ms. Trace:
I20260925 01:49:49.921017 11953 rpcz_store.cc:276] 0925 01:49:46.478833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.478907 (+ 74us) service_pool.cc:224] Handling call
0925 01:49:49.563546 (+3084639us) ts_tablet_manager.cc:1151] Deleting tablet 06b59e1505e246d2abada79299e09bfe
0925 01:49:49.563556 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.700985 (+137429us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.804057 (+103072us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.900626 (+ 96569us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3081951}
I20260925 01:49:49.921844 11953 tablet_replica.cc:333] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:49.921888 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 06b59e1505e246d2abada79299e09bfe (table default.Table_63b71c4cf1634d2aa8b517954ab683c8 [id=17b11380da7c42e0b51c4d6301d5789d]) successfully deleted
I20260925 01:49:49.922287 11953 raft_consensus.cc:2243] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:49.922537 11953 raft_consensus.cc:2272] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:49.923369 11953 ts_tablet_manager.cc:1916] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:49.929739 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3289c6dc8e84a358f877a197412d901" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:49.930039 11238 raft_consensus.cc:3060] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:49.916442 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1001e66d2984d9187443adcc42e5856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:49.938585 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3289c6dc8e84a358f877a197412d901" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:49.939543 11314 consensus_peers.cc:597] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:49.945511 11314 leader_election.cc:343] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:49.949510 11755 tablet_bootstrap.cc:492] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:49.949898 11755 ts_tablet_manager.cc:1403] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.055s user 0.006s sys 0.000s
I20260925 01:49:49.951567 11755 raft_consensus.cc:359] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.952574 11755 raft_consensus.cc:385] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:49.958189 11755 raft_consensus.cc:740] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:49.959415 11755 consensus_queue.cc:260] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:49.964083 11755 ts_tablet_manager.cc:1434] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260925 01:49:49.964577 11755 tablet_bootstrap.cc:492] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:49.974042 12220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:49:49.975277 11755 tablet_bootstrap.cc:654] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:49.976522 11973 server_base.cc:1061] running on GCE node
I20260925 01:49:49.977977 11973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20260925 01:49:49.979835 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a07f37b8469a497ba3fe504cb21105d2 consensus state has no leader
I20260925 01:49:49.988003 11755 tablet_bootstrap.cc:492] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:49.988327 11755 ts_tablet_manager.cc:1403] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260925 01:49:50.002713 11931 ts_tablet_manager.cc:1929] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:50.002871 11931 log.cc:1199] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/018525730c4e4134ab3a0506f1a0a6fa
I20260925 01:49:50.003295 11931 ts_tablet_manager.cc:1950] T 018525730c4e4134ab3a0506f1a0a6fa P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:50.006577 11238 raft_consensus.cc:2468] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:50.014792 11755 raft_consensus.cc:359] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.017607 11946 ts_tablet_manager.cc:1929] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:50.017809 11946 log.cc:1199] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b9937c3776f549dea887ace26dae492c
I20260925 01:49:50.017724 11755 raft_consensus.cc:385] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.018417 11946 ts_tablet_manager.cc:1950] T b9937c3776f549dea887ace26dae492c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:50.018584 11755 raft_consensus.cc:740] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.018940 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 57) took 3369 ms. Trace:
I20260925 01:49:50.019073 11931 rpcz_store.cc:276] 0925 01:49:46.649062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.649781 (+ 719us) service_pool.cc:224] Handling call
0925 01:49:49.599856 (+2950075us) ts_tablet_manager.cc:1151] Deleting tablet 018525730c4e4134ab3a0506f1a0a6fa
0925 01:49:49.599865 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.899438 (+299573us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.002594 (+103156us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.018896 (+ 16302us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2949875}
I20260925 01:49:50.018910 11755 consensus_queue.cc:260] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.019608 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 58) took 3368 ms. Trace:
I20260925 01:49:50.019722 11931 rpcz_store.cc:276] 0925 01:49:46.651125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.651173 (+ 48us) service_pool.cc:224] Handling call
0925 01:49:50.019432 (+3368259us) ts_tablet_manager.cc:1151] Deleting tablet e7623999b3c04ca69672a1e43fa6921f
0925 01:49:50.019443 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.019574 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3368066}
I20260925 01:49:50.020002 11931 tablet_replica.cc:333] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:50.020223 11931 raft_consensus.cc:2243] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:50.020404 11931 raft_consensus.cc:2272] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.021378 11755 ts_tablet_manager.cc:1434] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260925 01:49:50.024307 11755 tablet_bootstrap.cc:492] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:50.028321 11755 tablet_bootstrap.cc:654] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:50.034524 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e7623999b3c04ca69672a1e43fa6921f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e7623999b3c04ca69672a1e43fa6921f already in progress: creating tablet
I20260925 01:49:50.056532 11754 tablet_bootstrap.cc:492] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:50.056617 11753 tablet_bootstrap.cc:492] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:50.056739 11754 ts_tablet_manager.cc:1403] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.328s user 0.031s sys 0.042s
I20260925 01:49:50.056764 11753 ts_tablet_manager.cc:1403] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.365s user 0.008s sys 0.003s
I20260925 01:49:50.056792 11965 raft_consensus.cc:493] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.056960 11965 raft_consensus.cc:515] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.057569 11753 raft_consensus.cc:359] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.057556 11754 raft_consensus.cc:359] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.057744 11753 raft_consensus.cc:385] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.057781 11754 raft_consensus.cc:385] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.057819 11753 raft_consensus.cc:740] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.057825 11965 leader_election.cc:290] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.057889 11754 raft_consensus.cc:740] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.058184 11754 consensus_queue.cc:260] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.058812 11754 ts_tablet_manager.cc:1434] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:50.059191 11754 tablet_bootstrap.cc:492] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:50.059408 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1396d679e5824c469490170d257f6a9b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:50.060197 11176 leader_election.cc:343] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.061128 11754 tablet_bootstrap.cc:654] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.062222 12137 raft_consensus.cc:493] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.062422 12137 raft_consensus.cc:515] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.063079 12137 leader_election.cc:290] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.063616 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1396d679e5824c469490170d257f6a9b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:50.064221 11177 leader_election.cc:343] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:49:50.064397 11177 leader_election.cc:304] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:50.064822 11965 raft_consensus.cc:2749] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:50.065851 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76845ed48045b7b3632179be022e5f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:50.066527 11456 leader_election.cc:343] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.067704 11755 tablet_bootstrap.cc:492] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:50.067863 11755 ts_tablet_manager.cc:1403] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.002s
I20260925 01:49:50.068645 11755 raft_consensus.cc:359] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.068825 11755 raft_consensus.cc:385] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.068915 11755 raft_consensus.cc:740] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.069167 11755 consensus_queue.cc:260] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.070649 11755 ts_tablet_manager.cc:1434] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:50.071157 11755 tablet_bootstrap.cc:492] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:50.073500 11755 tablet_bootstrap.cc:654] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.078979 11931 ts_tablet_manager.cc:1916] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.087119 11753 consensus_queue.cc:260] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.091167 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2e96576354fe46bf9bfcde18f0a53390
W20260925 01:49:50.093215 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 784de8c6e6e1434a91106dd19cd9262a consensus state has no leader
W20260925 01:49:50.094025 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2feaab143fae4312915579fdb2ff1e40 consensus state has no leader
I20260925 01:49:50.094214 11755 tablet_bootstrap.cc:492] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:50.094396 11755 ts_tablet_manager.cc:1403] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.000s
I20260925 01:49:50.095152 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.095436 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 85d859207bbc4aefb26c726dce404c44
I20260925 01:49:50.095613 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet ccffbe61eea34333abdc6da94612c0f6 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:50.096269 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b" } modify_external_catalogs: true
I20260925 01:49:50.096462 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b" } modify_external_catalogs: true
I20260925 01:49:50.096405 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4ef3129ce4d545c0a2dae74dbc7798f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.096611 11314 leader_election.cc:304] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:50.096946 12079 raft_consensus.cc:2804] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:50.097095 12079 raft_consensus.cc:697] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
W20260925 01:49:50.097167 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ef3129ce4d545c0a2dae74dbc7798f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.097417 12079 consensus_queue.cc:237] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.103740 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d859207bbc4aefb26c726dce404c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.107051 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_62819e2601e6498796cbf6ba500c43de" } modify_external_catalogs: true
I20260925 01:49:50.107103 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0b653dec053f4999a9000498f3dfe715" } new_table_name: "default.Table_1e338da7b98a48a4b9612f4b5ca1fd65" modify_external_catalogs: true
I20260925 01:49:50.107400 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_62819e2601e6498796cbf6ba500c43de" } modify_external_catalogs: true
I20260925 01:49:50.108235 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_455458464d54496892b32698053029f7" } new_table_name: "default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8" modify_external_catalogs: true
I20260925 01:49:50.108762 11953 ts_tablet_manager.cc:1929] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:50.109875 11953 log.cc:1199] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/1396d679e5824c469490170d257f6a9b
I20260925 01:49:50.110404 11953 ts_tablet_manager.cc:1950] T 1396d679e5824c469490170d257f6a9b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:50.110320 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3dbfc023733e4f1ba765a6ad09ad8de8" } modify_external_catalogs: true
I20260925 01:49:50.110533 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3dbfc023733e4f1ba765a6ad09ad8de8" } modify_external_catalogs: true
I20260925 01:49:50.110622 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d859207bbc4aefb26c726dce404c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.112430 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.112473 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.112809 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d859207bbc4aefb26c726dce404c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.112910 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b2c1222a9e064057bef3e7159e2d9ec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.113572 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2c1222a9e064057bef3e7159e2d9ec3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.113657 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4aba0779435d4c10be3a8cd86662cb8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.114840 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 18) took 3793 ms. Trace:
I20260925 01:49:50.115293 11946 rpcz_store.cc:276] 0925 01:49:46.320847 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.321973 (+ 1126us) service_pool.cc:224] Handling call
0925 01:49:49.711577 (+3389604us) ts_tablet_manager.cc:1151] Deleting tablet b9937c3776f549dea887ace26dae492c
0925 01:49:49.711587 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:49.804299 (+ 92712us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.017460 (+213161us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.114773 (+ 97313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7641,"tablet-delete.queue_time_us":3389376}
I20260925 01:49:50.115525 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3b5c5e5eccf6419294fcf649547572ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.115674 11946 tablet_replica.cc:333] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:50.115904 11946 raft_consensus.cc:2243] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:49:50.116110 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b5c5e5eccf6419294fcf649547572ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.116375 11946 raft_consensus.cc:2272] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.117826 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b9937c3776f549dea887ace26dae492c (table default.Table_7b5309958b834d63b67d8a48293e5edd [id=96eed11bd70c486199e13071d27865da]) successfully deleted
I20260925 01:49:50.119712 11946 ts_tablet_manager.cc:1916] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:50.120699 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4aba0779435d4c10be3a8cd86662cb8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.122553 11755 raft_consensus.cc:359] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.122776 11755 raft_consensus.cc:385] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.122851 11755 raft_consensus.cc:740] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.123114 11755 consensus_queue.cc:260] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.123648 11755 ts_tablet_manager.cc:1434] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.029s user 0.001s sys 0.000s
I20260925 01:49:50.124221 11753 ts_tablet_manager.cc:1434] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.067s user 0.001s sys 0.001s
I20260925 01:49:50.124291 11755 tablet_bootstrap.cc:492] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:50.127933 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1b6ea676a1f4d99807029d8401251ef consensus state has no leader
I20260925 01:49:50.128955 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 04f412cbebe04a629070aecf2753287c (DEFAULT_TABLE table=default.Table_74c3e602a0454e0e8b4e734dc8dea4c6 [id=34ad0afe75be4b6b97e619d27ca2da1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.129042 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 04f412cbebe04a629070aecf2753287c (DEFAULT_TABLE table=default.Table_74c3e602a0454e0e8b4e734dc8dea4c6 [id=34ad0afe75be4b6b97e619d27ca2da1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.129487 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f412cbebe04a629070aecf2753287c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.132977 11755 tablet_bootstrap.cc:654] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.136037 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 04f412cbebe04a629070aecf2753287c (DEFAULT_TABLE table=default.Table_74c3e602a0454e0e8b4e734dc8dea4c6 [id=34ad0afe75be4b6b97e619d27ca2da1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.137393 11754 tablet_bootstrap.cc:492] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:50.137646 11754 ts_tablet_manager.cc:1403] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.079s user 0.004s sys 0.005s
I20260925 01:49:50.139106 11754 raft_consensus.cc:359] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.139393 11754 raft_consensus.cc:385] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.139516 11754 raft_consensus.cc:740] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.139889 11754 consensus_queue.cc:260] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.140551 11754 ts_tablet_manager.cc:1434] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260925 01:49:50.151098 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f412cbebe04a629070aecf2753287c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.155714 11753 tablet_bootstrap.cc:492] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:50.157882 12105 raft_consensus.cc:493] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.158152 12105 raft_consensus.cc:515] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.159080 12105 leader_election.cc:290] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.160549 11753 tablet_bootstrap.cc:654] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:50.166180 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 69576.8us
I20260925 01:49:50.191419 11754 tablet_bootstrap.cc:492] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:50.197448 11965 raft_consensus.cc:493] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.197721 11965 raft_consensus.cc:515] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.198518 11965 leader_election.cc:290] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.198767 11965 consensus_queue.cc:1048] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:50.198992 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "357963616763428fa69c7670e760f84e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:50.199313 11380 raft_consensus.cc:2468] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:50.202495 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f412cbebe04a629070aecf2753287c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.206804 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 37) took 3727 ms. Trace:
I20260925 01:49:50.206936 11953 rpcz_store.cc:276] 0925 01:49:46.479758 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.479826 (+ 68us) service_pool.cc:224] Handling call
0925 01:49:49.921753 (+3441927us) ts_tablet_manager.cc:1151] Deleting tablet 1396d679e5824c469490170d257f6a9b
0925 01:49:49.921767 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.004059 (+ 82292us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.108636 (+104577us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.206734 (+ 98098us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3440107}
I20260925 01:49:50.207407 11953 tablet_replica.cc:333] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:50.207677 11953 raft_consensus.cc:2243] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:50.207948 11953 raft_consensus.cc:2272] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.208556 11953 ts_tablet_manager.cc:1916] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.211663 11177 leader_election.cc:304] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:50.212016 12233 raft_consensus.cc:2804] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:50.212119 12233 raft_consensus.cc:493] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:50.212244 12233 raft_consensus.cc:3060] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.212589 11931 ts_tablet_manager.cc:1929] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:50.212735 11931 log.cc:1199] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8d208d580a2c4c27bd614ccc88088384
I20260925 01:49:50.213284 11931 ts_tablet_manager.cc:1950] T 8d208d580a2c4c27bd614ccc88088384 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:50.224937 11973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:49:50.233546 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 64) took 3407 ms. Trace:
I20260925 01:49:50.233685 11931 rpcz_store.cc:276] 0925 01:49:46.826224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.826458 (+ 234us) service_pool.cc:224] Handling call
0925 01:49:50.019942 (+3193484us) ts_tablet_manager.cc:1151] Deleting tablet 8d208d580a2c4c27bd614ccc88088384
0925 01:49:50.019951 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.104508 (+ 84557us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.212506 (+107998us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.233475 (+ 20969us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3193264}
I20260925 01:49:50.234486 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8d208d580a2c4c27bd614ccc88088384 (table default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e]) successfully deleted
I20260925 01:49:50.234918 11973 hybrid_clock.cc:648] HybridClock initialized: now 1790300990234768 us; error 132 us; skew 500 ppm
I20260925 01:49:50.235036 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 75) took 3132 ms. Trace:
I20260925 01:49:50.235128 11931 rpcz_store.cc:276] 0925 01:49:47.102723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.103076 (+ 353us) service_pool.cc:224] Handling call
0925 01:49:50.234819 (+3131743us) ts_tablet_manager.cc:1151] Deleting tablet 596f8ddbcd16458aa4f287f4f11282a1
0925 01:49:50.234834 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.234977 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3126254}
I20260925 01:49:50.235548 11973 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260925 01:49:50.235687 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 596f8ddbcd16458aa4f287f4f11282a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596f8ddbcd16458aa4f287f4f11282a1 already in progress: creating tablet
I20260925 01:49:50.236238 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 76) took 3075 ms. Trace:
I20260925 01:49:50.236353 11931 rpcz_store.cc:276] 0925 01:49:47.160711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.160786 (+ 75us) service_pool.cc:224] Handling call
0925 01:49:50.236024 (+3075238us) ts_tablet_manager.cc:1151] Deleting tablet 38082c23d99148bb916b0ae74fd474b8
0925 01:49:50.236051 (+ 27us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.236181 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3074985}
W20260925 01:49:50.236884 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 38082c23d99148bb916b0ae74fd474b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38082c23d99148bb916b0ae74fd474b8 already in progress: creating tablet
I20260925 01:49:50.237452 11931 tablet_replica.cc:333] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:50.237684 11931 raft_consensus.cc:2243] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:50.237954 11931 raft_consensus.cc:2272] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.238838 11931 ts_tablet_manager.cc:1916] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.240743 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d7b8d87cdc614126a5b456bfaef70491"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.241672 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7b8d87cdc614126a5b456bfaef70491 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:50.244040 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6e9bc6f6c7346bfadbd79b8d494641e consensus state has no leader
I20260925 01:49:50.244217 11754 tablet_bootstrap.cc:654] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.244565 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet a3358b78a1da48388d1f72536b1ed0a2 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:50.187526 12169 raft_consensus.cc:493] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:50.248270 12169 raft_consensus.cc:515] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.249207 12169 leader_election.cc:290] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.199329 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "357963616763428fa69c7670e760f84e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:50.250185 11176 leader_election.cc:343] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.250558 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet 784de8c6e6e1434a91106dd19cd9262a from {username='slave'} at 127.0.0.1:60372
W20260925 01:49:50.251900 11456 leader_election.cc:343] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 105fd502b74d442eb5d5031f56e5cb62
I20260925 01:49:50.255143 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d208d580a2c4c27bd614ccc88088384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.255414 11973 webserver.cc:533] Webserver started at http://127.10.159.252:38543/ using document root <none> and password file <none>
I20260925 01:49:50.256584 11973 fs_manager.cc:362] Metadata directory not provided
I20260925 01:49:50.256780 11973 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:49:50.259321 11754 tablet_bootstrap.cc:492] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:50.259557 11754 ts_tablet_manager.cc:1403] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.003s
I20260925 01:49:50.260357 11754 raft_consensus.cc:359] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.260597 11754 raft_consensus.cc:385] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.260696 11754 raft_consensus.cc:740] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.260953 11754 consensus_queue.cc:260] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.261507 11754 ts_tablet_manager.cc:1434] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:50.261857 11754 tablet_bootstrap.cc:492] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:50.266669 11753 tablet_bootstrap.cc:492] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:50.266894 11753 ts_tablet_manager.cc:1403] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.111s user 0.002s sys 0.003s
I20260925 01:49:50.267930 11753 raft_consensus.cc:359] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.268188 11753 raft_consensus.cc:385] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.268280 11753 raft_consensus.cc:740] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.277818 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet e7623999b3c04ca69672a1e43fa6921f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.278523 11973 fs_manager.cc:714] Time spent opening directory manager: real 0.018s user 0.010s sys 0.001s
I20260925 01:49:50.278627 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f1000553782a4118a246bbda71eaf618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.279673 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1000553782a4118a246bbda71eaf618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.281278 11753 consensus_queue.cc:260] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.301481 12080 raft_consensus.cc:493] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.301712 12080 raft_consensus.cc:515] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.302501 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet b05053f5646f4748a99647b7dbfae686 with delete_type TABLET_DATA_DELETED (replaced by tablet e2b9df8d98e5414186ef23b8b7f9cb61) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.307524 11753 ts_tablet_manager.cc:1434] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.041s user 0.000s sys 0.003s
I20260925 01:49:50.309031 12233 raft_consensus.cc:515] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.310220 12233 leader_election.cc:290] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.313220 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "357963616763428fa69c7670e760f84e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:50.314037 11176 leader_election.cc:343] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.327538 11754 tablet_bootstrap.cc:654] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.328924 12080 leader_election.cc:290] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.329175 11755 tablet_bootstrap.cc:492] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:50.329349 11755 ts_tablet_manager.cc:1403] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.205s user 0.044s sys 0.076s
I20260925 01:49:50.330286 11755 raft_consensus.cc:359] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.330569 11755 raft_consensus.cc:385] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.330730 11755 raft_consensus.cc:740] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.331040 11755 consensus_queue.cc:260] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.331611 11755 ts_tablet_manager.cc:1434] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:50.332222 11753 tablet_bootstrap.cc:492] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:50.332540 11755 tablet_bootstrap.cc:492] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:50.336403 11755 tablet_bootstrap.cc:654] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.341562 11753 tablet_bootstrap.cc:654] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.341751 11754 tablet_bootstrap.cc:492] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:50.341940 11754 ts_tablet_manager.cc:1403] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.000s
I20260925 01:49:50.344107 11754 raft_consensus.cc:359] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.344360 11754 raft_consensus.cc:385] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.344465 11754 raft_consensus.cc:740] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.344762 11754 consensus_queue.cc:260] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.345386 11754 ts_tablet_manager.cc:1434] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:49:50.345768 11754 tablet_bootstrap.cc:492] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:50.351501 12137 raft_consensus.cc:493] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.351665 12137 raft_consensus.cc:515] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.352412 12137 leader_election.cc:290] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:50.354140 11456 leader_election.cc:343] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c42d96d45e8c4e8e8bee374477cfb0bb
I20260925 01:49:50.354455 11755 tablet_bootstrap.cc:492] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:50.354655 11755 ts_tablet_manager.cc:1403] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.005s
I20260925 01:49:50.355820 11755 raft_consensus.cc:359] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.356078 11755 raft_consensus.cc:385] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.356160 11755 raft_consensus.cc:740] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.356460 11755 consensus_queue.cc:260] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.357023 11755 ts_tablet_manager.cc:1434] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:50.357358 11755 tablet_bootstrap.cc:492] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:50.358191 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b4bf650809e3446080a35f549aaa9964" } new_table_name: "default.Table_2da4b76cb6af4fe8bb2540ddec9231de" modify_external_catalogs: true
I20260925 01:49:50.359288 11755 tablet_bootstrap.cc:654] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.363060 11754 tablet_bootstrap.cc:654] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.365846 12080 raft_consensus.cc:493] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.366101 12080 raft_consensus.cc:515] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.367421 12080 leader_election.cc:290] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.369607 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:49:50.370570 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet 8dd27c6d835948ba859b4c11d8ebf783 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:50.372164 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:49:50.372996 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet 257e6f224f99427eb68fd61fa1aadae0 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:50.377135 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.377458 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.386586 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76845ed48045b7b3632179be022e5f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:50.386842 11375 raft_consensus.cc:2468] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:50.387521 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b2202b3e9b174d9a9bff1f005144d412"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.387800 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:50.388059 11523 raft_consensus.cc:2393] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
W20260925 01:49:50.388336 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2202b3e9b174d9a9bff1f005144d412 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.390627 12233 raft_consensus.cc:493] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.390897 12233 raft_consensus.cc:515] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.391749 12233 leader_election.cc:290] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.398342 11239 raft_consensus.cc:3060] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.399561 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:50.399887 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.400154 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:50.400347 11176 leader_election.cc:343] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.405511 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56
I20260925 01:49:50.408689 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.415145 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a3358b78a1da48388d1f72536b1ed0a2
I20260925 01:49:50.415854 11677 catalog_manager.cc:6934] ReplaceTablet: tablet a3358b78a1da48388d1f72536b1ed0a2 deleted and replaced by tablet 406d31139e1e441aa6fe204168486e28
I20260925 01:49:50.416638 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 784de8c6e6e1434a91106dd19cd9262a
I20260925 01:49:50.417222 11679 catalog_manager.cc:6934] ReplaceTablet: tablet 784de8c6e6e1434a91106dd19cd9262a deleted and replaced by tablet 35b123ac1e894239875404438ed19927
I20260925 01:49:50.419548 11754 tablet_bootstrap.cc:492] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:50.419809 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.422320 11753 tablet_bootstrap.cc:492] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:50.422569 11753 ts_tablet_manager.cc:1403] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.115s user 0.003s sys 0.002s
I20260925 01:49:50.423211 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet a3358b78a1da48388d1f72536b1ed0a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 406d31139e1e441aa6fe204168486e28) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.423555 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 784de8c6e6e1434a91106dd19cd9262a with delete_type TABLET_DATA_DELETED (replaced by tablet 35b123ac1e894239875404438ed19927) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.423550 11754 ts_tablet_manager.cc:1403] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.077s user 0.018s sys 0.009s
I20260925 01:49:50.424397 12240 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260925 01:49:50.426282 11753 raft_consensus.cc:359] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.426518 11753 raft_consensus.cc:385] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.426618 11753 raft_consensus.cc:740] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.426988 11753 consensus_queue.cc:260] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.428737 11753 ts_tablet_manager.cc:1434] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260925 01:49:50.431227 11753 tablet_bootstrap.cc:492] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:50.432931 11973 fs_manager.cc:730] Time spent opening block manager: real 0.152s user 0.042s sys 0.037s
I20260925 01:49:50.433573 11753 tablet_bootstrap.cc:654] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.433127 11973 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
uuid: "ca2cee7752c249f68a372ef5c6a18bff"
format_stamp: "Formatted at 2026-09-25 01:49:38 on dist-test-slave-xxxl"
I20260925 01:49:50.439939 11973 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 01:49:50.440908 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 784de8c6e6e1434a91106dd19cd9262a with delete_type TABLET_DATA_DELETED (replaced by tablet 35b123ac1e894239875404438ed19927) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.441413 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet a3358b78a1da48388d1f72536b1ed0a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 406d31139e1e441aa6fe204168486e28) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.441918 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d76845ed48045b7b3632179be022e5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.442345 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe174270f24ff780c212eaef90ef0d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:50.443492 11754 raft_consensus.cc:359] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.443964 11754 raft_consensus.cc:385] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.444128 11754 raft_consensus.cc:740] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.444516 11754 consensus_queue.cc:260] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.446524 11517 raft_consensus.cc:2468] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:50.447032 11457 leader_election.cc:304] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:50.448010 12069 raft_consensus.cc:2804] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:50.447911 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:50.448117 12069 raft_consensus.cc:493] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:50.448287 11242 raft_consensus.cc:2468] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:50.448375 12069 raft_consensus.cc:3060] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.449030 11754 ts_tablet_manager.cc:1434] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.025s user 0.000s sys 0.003s
I20260925 01:49:50.449472 11754 tablet_bootstrap.cc:492] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:50.452219 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 31fe174270f24ff780c212eaef90ef0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.455711 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:50.457080 11456 consensus_peers.cc:597] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:50.457343 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3150980bb72435886486156aa98d342 consensus state has no leader
I20260925 01:49:50.457623 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8dd27c6d835948ba859b4c11d8ebf783
I20260925 01:49:50.458758 11673 catalog_manager.cc:6934] ReplaceTablet: tablet 8dd27c6d835948ba859b4c11d8ebf783 deleted and replaced by tablet 0c01195f07b84b359a974fab5ed52582
I20260925 01:49:50.461566 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f7f257d6361c41b08685b0f8cdeac396" } modify_external_catalogs: true
I20260925 01:49:50.461913 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f7f257d6361c41b08685b0f8cdeac396" } modify_external_catalogs: true
I20260925 01:49:50.462126 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_71c7a46468e24855b65e14b9221f5930"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.462365 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9cb04782490848a79ec41ab36549c475" } modify_external_catalogs: true
I20260925 01:49:50.462579 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9cb04782490848a79ec41ab36549c475" } modify_external_catalogs: true
W20260925 01:49:50.462857 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71c7a46468e24855b65e14b9221f5930 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.465071 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_84f0f4996f3d4d609ad1b68dfa611853" } new_table_name: "default.Table_d658fd300e03462995eddeb99aaf8f45" modify_external_catalogs: true
I20260925 01:49:50.467229 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4dc4550a013e44da8eecc5fc94e0bd3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.468022 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dc4550a013e44da8eecc5fc94e0bd3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.469893 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0bc7dfa4dadb42fb8d8b5e24e86a2558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.473735 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.474258 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 257e6f224f99427eb68fd61fa1aadae0
I20260925 01:49:50.476105 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.478801 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.479025 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_205d65fa20234c96af8350d123668897" } new_table_name: "default.Table_f4d283936a5f426f85bb58068bf1ba85" modify_external_catalogs: true
I20260925 01:49:50.482434 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd27c6d835948ba859b4c11d8ebf783 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c01195f07b84b359a974fab5ed52582) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:50.485980 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bc7dfa4dadb42fb8d8b5e24e86a2558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.487128 11680 catalog_manager.cc:6934] ReplaceTablet: tablet 257e6f224f99427eb68fd61fa1aadae0 deleted and replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7
I20260925 01:49:50.487675 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1e338da7b98a48a4b9612f4b5ca1fd65" } new_table_name: "default.Table_95ebdd9395354eba91e3babd76028061" modify_external_catalogs: true
I20260925 01:49:50.488329 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 784de8c6e6e1434a91106dd19cd9262a with delete_type TABLET_DATA_DELETED (replaced by tablet 35b123ac1e894239875404438ed19927) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.488359 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_04ba88f4ea89466a9be2799b103547fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.489248 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04ba88f4ea89466a9be2799b103547fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.490080 12242 raft_consensus.cc:493] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:49:50.490659 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet a3358b78a1da48388d1f72536b1ed0a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 406d31139e1e441aa6fe204168486e28) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.491185 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 with delete_type TABLET_DATA_DELETED (replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.493160 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 with delete_type TABLET_DATA_DELETED (replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.498088 11946 ts_tablet_manager.cc:1929] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:50.498379 11946 log.cc:1199] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/4e008337914841b8a1ab4a64ecc6e181
I20260925 01:49:50.490316 12242 raft_consensus.cc:515] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.499740 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd27c6d835948ba859b4c11d8ebf783 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c01195f07b84b359a974fab5ed52582) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.499955 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c28c9e51d80a442486b78be32c74a94f
I20260925 01:49:50.500492 12242 leader_election.cc:290] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.501230 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7abda750abd14e078780e34ba4951149" } new_table_name: "default.Table_b693b8f3dca9446f917874b3d6f6d0ca" modify_external_catalogs: true
I20260925 01:49:50.501727 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d6d1d600af5a4b329a7548842f2d1ece"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.502288 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6d1d600af5a4b329a7548842f2d1ece in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.502650 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "357963616763428fa69c7670e760f84e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:50.502931 11380 raft_consensus.cc:3060] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.505929 11380 raft_consensus.cc:2468] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:50.507905 11375 raft_consensus.cc:3060] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.508101 11953 ts_tablet_manager.cc:1929] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:50.508245 11953 log.cc:1199] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a9e1f114c2a749d4af6a366c044f5ea5
I20260925 01:49:50.508713 11953 ts_tablet_manager.cc:1950] T a9e1f114c2a749d4af6a366c044f5ea5 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:50.512653 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c9e51d80a442486b78be32c74a94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.502701 12069 raft_consensus.cc:515] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.514307 12069 leader_election.cc:290] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.511163 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c9e51d80a442486b78be32c74a94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.515267 11946 ts_tablet_manager.cc:1950] T 4e008337914841b8a1ab4a64ecc6e181 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:50.516191 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 23) took 4192 ms. Trace:
I20260925 01:49:50.516304 11946 rpcz_store.cc:276] 0925 01:49:46.323573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.323629 (+ 56us) service_pool.cc:224] Handling call
0925 01:49:50.115595 (+3791966us) ts_tablet_manager.cc:1151] Deleting tablet 4e008337914841b8a1ab4a64ecc6e181
0925 01:49:50.115606 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.370883 (+255277us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.450931 (+ 80048us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.516143 (+ 65212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3791768}
I20260925 01:49:50.516815 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 4e008337914841b8a1ab4a64ecc6e181 (table default.Table_f80924a5cd5f4ef6a9c15df97a24dd6d [id=4936b4c5822241e78c7004d9f7ba3f78]) successfully deleted
I20260925 01:49:50.518939 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 with delete_type TABLET_DATA_DELETED (replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.523419 11755 tablet_bootstrap.cc:492] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:50.524834 11946 tablet_replica.cc:333] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:50.525115 11946 raft_consensus.cc:2243] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:50.525381 11755 ts_tablet_manager.cc:1403] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.168s user 0.010s sys 0.030s
I20260925 01:49:50.525658 11946 raft_consensus.cc:2272] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.528131 11946 ts_tablet_manager.cc:1916] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.529556 12242 raft_consensus.cc:493] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:50.529744 12242 raft_consensus.cc:515] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.530402 12242 leader_election.cc:290] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.532743 11755 raft_consensus.cc:359] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.533017 11755 raft_consensus.cc:385] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.533143 11755 raft_consensus.cc:740] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.533890 11755 consensus_queue.cc:260] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.535557 11755 ts_tablet_manager.cc:1434] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:49:50.536453 11755 tablet_bootstrap.cc:492] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:50.539033 11457 leader_election.cc:343] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: 105fd502b74d442eb5d5031f56e5cb62
I20260925 01:49:50.539214 11457 leader_election.cc:304] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:50.539786 12169 raft_consensus.cc:2749] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:49:50.540506 11457 leader_election.cc:343] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: c42d96d45e8c4e8e8bee374477cfb0bb
I20260925 01:49:50.540673 11755 tablet_bootstrap.cc:654] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.540675 11457 leader_election.cc:304] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:50.540885 11457 raft_consensus.cc:2686] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:50.544606 12242 raft_consensus.cc:493] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.544775 12242 raft_consensus.cc:515] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:50.544884 11314 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b05053f5646f4748a99647b7dbfae686
I20260925 01:49:50.545441 12242 leader_election.cc:290] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:49:50.545665 11314 leader_election.cc:343] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 31fe174270f24ff780c212eaef90ef0d
I20260925 01:49:50.545964 11314 leader_election.cc:304] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:50.557883 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dd27c6d835948ba859b4c11d8ebf783 with delete_type TABLET_DATA_DELETED (replaced by tablet 0c01195f07b84b359a974fab5ed52582) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.562047 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c11632e9ce934a888e72894235561dcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.562785 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c11632e9ce934a888e72894235561dcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.547282 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:50.570318 11372 raft_consensus.cc:2468] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:50.547915 11378 raft_consensus.cc:3060] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.571309 12080 raft_consensus.cc:2804] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:50.571456 12080 raft_consensus.cc:493] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:50.571563 12080 raft_consensus.cc:3060] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.571893 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_77d531160dc245eaaac97f131d587441"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.572595 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77d531160dc245eaaac97f131d587441 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.573019 11314 leader_election.cc:304] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:50.573431 12242 raft_consensus.cc:3060] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:50.574842 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1b6ea676a1f4d99807029d8401251ef consensus state has no leader
I20260925 01:49:50.577921 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bc79315e26e64754b7ae9ce08ba0a88d" } modify_external_catalogs: true
I20260925 01:49:50.578240 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bc79315e26e64754b7ae9ce08ba0a88d" } modify_external_catalogs: true
I20260925 01:49:50.578516 11314 leader_election.cc:304] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:50.577921 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ef187190ed9e4b7d910df53df764f469" } modify_external_catalogs: true
I20260925 01:49:50.578903 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ef187190ed9e4b7d910df53df764f469" } modify_external_catalogs: true
I20260925 01:49:50.579175 12105 raft_consensus.cc:2804] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:50.579293 12105 raft_consensus.cc:493] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:50.579468 12105 raft_consensus.cc:3060] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.579599 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 38) took 4097 ms. Trace:
W20260925 01:49:50.580389 11314 leader_election.cc:343] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.580895 11931 ts_tablet_manager.cc:1929] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:50.582093 11754 tablet_bootstrap.cc:654] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.579721 11953 rpcz_store.cc:276] 0925 01:49:46.482148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.482199 (+ 51us) service_pool.cc:224] Handling call
0925 01:49:50.207239 (+3725040us) ts_tablet_manager.cc:1151] Deleting tablet a9e1f114c2a749d4af6a366c044f5ea5
0925 01:49:50.207249 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.410987 (+203738us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.507979 (+ 96992us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.579550 (+ 71571us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3724786}
I20260925 01:49:50.582510 11953 tablet_replica.cc:333] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:50.582731 11953 raft_consensus.cc:2243] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:50.582919 11953 raft_consensus.cc:2272] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.583185 11753 tablet_bootstrap.cc:492] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:50.583375 11753 ts_tablet_manager.cc:1403] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.152s user 0.006s sys 0.006s
I20260925 01:49:50.583534 11953 ts_tablet_manager.cc:1916] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.583449 11177 leader_election.cc:304] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:50.583842 11931 log.cc:1199] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/200caea41ba4466386b091875f017956
I20260925 01:49:50.584352 11753 raft_consensus.cc:359] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.586024 11931 ts_tablet_manager.cc:1950] T 200caea41ba4466386b091875f017956 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:50.586993 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 77) took 3384 ms. Trace:
I20260925 01:49:50.587145 11931 rpcz_store.cc:276] 0925 01:49:47.202868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.203851 (+ 983us) service_pool.cc:224] Handling call
0925 01:49:50.237362 (+3033511us) ts_tablet_manager.cc:1151] Deleting tablet 200caea41ba4466386b091875f017956
0925 01:49:50.237372 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.384841 (+147469us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.517330 (+132489us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.586954 (+ 69624us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3033189}
I20260925 01:49:50.587602 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 85) took 3174 ms. Trace:
I20260925 01:49:50.587687 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a9e1f114c2a749d4af6a366c044f5ea5 (table default.Table_43fcb0af03694aafb7d0f246fb1b2815 [id=3dd1eb1f66404d10a4398f52c951bf72]) successfully deleted
I20260925 01:49:50.587703 11931 rpcz_store.cc:276] 0925 01:49:47.413000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.413250 (+ 250us) service_pool.cc:224] Handling call
0925 01:49:50.587445 (+3174195us) ts_tablet_manager.cc:1151] Deleting tablet 19c718c83cfe49b9a745e06314e24409
0925 01:49:50.587456 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.587560 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3173711}
I20260925 01:49:50.588066 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 86) took 3168 ms. Trace:
I20260925 01:49:50.588181 11931 rpcz_store.cc:276] 0925 01:49:47.419794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.419849 (+ 55us) service_pool.cc:224] Handling call
0925 01:49:50.587934 (+3168085us) ts_tablet_manager.cc:1151] Deleting tablet 02f9e96bcdf9418ea54dc73bf68a2be6
0925 01:49:50.587943 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.588027 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3167686}
I20260925 01:49:50.588589 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 87) took 3165 ms. Trace:
I20260925 01:49:50.590755 11753 raft_consensus.cc:385] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.590888 11753 raft_consensus.cc:740] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.591981 11753 consensus_queue.cc:260] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.595324 11755 tablet_bootstrap.cc:492] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:50.595590 11755 ts_tablet_manager.cc:1403] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.060s user 0.014s sys 0.022s
I20260925 01:49:50.588702 11931 rpcz_store.cc:276] 0925 01:49:47.423478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.424761 (+ 1283us) service_pool.cc:224] Handling call
0925 01:49:50.588415 (+3163654us) ts_tablet_manager.cc:1151] Deleting tablet 347a144e18ab4f6e834551044a2ac4ae
0925 01:49:50.588433 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.588542 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3118228}
I20260925 01:49:50.596796 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 90) took 3127 ms. Trace:
I20260925 01:49:50.596956 11931 rpcz_store.cc:276] 0925 01:49:47.469005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.470525 (+ 1520us) service_pool.cc:224] Handling call
0925 01:49:50.596480 (+3125955us) ts_tablet_manager.cc:1151] Deleting tablet 55e9d52e3f79408a99216250aefc45c8
0925 01:49:50.596492 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.596660 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3125776}
I20260925 01:49:50.596745 11755 raft_consensus.cc:359] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.597529 11755 raft_consensus.cc:385] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.597654 11755 raft_consensus.cc:740] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.598022 11755 consensus_queue.cc:260] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.598830 11753 ts_tablet_manager.cc:1434] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.015s user 0.001s sys 0.002s
I20260925 01:49:50.600577 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 91) took 3117 ms. Trace:
I20260925 01:49:50.600739 11931 rpcz_store.cc:276] 0925 01:49:47.483526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.486197 (+ 2671us) service_pool.cc:224] Handling call
0925 01:49:50.597261 (+3111064us) ts_tablet_manager.cc:1151] Deleting tablet 039ee80a2822417898c1d1d779f52867
0925 01:49:50.597275 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.600503 (+ 3228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3110614}
I20260925 01:49:50.601585 11753 tablet_bootstrap.cc:492] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:50.602589 11755 ts_tablet_manager.cc:1434] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260925 01:49:50.603034 11755 tablet_bootstrap.cc:492] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:50.601143 11931 tablet_replica.cc:333] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:50.608407 11753 tablet_bootstrap.cc:654] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.616834 11755 tablet_bootstrap.cc:654] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.632362 11754 tablet_bootstrap.cc:492] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:50.632604 11754 ts_tablet_manager.cc:1403] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.183s user 0.006s sys 0.003s
I20260925 01:49:50.633695 11754 raft_consensus.cc:359] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.634027 11754 raft_consensus.cc:385] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.634181 11754 raft_consensus.cc:740] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.634445 11754 consensus_queue.cc:260] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.635840 11753 tablet_bootstrap.cc:492] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:50.637761 11753 ts_tablet_manager.cc:1403] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.000s
I20260925 01:49:50.642956 11753 raft_consensus.cc:359] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:50.643596 11753 raft_consensus.cc:385] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.643605 11965 raft_consensus.cc:2804] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:50.643846 11753 raft_consensus.cc:740] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.644317 11753 consensus_queue.cc:260] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:50.646407 11753 ts_tablet_manager.cc:1434] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:49:50.648699 11753 tablet_bootstrap.cc:492] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:50.652040 11753 tablet_bootstrap.cc:654] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.657784 11973 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:49:50.658468 11753 tablet_bootstrap.cc:492] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:50.658703 11753 ts_tablet_manager.cc:1403] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20260925 01:49:50.661685 11753 raft_consensus.cc:359] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.661993 11753 raft_consensus.cc:385] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.663480 11753 raft_consensus.cc:740] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.664201 11753 consensus_queue.cc:260] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:50.665521 11965 raft_consensus.cc:697] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:50.665926 11965 consensus_queue.cc:237] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.667423 11973 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:49:50.667696 11753 ts_tablet_manager.cc:1434] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260925 01:49:50.669345 11753 tablet_bootstrap.cc:492] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:50.670048 11973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:49:50.673171 11753 tablet_bootstrap.cc:654] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:50.673823 11665 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f0157a45817246cfaa0b016afdbd59cb (table default.Table_d82fb9eb56a0497cb5f94dc964e94656 [id=c3bda2bcc66f4f4ea55f4a7066905c87], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f0157a45817246cfaa0b016afdbd59cb consensus state has no leader
I20260925 01:49:50.682440 11946 ts_tablet_manager.cc:1929] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:50.682615 11946 log.cc:1199] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c42d96d45e8c4e8e8bee374477cfb0bb
I20260925 01:49:50.683086 11946 ts_tablet_manager.cc:1950] T c42d96d45e8c4e8e8bee374477cfb0bb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:50.683552 12080 raft_consensus.cc:515] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.684335 12080 leader_election.cc:290] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.686136 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c9e51d80a442486b78be32c74a94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:50.687003 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 19c718c83cfe49b9a745e06314e24409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19c718c83cfe49b9a745e06314e24409 already in progress: creating tablet
W20260925 01:49:50.687620 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02f9e96bcdf9418ea54dc73bf68a2be6 already in progress: creating tablet
W20260925 01:49:50.688165 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 347a144e18ab4f6e834551044a2ac4ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 347a144e18ab4f6e834551044a2ac4ae already in progress: creating tablet
W20260925 01:49:50.688616 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 55e9d52e3f79408a99216250aefc45c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55e9d52e3f79408a99216250aefc45c8 already in progress: creating tablet
I20260925 01:49:50.688779 12233 raft_consensus.cc:493] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac4ec033f794d7a90b52aa4e0b6155d)
I20260925 01:49:50.688964 12233 raft_consensus.cc:515] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:50.689098 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 039ee80a2822417898c1d1d779f52867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 039ee80a2822417898c1d1d779f52867 already in progress: creating tablet
I20260925 01:49:50.689924 12233 leader_election.cc:290] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.691047 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:50.691861 12233 consensus_queue.cc:1048] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:50.698657 11753 tablet_bootstrap.cc:492] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:50.698881 11753 ts_tablet_manager.cc:1403] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.003s
I20260925 01:49:50.699898 11753 raft_consensus.cc:359] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.700089 11753 raft_consensus.cc:385] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.700229 11753 raft_consensus.cc:740] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.700610 11753 consensus_queue.cc:260] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.701287 11753 ts_tablet_manager.cc:1434] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:50.703783 12079 raft_consensus.cc:493] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.703981 12079 raft_consensus.cc:515] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.704800 12079 leader_election.cc:290] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.706770 11753 tablet_bootstrap.cc:492] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:50.710414 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76845ed48045b7b3632179be022e5f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:50.710678 11239 raft_consensus.cc:3060] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:50.710803 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f892954cd22c48aaad2f0e20b1277844 consensus state has no leader
I20260925 01:49:50.713501 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c3024aeca0894967b8d02b5871425583" } modify_external_catalogs: true
I20260925 01:49:50.713707 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c3024aeca0894967b8d02b5871425583" } modify_external_catalogs: true
I20260925 01:49:50.713788 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_205d65fa20234c96af8350d123668897 [id=56d41c65456f4cf691b9f87319014030]). Expected version 2 got 0
I20260925 01:49:50.714857 11358 tablet_service.cc:1511] Processing CreateTablet for tablet e6b97d37704f4a0d88457d124bb4f259 (DEFAULT_TABLE table=default.Table_7df458fb50104adaac9587ce837b400b [id=7a90fa18b2534fac8ae77f73f0e4e3cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.715390 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_997e0c8809ba4ba198f70270f4183297"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.716038 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_997e0c8809ba4ba198f70270f4183297 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.719699 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d143a5ee928e48efae3ed675e65f4871"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.720444 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d143a5ee928e48efae3ed675e65f4871 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:50.722415 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 consensus state has no leader
I20260925 01:49:50.723114 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4f4321544a4f1d9de2e50aa5d7b42a (DEFAULT_TABLE table=default.Table_d8fab09ad424478dbf94ca9d17938d66 [id=4ae192d3d67e45608f90573dc387c053]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:50.724828 11664 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260925 01:49:50.725404 11177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 177193us
I20260925 01:49:50.725809 11360 tablet_service.cc:1511] Processing CreateTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 (DEFAULT_TABLE table=default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.725917 11177 leader_election.cc:304] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:50.726527 12233 raft_consensus.cc:2804] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:50.726637 12233 raft_consensus.cc:493] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:50.726758 12233 raft_consensus.cc:3060] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.728951 11931 raft_consensus.cc:2243] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:50.728987 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.729619 11931 raft_consensus.cc:2272] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.730278 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 (DEFAULT_TABLE table=default.Table_c3024aeca0894967b8d02b5871425583 [id=044f915b5cf14e089a2b225ac86d295d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.730688 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:50.731365 11314 consensus_peers.cc:597] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9937c3776f549dea887ace26dae492c. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:50.731675 11314 leader_election.cc:343] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5b65068a447744ec99e56489963b251c
W20260925 01:49:50.731983 11314 leader_election.cc:343] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: c75a4ed161734d30ab5ad2e2b00d77c9
I20260925 01:49:50.735121 11341 tablet_service.cc:1511] Processing CreateTablet for tablet d253f8b1e4ac41388a885178f2ed0f40 (DEFAULT_TABLE table=default.Table_d55100401c234d6593420fe96b17dfa6 [id=99a2cf74a0de4842bfaf635fdccd5975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.735713 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 60411b0feafe4fef9c4fdc364163f1df (DEFAULT_TABLE table=default.Table_09e8e9221d6b40e4ad019a42371a5e5f [id=0848b51bdadb45b5b1a5357208cfcd58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.737504 11931 ts_tablet_manager.cc:1916] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.739588 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9ccd099cba4b92909bb17c45dfce8a (DEFAULT_TABLE table=default.Table_81a22cdbb608445c9146c6b95401bffc [id=c23a94a77b36437f843f323488d4ed42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.745151 11755 tablet_bootstrap.cc:492] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:50.745460 11755 ts_tablet_manager.cc:1403] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.017s
I20260925 01:49:50.746441 11755 raft_consensus.cc:359] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.746764 11755 raft_consensus.cc:385] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:50.747411 11755 raft_consensus.cc:740] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:50.751818 11497 tablet_service.cc:1511] Processing CreateTablet for tablet e6b97d37704f4a0d88457d124bb4f259 (DEFAULT_TABLE table=default.Table_7df458fb50104adaac9587ce837b400b [id=7a90fa18b2534fac8ae77f73f0e4e3cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.752677 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:50.754160 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:50.757925 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 1396d679e5824c469490170d257f6a9b with delete_type TABLET_DATA_DELETED (replaced by tablet b2708108d6f04f858024542054024e1a) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.762832 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4f4321544a4f1d9de2e50aa5d7b42a (DEFAULT_TABLE table=default.Table_d8fab09ad424478dbf94ca9d17938d66 [id=4ae192d3d67e45608f90573dc387c053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.763474 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 60411b0feafe4fef9c4fdc364163f1df (DEFAULT_TABLE table=default.Table_09e8e9221d6b40e4ad019a42371a5e5f [id=0848b51bdadb45b5b1a5357208cfcd58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.764334 11490 tablet_service.cc:1511] Processing CreateTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 (DEFAULT_TABLE table=default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.766396 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b97d37704f4a0d88457d124bb4f259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.767125 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 (DEFAULT_TABLE table=default.Table_c3024aeca0894967b8d02b5871425583 [id=044f915b5cf14e089a2b225ac86d295d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.768152 11491 tablet_service.cc:1511] Processing CreateTablet for tablet d253f8b1e4ac41388a885178f2ed0f40 (DEFAULT_TABLE table=default.Table_d55100401c234d6593420fe96b17dfa6 [id=99a2cf74a0de4842bfaf635fdccd5975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.769639 11753 tablet_bootstrap.cc:654] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.771552 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:50.772075 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:50.772379 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9ccd099cba4b92909bb17c45dfce8a (DEFAULT_TABLE table=default.Table_81a22cdbb608445c9146c6b95401bffc [id=c23a94a77b36437f843f323488d4ed42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.773100 11517 raft_consensus.cc:2393] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:50.773816 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4f4321544a4f1d9de2e50aa5d7b42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.774148 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9ccd099cba4b92909bb17c45dfce8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.774616 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 24) took 4450 ms. Trace:
I20260925 01:49:50.774832 11946 rpcz_store.cc:276] 0925 01:49:46.324534 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.324585 (+ 51us) service_pool.cc:224] Handling call
0925 01:49:50.524733 (+4200148us) ts_tablet_manager.cc:1151] Deleting tablet c42d96d45e8c4e8e8bee374477cfb0bb
0925 01:49:50.524745 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.584025 (+ 59280us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.682319 (+ 98294us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.774570 (+ 92251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4199934}
I20260925 01:49:50.775265 11946 tablet_replica.cc:333] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:50.775427 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c42d96d45e8c4e8e8bee374477cfb0bb (table default.Table_497014a801f24f9aa384248a367ca1d7 [id=464edb71967c4016ae7592aaad5492d6]) successfully deleted
I20260925 01:49:50.775558 11946 raft_consensus.cc:2243] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:50.775975 11946 pending_rounds.cc:70] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:50.776095 11946 pending_rounds.cc:77] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072837832749056 op_type: NO_OP noop_request { }
I20260925 01:49:50.776271 11946 raft_consensus.cc:2889] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:50.776427 11946 raft_consensus.cc:2272] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.779369 12169 raft_consensus.cc:493] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.779656 12169 raft_consensus.cc:515] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.780332 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15376374d9f2401fb9bb83d2f0acf7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.780566 12169 leader_election.cc:290] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.782580 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60411b0feafe4fef9c4fdc364163f1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.784782 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d253f8b1e4ac41388a885178f2ed0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.787971 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91957f62d8044ea8f6a3464c84b9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.790359 11239 raft_consensus.cc:2468] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:50.793639 12233 raft_consensus.cc:515] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.796206 11238 raft_consensus.cc:2393] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:50.797101 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_98e49819b069428c81b83d226192a743 [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 1 got 0
I20260925 01:49:50.798308 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7623999b3c04ca69672a1e43fa6921f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:50.798465 12233 leader_election.cc:290] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:50.798612 11239 raft_consensus.cc:2468] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:50.800742 11946 ts_tablet_manager.cc:1916] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.802690 11456 leader_election.cc:304] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:49:50.803238 11456 consensus_peers.cc:597] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d208d580a2c4c27bd614ccc88088384. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:50.804009 11219 tablet_service.cc:1511] Processing CreateTablet for tablet e6b97d37704f4a0d88457d124bb4f259 (DEFAULT_TABLE table=default.Table_7df458fb50104adaac9587ce837b400b [id=7a90fa18b2534fac8ae77f73f0e4e3cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.804137 11456 leader_election.cc:304] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:50.804386 12137 raft_consensus.cc:2804] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:50.804986 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4f4321544a4f1d9de2e50aa5d7b42a (DEFAULT_TABLE table=default.Table_d8fab09ad424478dbf94ca9d17938d66 [id=4ae192d3d67e45608f90573dc387c053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.805852 11207 tablet_service.cc:1511] Processing CreateTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 (DEFAULT_TABLE table=default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.806210 12137 raft_consensus.cc:697] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:50.806551 12137 consensus_queue.cc:237] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.807001 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 (DEFAULT_TABLE table=default.Table_c3024aeca0894967b8d02b5871425583 [id=044f915b5cf14e089a2b225ac86d295d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:50.809144 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 84288.4us
I20260925 01:49:50.749387 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d76845ed48045b7b3632179be022e5f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:50.814653 11372 raft_consensus.cc:3060] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.817395 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 15376374d9f2401fb9bb83d2f0acf7b3
I20260925 01:49:50.817615 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:49:50.817950 11372 raft_consensus.cc:2468] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:50.772081 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d3626880758447e9aa85f8f9070d4e3" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:50.818543 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 06fca09010f841c5a7b58678560065f3
I20260925 01:49:50.818828 11755 consensus_queue.cc:260] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.819474 11755 ts_tablet_manager.cc:1434] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.074s user 0.002s sys 0.000s
I20260925 01:49:50.819832 11755 tablet_bootstrap.cc:492] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:50.777099 11953 ts_tablet_manager.cc:1929] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:50.820240 11953 log.cc:1199] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/5b65068a447744ec99e56489963b251c
I20260925 01:49:50.820880 11953 ts_tablet_manager.cc:1950] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:50.821090 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.821347 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.821583 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fca09010f841c5a7b58678560065f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.821623 11177 leader_election.cc:304] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:50.777390 12242 raft_consensus.cc:2749] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:50.822105 12263 consensus_queue.cc:1048] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:50.777616 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b97d37704f4a0d88457d124bb4f259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.822659 12263 raft_consensus.cc:2749] T 3d3626880758447e9aa85f8f9070d4e3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:50.821359 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 42) took 4332 ms. Trace:
I20260925 01:49:50.822813 11953 rpcz_store.cc:276] 0925 01:49:46.488383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.489090 (+ 707us) service_pool.cc:224] Handling call
0925 01:49:50.582436 (+4093346us) ts_tablet_manager.cc:1151] Deleting tablet 5b65068a447744ec99e56489963b251c
0925 01:49:50.582447 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.677818 (+ 95371us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.776991 (+ 99173us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.821289 (+ 44298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4086870}
I20260925 01:49:50.823215 11953 tablet_replica.cc:333] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:50.823437 11953 raft_consensus.cc:2243] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:50.823630 11953 raft_consensus.cc:2272] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.824231 11953 ts_tablet_manager.cc:1916] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.825515 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:50.826931 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 5b65068a447744ec99e56489963b251c (table default.Table_c6206da59ecf432cb4c65623ced807f5 [id=fe56a57c1dff44e09680b6041eeafac5]) successfully deleted
I20260925 01:49:50.828027 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4f4321544a4f1d9de2e50aa5d7b42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.829525 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d253f8b1e4ac41388a885178f2ed0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.832770 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91957f62d8044ea8f6a3464c84b9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.834537 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 60411b0feafe4fef9c4fdc364163f1df (DEFAULT_TABLE table=default.Table_09e8e9221d6b40e4ad019a42371a5e5f [id=0848b51bdadb45b5b1a5357208cfcd58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.836314 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_497014a801f24f9aa384248a367ca1d7" } new_table_name: "default.Table_0b0ce5f884684db28023373c46961746" modify_external_catalogs: true
I20260925 01:49:50.836575 11214 tablet_service.cc:1511] Processing CreateTablet for tablet d253f8b1e4ac41388a885178f2ed0f40 (DEFAULT_TABLE table=default.Table_d55100401c234d6593420fe96b17dfa6 [id=99a2cf74a0de4842bfaf635fdccd5975]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.837468 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9ccd099cba4b92909bb17c45dfce8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.838124 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9ccd099cba4b92909bb17c45dfce8a (DEFAULT_TABLE table=default.Table_81a22cdbb608445c9146c6b95401bffc [id=c23a94a77b36437f843f323488d4ed42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:50.839790 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_abb11ad0c29f45e2a38ef498da7e605b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.840461 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abb11ad0c29f45e2a38ef498da7e605b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.840924 12069 raft_consensus.cc:2804] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:50.841853 12069 raft_consensus.cc:493] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:50.841995 12069 raft_consensus.cc:3060] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:50.843741 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_40519dcfbe2e470ca48f0351bf0ea7cd" } modify_external_catalogs: true
I20260925 01:49:50.780869 12105 raft_consensus.cc:515] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.843827 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 (table default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]). Expected version 2 got 0
I20260925 01:49:50.792750 12241 raft_consensus.cc:493] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:49:50.798674 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.843984 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_40519dcfbe2e470ca48f0351bf0ea7cd" } modify_external_catalogs: true
I20260925 01:49:50.845475 12241 raft_consensus.cc:515] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.849094 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.849922 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.851312 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ec6a77ed80f04e6d8eaa7f81d505133f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.851402 11754 ts_tablet_manager.cc:1434] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.219s user 0.029s sys 0.046s
W20260925 01:49:50.851950 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec6a77ed80f04e6d8eaa7f81d505133f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.852031 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.853221 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0edb84dafd8f46f6856de68ddb449886"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.853696 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0edb84dafd8f46f6856de68ddb449886 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.853968 11754 tablet_bootstrap.cc:492] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:50.854300 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1a45113614774c6dbf41445536534f11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.854781 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a45113614774c6dbf41445536534f11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.855911 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fca09010f841c5a7b58678560065f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.855926 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15376374d9f2401fb9bb83d2f0acf7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.857555 12271 consensus_queue.cc:1048] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:50.858886 12105 leader_election.cc:290] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.854202 12241 leader_election.cc:290] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.864702 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60411b0feafe4fef9c4fdc364163f1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.864970 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15376374d9f2401fb9bb83d2f0acf7b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.865447 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60411b0feafe4fef9c4fdc364163f1df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.865511 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b91957f62d8044ea8f6a3464c84b9e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.865933 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4f4321544a4f1d9de2e50aa5d7b42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.866230 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6b97d37704f4a0d88457d124bb4f259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.867343 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9ccd099cba4b92909bb17c45dfce8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.864696 11931 ts_tablet_manager.cc:1929] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:50.879740 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 45a794ad0d87475a88efc02f5ae080f4
I20260925 01:49:50.880028 12241 raft_consensus.cc:493] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:50.881330 12241 raft_consensus.cc:515] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:50.881964 12241 leader_election.cc:290] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:50.885140 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fbb2f99ff1e94b04ac906f20c094f645"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:50.885807 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbb2f99ff1e94b04ac906f20c094f645 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.886576 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d4dec575dd5543cb92d86806b588550c" } new_table_name: "default.Table_a3c9e904392e436babfab378a07cf3a6" modify_external_catalogs: true
I20260925 01:49:50.889653 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.896579 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:50.897557 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d253f8b1e4ac41388a885178f2ed0f40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:50.899878 11931 log.cc:1199] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/e686dff5ada64f05a1c7bd914c1377a4
I20260925 01:49:50.900734 11931 ts_tablet_manager.cc:1950] T e686dff5ada64f05a1c7bd914c1377a4 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:50.901964 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 92) took 3401 ms. Trace:
I20260925 01:49:50.902099 11931 rpcz_store.cc:276] 0925 01:49:47.500435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.500499 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:50.601056 (+3100557us) ts_tablet_manager.cc:1151] Deleting tablet e686dff5ada64f05a1c7bd914c1377a4
0925 01:49:50.601067 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.729177 (+128110us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x616000170854. stack: 00007fc2a418e5c6 00007fc2a418e380 00007fc2a319634d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fc2b0282a70 00007fc2b160b583 00007fc2b41d88b7 00007fc2b420ba64 00007fc2b41ec3a0 00007fc2b41ec12d 0000000000aaef9c 00007fc2a41d4aef 00007fc2a41d7deb 00007fc2a41d7c68
0925 01:49:50.787209 (+ 58032us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.864584 (+ 77375us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.901673 (+ 37089us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286878464,"tablet-delete.queue_time_us":3100186}
I20260925 01:49:50.910789 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:50.911527 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.913497 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 93) took 3359 ms. Trace:
I20260925 01:49:50.918169 11931 rpcz_store.cc:276] 0925 01:49:47.543240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.543294 (+ 54us) service_pool.cc:224] Handling call
0925 01:49:50.902433 (+3359139us) ts_tablet_manager.cc:1151] Deleting tablet 4d7b3c65d8a64734b2c432790dae07e1
0925 01:49:50.902443 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.902562 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3358886}
I20260925 01:49:50.919921 11931 tablet_replica.cc:333] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:50.920223 11931 raft_consensus.cc:2243] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:49:50.920603 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ec82ac4f3b4d48fbbb33c21f5630d749 consensus state has no leader
I20260925 01:49:50.920670 11931 raft_consensus.cc:2272] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.921334 11931 ts_tablet_manager.cc:1916] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.924681 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 95ac080782664fca8661c188ab822e89
I20260925 01:49:50.803411 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:49:50.921662 11314 leader_election.cc:343] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5b65068a447744ec99e56489963b251c
I20260925 01:49:50.925276 11314 leader_election.cc:304] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:50.932891 11314 raft_consensus.cc:2686] T 5b65068a447744ec99e56489963b251c P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:49:50.934002 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 73510.9us
I20260925 01:49:50.935268 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet e686dff5ada64f05a1c7bd914c1377a4 (table default.Table_1a15ff4030084c1c84fadccb984297e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]) successfully deleted
I20260925 01:49:50.936237 11953 ts_tablet_manager.cc:1929] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:50.936403 11953 log.cc:1199] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a3ec6c34d22241e5bda3ec6665a47fc7
I20260925 01:49:50.939944 11754 tablet_bootstrap.cc:654] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:50.943852 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a07f37b8469a497ba3fe504cb21105d2 consensus state has no leader
I20260925 01:49:50.952832 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 95ac080782664fca8661c188ab822e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.953418 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fca09010f841c5a7b58678560065f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:50.954442 11314 leader_election.cc:343] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c75a4ed161734d30ab5ad2e2b00d77c9
I20260925 01:49:50.955346 11375 raft_consensus.cc:2393] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b93565e796c94a3699eb1824383bbaeb in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:50.961822 11314 leader_election.cc:304] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:50.963745 11314 leader_election.cc:343] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.966104 12105 raft_consensus.cc:2749] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:50.967756 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:50.968233 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:50.969990 11953 ts_tablet_manager.cc:1950] T a3ec6c34d22241e5bda3ec6665a47fc7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:50.974669 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet b9937c3776f549dea887ace26dae492c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:43 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:50.975553 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 4d7b3c65d8a64734b2c432790dae07e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d7b3c65d8a64734b2c432790dae07e1 already in progress: creating tablet
I20260925 01:49:50.975930 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:50.976085 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 40) took 4487 ms. Trace:
I20260925 01:49:50.976282 11953 rpcz_store.cc:276] 0925 01:49:46.488136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.488188 (+ 52us) service_pool.cc:224] Handling call
0925 01:49:50.823105 (+4334917us) ts_tablet_manager.cc:1151] Deleting tablet a3ec6c34d22241e5bda3ec6665a47fc7
0925 01:49:50.823114 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.828600 (+ 5486us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.916658 (+ 88058us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.976047 (+ 59389us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4317064}
I20260925 01:49:50.976687 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 95ac080782664fca8661c188ab822e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.976909 11953 tablet_replica.cc:333] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:50.977246 11953 raft_consensus.cc:2243] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:50.977499 11953 raft_consensus.cc:2272] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:50.977624 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a3ec6c34d22241e5bda3ec6665a47fc7 (table default.Table_854ab4951a1b404a99eb1caa32ea46e0 [id=2df4a02c11a14e6584003a727651841e]) successfully deleted
I20260925 01:49:50.979888 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_703892f2a488412e87acffbe309416fd" } new_table_name: "default.Table_0f935fd09c3741a3bf5fd153ba450059" modify_external_catalogs: true
I20260925 01:49:50.974957 11755 tablet_bootstrap.cc:654] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:50.980204 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5494c67817c04f7db697678f00ba117d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.980659 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e2abaeb692e1458dacd8e8bab6cf101f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:50.981397 11671 master_service.cc:960] ReplaceTablet: received request to replace tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:50.983306 11931 ts_tablet_manager.cc:1929] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:50.983687 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7623999b3c04ca69672a1e43fa6921f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:50.983938 11375 raft_consensus.cc:2468] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:49:50.984359 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2abaeb692e1458dacd8e8bab6cf101f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:50.984475 11314 leader_election.cc:343] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:50.984644 11314 leader_election.cc:304] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:50.986480 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5494c67817c04f7db697678f00ba117d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:50.983459 11931 log.cc:1199] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/5acd5d878aac4261a7294e87304c9dfc
I20260925 01:49:50.987742 11931 ts_tablet_manager.cc:1950] T 5acd5d878aac4261a7294e87304c9dfc P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:50.988332 12242 raft_consensus.cc:2749] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:49:50.988842 11314 leader_election.cc:304] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:50.989655 11953 ts_tablet_manager.cc:1916] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:50.990581 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 94) took 3429 ms. Trace:
I20260925 01:49:50.990710 11931 rpcz_store.cc:276] 0925 01:49:47.561565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.561637 (+ 72us) service_pool.cc:224] Handling call
0925 01:49:50.918538 (+3356901us) ts_tablet_manager.cc:1151] Deleting tablet 5acd5d878aac4261a7294e87304c9dfc
0925 01:49:50.918550 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.954878 (+ 36328us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.983196 (+ 28318us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:50.990540 (+ 7344us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3356647}
I20260925 01:49:50.991165 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 5acd5d878aac4261a7294e87304c9dfc (table default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded]) successfully deleted
I20260925 01:49:50.993636 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8b16a38a30ff44fb8d7eb01498f9b9c7
I20260925 01:49:50.994517 11671 catalog_manager.cc:6934] ReplaceTablet: tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 deleted and replaced by tablet 86c8c3bba9614539bfe3018461ad21f8
I20260925 01:49:50.996073 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 86c8c3bba9614539bfe3018461ad21f8) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:50.999475 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet a9068770de0b473488bd8ea4752fb15d from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:50.999629 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 86c8c3bba9614539bfe3018461ad21f8) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:50.999931 11931 tablet_replica.cc:333] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:51.000172 11931 raft_consensus.cc:2243] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:51.000385 11931 raft_consensus.cc:2272] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.001031 11931 ts_tablet_manager.cc:1916] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:51.012645 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df5dcf3b6d134065be92ec6ea8caffc7 has no consensus state
W20260925 01:49:51.019438 12283 log.cc:927] Time spent T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Append to log took a long time: real 0.123s user 0.000s sys 0.000s
I20260925 01:49:51.020248 12296 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:49:51.028191 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 644b28192e3b45e7b5370d55804cb043 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:51.030378 11754 tablet_bootstrap.cc:492] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:51.030685 11754 ts_tablet_manager.cc:1403] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.177s user 0.004s sys 0.011s
I20260925 01:49:51.031641 11754 raft_consensus.cc:359] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.031872 11754 raft_consensus.cc:385] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.031941 11754 raft_consensus.cc:740] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.032339 11754 consensus_queue.cc:260] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.040166 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet ae948bf42ae34a7ab72112d5f1f02585 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:51.040997 12069 raft_consensus.cc:515] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.041893 12069 leader_election.cc:290] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.048679 11754 ts_tablet_manager.cc:1434] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20260925 01:49:51.053835 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_33e82d375f274afa8be91af4b28057b2" } new_table_name: "default.Table_7bf2059d1939417f9dc9b05d8a716c76" modify_external_catalogs: true
I20260925 01:49:51.055274 11754 tablet_bootstrap.cc:492] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:51.057394 11754 tablet_bootstrap.cc:654] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.063488 11931 ts_tablet_manager.cc:1929] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.063691 11931 log.cc:1199] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ff92ca86767f4ba6905da62b6a4b892c
I20260925 01:49:51.064155 11931 ts_tablet_manager.cc:1950] T ff92ca86767f4ba6905da62b6a4b892c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:51.069564 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_def921b326b04b85a7bd4c9e3b3b15cc" } new_table_name: "default.Table_405242f491234df4b8b961f90612941e" modify_external_catalogs: true
I20260925 01:49:51.072468 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b2c0a186ead548bca5ccee40cb8df40f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.073222 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 104) took 3191 ms. Trace:
I20260925 01:49:51.073344 11931 rpcz_store.cc:276] 0925 01:49:47.882105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.882182 (+ 77us) service_pool.cc:224] Handling call
0925 01:49:50.998619 (+3116437us) ts_tablet_manager.cc:1151] Deleting tablet ff92ca86767f4ba6905da62b6a4b892c
0925 01:49:50.998630 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.039769 (+ 41139us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.063396 (+ 23627us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.073086 (+ 9690us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3087034}
W20260925 01:49:51.079548 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2c0a186ead548bca5ccee40cb8df40f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.080030 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a3c9e904392e436babfab378a07cf3a6" } modify_external_catalogs: true
I20260925 01:49:51.080622 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_260512e222a64aae83a308a6de0b4843" } modify_external_catalogs: true
I20260925 01:49:51.074090 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ff92ca86767f4ba6905da62b6a4b892c (table default.Table_fdc621d947f448fca1456221c2c4326e [id=e4e40511b79d43919b00485a71bf0509]) successfully deleted
I20260925 01:49:51.075634 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4dc4550a013e44da8eecc5fc94e0bd3d" } modify_external_catalogs: true
I20260925 01:49:51.085939 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 105) took 3170 ms. Trace:
I20260925 01:49:51.086848 11931 rpcz_store.cc:276] 0925 01:49:47.914840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.915841 (+ 1001us) service_pool.cc:224] Handling call
0925 01:49:51.083167 (+3167326us) ts_tablet_manager.cc:1151] Deleting tablet e2b9df8d98e5414186ef23b8b7f9cb61
0925 01:49:51.083181 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.085328 (+ 2147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3166940}
I20260925 01:49:51.089686 11754 tablet_bootstrap.cc:492] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:51.090039 11754 ts_tablet_manager.cc:1403] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.003s
I20260925 01:49:51.092285 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:51.092108 11754 raft_consensus.cc:359] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.092677 11754 raft_consensus.cc:385] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.097671 11946 ts_tablet_manager.cc:1929] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.098098 11946 log.cc:1199] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8d4e94cdafd343ee8a84c64668fe48fe
I20260925 01:49:51.098011 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8b1c0d4e229f41dfa2c87392267a114d" } modify_external_catalogs: true
I20260925 01:49:51.098542 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_77556b8645c143cba6b3bee14942c58b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.098768 11946 ts_tablet_manager.cc:1950] T 8d4e94cdafd343ee8a84c64668fe48fe P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:51.099193 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77556b8645c143cba6b3bee14942c58b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:51.099504 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e2b9df8d98e5414186ef23b8b7f9cb61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2b9df8d98e5414186ef23b8b7f9cb61 already in progress: creating tablet
I20260925 01:49:51.099691 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 17) took 4779 ms. Trace:
I20260925 01:49:51.099900 11946 rpcz_store.cc:276] 0925 01:49:46.320729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.324685 (+ 3956us) service_pool.cc:224] Handling call
0925 01:49:50.775174 (+4450489us) ts_tablet_manager.cc:1151] Deleting tablet 8d4e94cdafd343ee8a84c64668fe48fe
0925 01:49:50.775184 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:50.909526 (+134342us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.096985 (+187459us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.099647 (+ 2662us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4450297}
I20260925 01:49:51.093199 11754 raft_consensus.cc:740] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.100461 11946 tablet_replica.cc:333] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:51.102169 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 107) took 2900 ms. Trace:
I20260925 01:49:51.102108 11754 consensus_queue.cc:260] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.102680 11931 rpcz_store.cc:276] 0925 01:49:48.201588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.201658 (+ 70us) service_pool.cc:224] Handling call
0925 01:49:51.100541 (+2898883us) ts_tablet_manager.cc:1151] Deleting tablet ca17585cd523440ca1e9b754f3aedf8a
0925 01:49:51.100668 (+ 127us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.101547 (+ 879us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2898452}
W20260925 01:49:51.111023 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 263678us
I20260925 01:49:51.111234 11931 tablet_replica.cc:333] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:51.112325 11754 ts_tablet_manager.cc:1434] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.022s user 0.000s sys 0.004s
I20260925 01:49:51.112843 11931 raft_consensus.cc:2243] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:51.118928 11753 tablet_bootstrap.cc:492] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:51.119864 11753 ts_tablet_manager.cc:1403] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.413s user 0.023s sys 0.032s
I20260925 01:49:51.119849 11754 tablet_bootstrap.cc:492] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:51.120178 11931 raft_consensus.cc:2272] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.124253 11753 raft_consensus.cc:359] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.124791 11753 raft_consensus.cc:385] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.124929 11753 raft_consensus.cc:740] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.125281 11753 consensus_queue.cc:260] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.125566 11931 ts_tablet_manager.cc:1916] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.126163 11753 ts_tablet_manager.cc:1434] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:49:51.126760 11753 tablet_bootstrap.cc:492] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:51.129727 11519 raft_consensus.cc:3060] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.136626 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8b1c0d4e229f41dfa2c87392267a114d" } modify_external_catalogs: true
I20260925 01:49:51.136729 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a3c9e904392e436babfab378a07cf3a6" } modify_external_catalogs: true
I20260925 01:49:51.136646 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_260512e222a64aae83a308a6de0b4843" } modify_external_catalogs: true
W20260925 01:49:51.142359 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e87128b8baef4f9d80341f6980da519d consensus state has no leader
I20260925 01:49:51.142848 11946 raft_consensus.cc:2243] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:51.143289 11946 raft_consensus.cc:2272] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.144088 11946 ts_tablet_manager.cc:1916] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.145602 11754 tablet_bootstrap.cc:654] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.147413 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a07f37b8469a497ba3fe504cb21105d2
I20260925 01:49:51.149212 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f37b8469a497ba3fe504cb21105d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.153229 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 (DEFAULT_TABLE table=default.Table_77d531160dc245eaaac97f131d587441 [id=32c8539cc67d46e2acfad4a1ad9ba69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.153767 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031687d4b26b4c7889dfbe3485c9f4c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.159467 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 284013us
I20260925 01:49:51.160017 11219 tablet_service.cc:1511] Processing CreateTablet for tablet b61b1bf5a8d446918edc6d166b7712ef (DEFAULT_TABLE table=default.Table_c11632e9ce934a888e72894235561dcd [id=350f9fe5f3ae4c419ac210a46eb8d38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.160496 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61b1bf5a8d446918edc6d166b7712ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.161486 11176 leader_election.cc:343] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.161666 11176 leader_election.cc:304] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:51.162179 11214 tablet_service.cc:1511] Processing CreateTablet for tablet f1d3077f21374d969626972654c7e5e1 (DEFAULT_TABLE table=default.Table_d6d1d600af5a4b329a7548842f2d1ece [id=f8604990226645818fd503006ea56e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.162568 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d3077f21374d969626972654c7e5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.166684 11965 raft_consensus.cc:2749] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:49:51.168556 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff92ca86767f4ba6905da62b6a4b892c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:51.169765 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7623999b3c04ca69672a1e43fa6921f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:51.169971 11239 raft_consensus.cc:3060] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.170156 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31fe174270f24ff780c212eaef90ef0d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:51.170383 11517 raft_consensus.cc:3060] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.173044 11239 raft_consensus.cc:2468] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:51.174286 11517 raft_consensus.cc:2468] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:51.175267 11965 raft_consensus.cc:493] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.175350 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:51.175423 11965 raft_consensus.cc:515] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.176083 11965 leader_election.cc:290] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:51.180262 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 (DEFAULT_TABLE table=default.Table_04ba88f4ea89466a9be2799b103547fd [id=7d196ee9e42a41968e3013907ed4911a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.180811 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31353cc95e014e5bb24e5e5cefab1503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.182824 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:51.184351 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ae948bf42ae34a7ab72112d5f1f02585
I20260925 01:49:51.184993 11675 catalog_manager.cc:6934] ReplaceTablet: tablet ae948bf42ae34a7ab72112d5f1f02585 deleted and replaced by tablet aaa2f7ef888846ec9667916ba47084db
I20260925 01:49:51.185791 12069 raft_consensus.cc:493] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.185948 12069 raft_consensus.cc:515] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.186564 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4dc4550a013e44da8eecc5fc94e0bd3d" } modify_external_catalogs: true
W20260925 01:49:51.186720 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aaa2f7ef888846ec9667916ba47084db has no consensus state
I20260925 01:49:51.187588 12069 leader_election.cc:290] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.188019 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8d4e94cdafd343ee8a84c64668fe48fe (table default.Table_691fb438533845f28d06c6bbb6f2996d [id=a3021d36f54a4fe3b92a782c075015f5]) successfully deleted
I20260925 01:49:51.188581 11680 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:51.189000 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.189791 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f9e96bcdf9418ea54dc73bf68a2be6" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:51.190831 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 95ac080782664fca8661c188ab822e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.192042 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 86c8c3bba9614539bfe3018461ad21f8) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.192605 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 6386bd0cb4894068985fe152299f0b47 (DEFAULT_TABLE table=default.Table_0bc7dfa4dadb42fb8d8b5e24e86a2558 [id=1726c0f5240e46a68e6390a4c72f9621]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.193140 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6386bd0cb4894068985fe152299f0b47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.194334 11176 leader_election.cc:343] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.196821 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 406d31139e1e441aa6fe204168486e28 (DEFAULT_TABLE table=default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.197363 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406d31139e1e441aa6fe204168486e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.201716 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 with delete_type TABLET_DATA_DELETED (replaced by tablet aaa2f7ef888846ec9667916ba47084db) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.203751 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f37b8469a497ba3fe504cb21105d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.204543 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 (DEFAULT_TABLE table=default.Table_77d531160dc245eaaac97f131d587441 [id=32c8539cc67d46e2acfad4a1ad9ba69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.205271 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031687d4b26b4c7889dfbe3485c9f4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.206424 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d9ec82d6876c42f4ba2646cb90d5c35b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.207109 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9ec82d6876c42f4ba2646cb90d5c35b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.208173 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5995b17dc74742079004a9f3dadc82b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.209733 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5995b17dc74742079004a9f3dadc82b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.212348 11209 tablet_service.cc:1511] Processing CreateTablet for tablet b97f703869d4471cb940ef654203ec2b (DEFAULT_TABLE table=default.Table_b2c1222a9e064057bef3e7159e2d9ec3 [id=e9edf18c4d10412cb249878f4a94e7d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.212824 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f703869d4471cb940ef654203ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.216629 11210 tablet_service.cc:1511] Processing CreateTablet for tablet f46004be36b543a395a783a13b1b14cf (DEFAULT_TABLE table=default.Table_4aba0779435d4c10be3a8cd86662cb8a [id=82de5b3161a5463693e13ea92f4ae6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.217589 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46004be36b543a395a783a13b1b14cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.218340 11497 tablet_service.cc:1511] Processing CreateTablet for tablet b61b1bf5a8d446918edc6d166b7712ef (DEFAULT_TABLE table=default.Table_c11632e9ce934a888e72894235561dcd [id=350f9fe5f3ae4c419ac210a46eb8d38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.219022 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61b1bf5a8d446918edc6d166b7712ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.219799 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_997e0c8809ba4ba198f70270f4183297" } new_table_name: "default.Table_868285a9866c47e5a5eb6932b93a6fbc" modify_external_catalogs: true
I20260925 01:49:51.227315 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1ef54231b09343c68073a0b4a490545b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.230605 12241 raft_consensus.cc:493] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.230792 12241 raft_consensus.cc:515] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.231508 12241 leader_election.cc:290] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.233083 11222 tablet_service.cc:1511] Processing CreateTablet for tablet fce91b00d3a14e6398abacad61ff5b0f (DEFAULT_TABLE table=default.Table_f1000553782a4118a246bbda71eaf618 [id=283f50719ac648e297b59efd4f00941d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:51.233536 11314 leader_election.cc:343] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 31fe174270f24ff780c212eaef90ef0d
I20260925 01:49:51.233690 11494 tablet_service.cc:1511] Processing CreateTablet for tablet f1d3077f21374d969626972654c7e5e1 (DEFAULT_TABLE table=default.Table_d6d1d600af5a4b329a7548842f2d1ece [id=f8604990226645818fd503006ea56e70]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:51.233808 11314 leader_election.cc:343] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.234886 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 (DEFAULT_TABLE table=default.Table_04ba88f4ea89466a9be2799b103547fd [id=7d196ee9e42a41968e3013907ed4911a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.235630 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 6386bd0cb4894068985fe152299f0b47 (DEFAULT_TABLE table=default.Table_0bc7dfa4dadb42fb8d8b5e24e86a2558 [id=1726c0f5240e46a68e6390a4c72f9621]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.236266 12079 raft_consensus.cc:493] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.236457 12079 raft_consensus.cc:515] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.236954 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 with delete_type TABLET_DATA_DELETED (replaced by tablet aaa2f7ef888846ec9667916ba47084db) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.237249 12079 leader_election.cc:290] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.240130 11753 tablet_bootstrap.cc:654] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.240183 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7623999b3c04ca69672a1e43fa6921f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:51.240525 11375 raft_consensus.cc:3060] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.243818 11375 raft_consensus.cc:2468] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:51.244987 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:51.246112 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f37b8469a497ba3fe504cb21105d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.246394 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d3077f21374d969626972654c7e5e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.246486 11314 leader_election.cc:343] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.246623 11314 leader_election.cc:304] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:51.247138 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31353cc95e014e5bb24e5e5cefab1503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.247660 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6386bd0cb4894068985fe152299f0b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.247727 11360 tablet_service.cc:1511] Processing CreateTablet for tablet b61b1bf5a8d446918edc6d166b7712ef (DEFAULT_TABLE table=default.Table_c11632e9ce934a888e72894235561dcd [id=350f9fe5f3ae4c419ac210a46eb8d38e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.248135 12242 raft_consensus.cc:2749] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:51.255537 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 406d31139e1e441aa6fe204168486e28 (DEFAULT_TABLE table=default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.258723 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 3d398851fb194c61a0a3b2c60c7a5e8b (DEFAULT_TABLE table=default.Table_4ef3129ce4d545c0a2dae74dbc7798f0 [id=13bb30253d2c46e8aadf3c0065334d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.259263 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 35b123ac1e894239875404438ed19927 (DEFAULT_TABLE table=default.Table_c91274a8eb214f14b4baeb24cabdd8c6 [id=5405c0f51c3b4db8a58b97b60ea65777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.259459 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 0c01195f07b84b359a974fab5ed52582 (DEFAULT_TABLE table=default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.259680 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 with delete_type TABLET_DATA_DELETED (replaced by tablet aaa2f7ef888846ec9667916ba47084db) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.260291 11355 tablet_service.cc:1511] Processing CreateTablet for tablet df5dcf3b6d134065be92ec6ea8caffc7 (DEFAULT_TABLE table=default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.260845 11348 tablet_service.cc:1511] Processing CreateTablet for tablet b97f703869d4471cb940ef654203ec2b (DEFAULT_TABLE table=default.Table_b2c1222a9e064057bef3e7159e2d9ec3 [id=e9edf18c4d10412cb249878f4a94e7d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.261138 12242 raft_consensus.cc:2749] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:51.261770 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 (DEFAULT_TABLE table=default.Table_77d531160dc245eaaac97f131d587441 [id=32c8539cc67d46e2acfad4a1ad9ba69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.262331 11351 tablet_service.cc:1511] Processing CreateTablet for tablet f1d3077f21374d969626972654c7e5e1 (DEFAULT_TABLE table=default.Table_d6d1d600af5a4b329a7548842f2d1ece [id=f8604990226645818fd503006ea56e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.262679 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02f9e96bcdf9418ea54dc73bf68a2be6" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:51.263593 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61b1bf5a8d446918edc6d166b7712ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.263942 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d398851fb194c61a0a3b2c60c7a5e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.264117 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 (DEFAULT_TABLE table=default.Table_3b5c5e5eccf6419294fcf649547572ac [id=17f681ed73a4408db51a13e3764c7ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.264250 11354 tablet_service.cc:1511] Processing CreateTablet for tablet f46004be36b543a395a783a13b1b14cf (DEFAULT_TABLE table=default.Table_4aba0779435d4c10be3a8cd86662cb8a [id=82de5b3161a5463693e13ea92f4ae6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.264562 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ecfc5a2a80449c9905c83b6bcb3652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.264762 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 6386bd0cb4894068985fe152299f0b47 (DEFAULT_TABLE table=default.Table_0bc7dfa4dadb42fb8d8b5e24e86a2558 [id=1726c0f5240e46a68e6390a4c72f9621]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.265091 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b123ac1e894239875404438ed19927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.265030 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 (DEFAULT_TABLE table=default.Table_04ba88f4ea89466a9be2799b103547fd [id=7d196ee9e42a41968e3013907ed4911a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.265368 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31353cc95e014e5bb24e5e5cefab1503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.266250 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031687d4b26b4c7889dfbe3485c9f4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.266526 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 818a792969a245f5b0fe5f80128206ba (DEFAULT_TABLE table=default.Table_b2202b3e9b174d9a9bff1f005144d412 [id=3a0322c7d2bf4cc89a0e09ac46a62440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.266919 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818a792969a245f5b0fe5f80128206ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.267529 11350 tablet_service.cc:1511] Processing CreateTablet for tablet fce91b00d3a14e6398abacad61ff5b0f (DEFAULT_TABLE table=default.Table_f1000553782a4118a246bbda71eaf618 [id=283f50719ac648e297b59efd4f00941d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.268908 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d3077f21374d969626972654c7e5e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.271620 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 226498ea628a475d8fcab28a6598a819 (DEFAULT_TABLE table=default.Table_71c7a46468e24855b65e14b9221f5930 [id=cead6e15d1894994bb2fdaa3d7f0d88d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.272910 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 (DEFAULT_TABLE table=default.Table_d7b8d87cdc614126a5b456bfaef70491 [id=a26d8b5cd5b94f7392cd13e13ca79d80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.285771 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6386bd0cb4894068985fe152299f0b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.286231 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ffb404d93a4436ba9e624b45650fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.287271 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226498ea628a475d8fcab28a6598a819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.288390 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c01195f07b84b359a974fab5ed52582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.289119 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce91b00d3a14e6398abacad61ff5b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.290009 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46004be36b543a395a783a13b1b14cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.291419 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f703869d4471cb940ef654203ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.292337 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5dcf3b6d134065be92ec6ea8caffc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.293399 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406d31139e1e441aa6fe204168486e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.301512 11946 ts_tablet_manager.cc:1929] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.303184 11359 tablet_service.cc:1511] Processing CreateTablet for tablet f2618c46630c4295949b36f3d0087941 (DEFAULT_TABLE table=default.Table_4dc4550a013e44da8eecc5fc94e0bd3d [id=9084029417354d6a8fd7cbb2b0b68e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.303857 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2618c46630c4295949b36f3d0087941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.313266 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 35b123ac1e894239875404438ed19927 (DEFAULT_TABLE table=default.Table_c91274a8eb214f14b4baeb24cabdd8c6 [id=5405c0f51c3b4db8a58b97b60ea65777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.314549 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 (DEFAULT_TABLE table=default.Table_d7b8d87cdc614126a5b456bfaef70491 [id=a26d8b5cd5b94f7392cd13e13ca79d80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.318845 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce91b00d3a14e6398abacad61ff5b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.308808 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 406d31139e1e441aa6fe204168486e28 (DEFAULT_TABLE table=default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:51.322376 11177 leader_election.cc:343] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.322532 11177 leader_election.cc:304] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:51.322836 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 406d31139e1e441aa6fe204168486e28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.322896 11177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 59359.9us
I20260925 01:49:51.323702 11965 raft_consensus.cc:493] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.324493 11497 tablet_service.cc:1511] Processing CreateTablet for tablet fce91b00d3a14e6398abacad61ff5b0f (DEFAULT_TABLE table=default.Table_f1000553782a4118a246bbda71eaf618 [id=283f50719ac648e297b59efd4f00941d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.324610 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 (DEFAULT_TABLE table=default.Table_3b5c5e5eccf6419294fcf649547572ac [id=17f681ed73a4408db51a13e3764c7ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.325973 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 3d398851fb194c61a0a3b2c60c7a5e8b (DEFAULT_TABLE table=default.Table_4ef3129ce4d545c0a2dae74dbc7798f0 [id=13bb30253d2c46e8aadf3c0065334d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.326370 11754 tablet_bootstrap.cc:492] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:51.327234 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 818a792969a245f5b0fe5f80128206ba (DEFAULT_TABLE table=default.Table_b2202b3e9b174d9a9bff1f005144d412 [id=3a0322c7d2bf4cc89a0e09ac46a62440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.310724 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 818a792969a245f5b0fe5f80128206ba (DEFAULT_TABLE table=default.Table_b2202b3e9b174d9a9bff1f005144d412 [id=3a0322c7d2bf4cc89a0e09ac46a62440]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.329584 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818a792969a245f5b0fe5f80128206ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.330144 11213 tablet_service.cc:1511] Processing CreateTablet for tablet df5dcf3b6d134065be92ec6ea8caffc7 (DEFAULT_TABLE table=default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.330791 11206 tablet_service.cc:1511] Processing CreateTablet for tablet f2618c46630c4295949b36f3d0087941 (DEFAULT_TABLE table=default.Table_4dc4550a013e44da8eecc5fc94e0bd3d [id=9084029417354d6a8fd7cbb2b0b68e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.330925 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.332139 11946 log.cc:1199] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/491d790067644090aa4d25f4060cc2ec
I20260925 01:49:51.332978 11946 ts_tablet_manager.cc:1950] T 491d790067644090aa4d25f4060cc2ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:51.311893 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 35b123ac1e894239875404438ed19927 (DEFAULT_TABLE table=default.Table_c91274a8eb214f14b4baeb24cabdd8c6 [id=5405c0f51c3b4db8a58b97b60ea65777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.312491 11488 tablet_service.cc:1511] Processing CreateTablet for tablet df5dcf3b6d134065be92ec6ea8caffc7 (DEFAULT_TABLE table=default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.313123 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 226498ea628a475d8fcab28a6598a819 (DEFAULT_TABLE table=default.Table_71c7a46468e24855b65e14b9221f5930 [id=cead6e15d1894994bb2fdaa3d7f0d88d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.334637 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b123ac1e894239875404438ed19927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.313830 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 (DEFAULT_TABLE table=default.Table_d7b8d87cdc614126a5b456bfaef70491 [id=a26d8b5cd5b94f7392cd13e13ca79d80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.334921 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ffb404d93a4436ba9e624b45650fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.335412 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5dcf3b6d134065be92ec6ea8caffc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.314522 11503 tablet_service.cc:1511] Processing CreateTablet for tablet f2618c46630c4295949b36f3d0087941 (DEFAULT_TABLE table=default.Table_4dc4550a013e44da8eecc5fc94e0bd3d [id=9084029417354d6a8fd7cbb2b0b68e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.335927 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2618c46630c4295949b36f3d0087941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.336642 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226498ea628a475d8fcab28a6598a819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.340437 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 25) took 5014 ms. Trace:
I20260925 01:49:51.342576 11946 rpcz_store.cc:276] 0925 01:49:46.325554 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.325606 (+ 52us) service_pool.cc:224] Handling call
0925 01:49:51.100363 (+4774757us) ts_tablet_manager.cc:1151] Deleting tablet 491d790067644090aa4d25f4060cc2ec
0925 01:49:51.100375 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.181005 (+ 80630us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.301430 (+120425us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.340369 (+ 38939us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4774527}
I20260925 01:49:51.348232 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 26) took 5021 ms. Trace:
I20260925 01:49:51.348510 11946 rpcz_store.cc:276] 0925 01:49:46.326668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.326718 (+ 50us) service_pool.cc:224] Handling call
0925 01:49:51.347927 (+5021209us) ts_tablet_manager.cc:1151] Deleting tablet ae497a92e49746a79cbbfe3c82b2b544
0925 01:49:51.347941 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.348161 (+ 220us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5021002}
I20260925 01:49:51.349164 11946 tablet_replica.cc:333] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:51.348639 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee95aba7a8f4d8db4ed0b8a862dab63" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.349509 11946 raft_consensus.cc:2243] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:51.349539 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b123ac1e894239875404438ed19927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.350008 11946 raft_consensus.cc:2272] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.239073 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 927bc1194884470e9fc977ca870f1b0c
I20260925 01:49:51.351388 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 818a792969a245f5b0fe5f80128206ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.351552 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ef54231b09343c68073a0b4a490545b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.352097 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d398851fb194c61a0a3b2c60c7a5e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.351919 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_040b864e0371477a9619a6362779f0f3" } new_table_name: "default.Table_7516d7fbf45346258116dfceef9ce462" modify_external_catalogs: true
I20260925 01:49:51.352912 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ecfc5a2a80449c9905c83b6bcb3652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.277994 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8bf42293dd5d452aa7ed9e0eaa78f54d
I20260925 01:49:51.278625 11672 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_d658fd300e03462995eddeb99aaf8f45 [id=f8317c3550b14fe3abf468ea0d755b88] alter complete (version 3)
I20260925 01:49:51.353461 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5dcf3b6d134065be92ec6ea8caffc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.354003 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_aef1efeefaf4495bb03c12af5e28505b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.354132 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_064d8e4efcc9494089e586a0eb83a55f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.354146 11965 raft_consensus.cc:515] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:51.354671 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aef1efeefaf4495bb03c12af5e28505b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.354839 11965 leader_election.cc:290] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:51.355010 12263 raft_consensus.cc:2749] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:51.355223 11754 ts_tablet_manager.cc:1403] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.208s user 0.010s sys 0.001s
I20260925 01:49:51.283094 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0c8444676dd247048ee61b454fa4e0c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.356492 11754 raft_consensus.cc:359] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:51.356616 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c8444676dd247048ee61b454fa4e0c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.356792 11754 raft_consensus.cc:385] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.356943 11754 raft_consensus.cc:740] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.357306 11754 consensus_queue.cc:260] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.283499 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0e71b8f12efa4591b712a486be4752b9" } modify_external_catalogs: true
I20260925 01:49:51.357993 11754 ts_tablet_manager.cc:1434] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:49:51.357941 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0e71b8f12efa4591b712a486be4752b9" } modify_external_catalogs: true
I20260925 01:49:51.359129 11754 tablet_bootstrap.cc:492] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:51.296150 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f2618c46630c4295949b36f3d0087941
I20260925 01:49:51.360412 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ad64de020ae64170995d164f0ae43e85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.361017 11931 ts_tablet_manager.cc:1929] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260925 01:49:51.361122 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad64de020ae64170995d164f0ae43e85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.361181 11931 log.cc:1199] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/3da92b7f256647f19faeed66b4012438
I20260925 01:49:51.361969 11931 ts_tablet_manager.cc:1950] T 3da92b7f256647f19faeed66b4012438 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:49:51.320333 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 602af3d6e7bb44f8a316691019f85c25 has no consensus state
I20260925 01:49:51.362875 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_95d84f6a76304a15a2eea81e724b435c" } new_table_name: "default.Table_1952d6b4149e47b994684a0bbdd45b2f" modify_external_catalogs: true
I20260925 01:49:51.362985 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 108) took 3121 ms. Trace:
I20260925 01:49:51.363173 11931 rpcz_store.cc:276] 0925 01:49:48.241566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.241632 (+ 66us) service_pool.cc:224] Handling call
0925 01:49:51.110597 (+2868965us) ts_tablet_manager.cc:1151] Deleting tablet 3da92b7f256647f19faeed66b4012438
0925 01:49:51.110788 (+ 191us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.142216 (+ 31428us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.323527 (+181311us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.362921 (+ 39394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2868498}
I20260925 01:49:51.363776 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 109) took 3005 ms. Trace:
I20260925 01:49:51.363979 11931 rpcz_store.cc:276] 0925 01:49:48.358152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.358208 (+ 56us) service_pool.cc:224] Handling call
0925 01:49:51.363546 (+3005338us) ts_tablet_manager.cc:1151] Deleting tablet c75a4ed161734d30ab5ad2e2b00d77c9
0925 01:49:51.363559 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.363688 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3005111}
I20260925 01:49:51.364550 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 115) took 2950 ms. Trace:
I20260925 01:49:51.364758 11931 rpcz_store.cc:276] 0925 01:49:48.414536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.414986 (+ 450us) service_pool.cc:224] Handling call
0925 01:49:51.364321 (+2949335us) ts_tablet_manager.cc:1151] Deleting tablet 17352fd6ea4e4ed9a178f1510edf4f6d
0925 01:49:51.364333 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.364469 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2948399}
I20260925 01:49:51.365265 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 118) took 2897 ms. Trace:
I20260925 01:49:51.365461 11931 rpcz_store.cc:276] 0925 01:49:48.467668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.468542 (+ 874us) service_pool.cc:224] Handling call
0925 01:49:51.365038 (+2896496us) ts_tablet_manager.cc:1151] Deleting tablet 331380a2be9a4893927c9b94a2c3e08b
0925 01:49:51.365050 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.365182 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2878436}
I20260925 01:49:51.367004 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2618c46630c4295949b36f3d0087941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.367796 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ffb404d93a4436ba9e624b45650fe1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.367786 11946 ts_tablet_manager.cc:1916] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.369524 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 927bc1194884470e9fc977ca870f1b0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:51.354676 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_064d8e4efcc9494089e586a0eb83a55f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.370096 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.370623 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet f2618c46630c4295949b36f3d0087941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.373230 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 0c01195f07b84b359a974fab5ed52582 (DEFAULT_TABLE table=default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.373878 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c01195f07b84b359a974fab5ed52582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.324738 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cc6c271622254896bab14472c1455e8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.377245 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc6c271622254896bab14472c1455e8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.325453 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 98ffeb9d70374afdb72a728d7b211d33 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:51.379089 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee95aba7a8f4d8db4ed0b8a862dab63" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:51.383174 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8234c4d0c72541158826416e40f34031 consensus state has no leader
I20260925 01:49:51.316515 11485 tablet_service.cc:1511] Processing CreateTablet for tablet f46004be36b543a395a783a13b1b14cf (DEFAULT_TABLE table=default.Table_4aba0779435d4c10be3a8cd86662cb8a [id=82de5b3161a5463693e13ea92f4ae6cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.317408 12288 raft_consensus.cc:493] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.386312 12288 raft_consensus.cc:515] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.387256 12288 leader_election.cc:290] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.317603 12294 raft_consensus.cc:493] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.387657 12294 raft_consensus.cc:515] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.388362 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a51db57fcb214a8289f9ac66be21414f" } new_table_name: "default.Table_6a8f6bbf5d5d430f89f28a60bf15e379" modify_external_catalogs: true
I20260925 01:49:51.388948 12294 leader_election.cc:290] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.390121 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46004be36b543a395a783a13b1b14cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.392719 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_04ba88f4ea89466a9be2799b103547fd" } modify_external_catalogs: true
I20260925 01:49:51.392982 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_04ba88f4ea89466a9be2799b103547fd" } modify_external_catalogs: true
I20260925 01:49:51.393951 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7516d7fbf45346258116dfceef9ce462" } new_table_name: "default.Table_a5cb3c3da42d49eda4923be1eeea6988" modify_external_catalogs: true
I20260925 01:49:51.394246 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d7f97ead49634bf6b03e292544af4d07
W20260925 01:49:51.396661 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fcb56153a802427aaebbf55a8193d62b consensus state has no leader
I20260925 01:49:51.330621 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 226498ea628a475d8fcab28a6598a819 (DEFAULT_TABLE table=default.Table_71c7a46468e24855b65e14b9221f5930 [id=cead6e15d1894994bb2fdaa3d7f0d88d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.400935 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 226498ea628a475d8fcab28a6598a819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.410591 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 927bc1194884470e9fc977ca870f1b0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:51.410977 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c28c8f00a8634ef89e4773b62e095b74 consensus state has no leader
I20260925 01:49:51.412039 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]) successfully deleted
W20260925 01:49:51.412544 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c75a4ed161734d30ab5ad2e2b00d77c9 because the tablet was not found. No further retry: Not found: Tablet not found: c75a4ed161734d30ab5ad2e2b00d77c9
W20260925 01:49:51.412963 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 17352fd6ea4e4ed9a178f1510edf4f6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17352fd6ea4e4ed9a178f1510edf4f6d already in progress: creating tablet
W20260925 01:49:51.413451 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 331380a2be9a4893927c9b94a2c3e08b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 331380a2be9a4893927c9b94a2c3e08b already in progress: creating tablet
W20260925 01:49:51.415267 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8234c4d0c72541158826416e40f34031 consensus state has no leader
I20260925 01:49:51.420969 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:51.421356 11523 raft_consensus.cc:2468] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:51.422024 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce91b00d3a14e6398abacad61ff5b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.411002 12293 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:49:51.426751 11494 tablet_service.cc:1511] Processing CreateTablet for tablet b97f703869d4471cb940ef654203ec2b (DEFAULT_TABLE table=default.Table_b2c1222a9e064057bef3e7159e2d9ec3 [id=e9edf18c4d10412cb249878f4a94e7d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.427923 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 121) took 2923 ms. Trace:
I20260925 01:49:51.428303 11753 tablet_bootstrap.cc:492] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:51.428568 11753 ts_tablet_manager.cc:1403] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.302s user 0.004s sys 0.001s
I20260925 01:49:51.429772 11753 raft_consensus.cc:359] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.430094 11753 raft_consensus.cc:385] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.430195 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:51.430269 11753 raft_consensus.cc:740] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.430593 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet f2618c46630c4295949b36f3d0087941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.434616 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.430449 11379 raft_consensus.cc:2468] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:51.441435 11176 leader_election.cc:304] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:51.443053 11931 rpcz_store.cc:276] 0925 01:49:48.496608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.497138 (+ 530us) service_pool.cc:224] Handling call
0925 01:49:51.365673 (+2868535us) ts_tablet_manager.cc:1151] Deleting tablet 75a8e09b8838443c9bfff440ff1f877d
0925 01:49:51.411440 (+ 45767us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.419790 (+ 8350us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860594}
I20260925 01:49:51.443805 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97f703869d4471cb940ef654203ec2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.317831 11456 leader_election.cc:304] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:51.446520 12288 raft_consensus.cc:2804] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:51.446888 11965 raft_consensus.cc:2804] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:51.446733 12288 raft_consensus.cc:697] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:51.447089 11965 raft_consensus.cc:493] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:51.447232 12288 consensus_queue.cc:237] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.447794 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f97ead49634bf6b03e292544af4d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.447960 11931 tablet_replica.cc:333] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:51.318492 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 (DEFAULT_TABLE table=default.Table_3b5c5e5eccf6419294fcf649547572ac [id=17f681ed73a4408db51a13e3764c7ef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.321821 12137 raft_consensus.cc:493] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.450790 12137 raft_consensus.cc:515] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:51.451187 11946 ts_tablet_manager.cc:1929] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.451375 11946 log.cc:1199] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ff92ca86767f4ba6905da62b6a4b892c
I20260925 01:49:51.451639 12137 leader_election.cc:290] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.325330 11519 raft_consensus.cc:3060] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.310034 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 3d398851fb194c61a0a3b2c60c7a5e8b (DEFAULT_TABLE table=default.Table_4ef3129ce4d545c0a2dae74dbc7798f0 [id=13bb30253d2c46e8aadf3c0065334d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.311297 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 0c01195f07b84b359a974fab5ed52582 (DEFAULT_TABLE table=default.Table_b187688e2bdb475496c7d6278e6a6754 [id=e93d9881c42d4a51a90c1ffb5fe17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.452864 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d398851fb194c61a0a3b2c60c7a5e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.453547 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c01195f07b84b359a974fab5ed52582. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.453686 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 135426us
I20260925 01:49:51.455606 11946 ts_tablet_manager.cc:1950] T ff92ca86767f4ba6905da62b6a4b892c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:51.459455 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.460249 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ecfc5a2a80449c9905c83b6bcb3652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.461521 11965 raft_consensus.cc:3060] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.472787 11931 raft_consensus.cc:2243] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:51.473798 11755 tablet_bootstrap.cc:492] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:51.476496 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.479745 11755 ts_tablet_manager.cc:1403] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.654s user 0.049s sys 0.076s
I20260925 01:49:51.483275 11931 raft_consensus.cc:2272] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.483654 11953 ts_tablet_manager.cc:1929] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:51.484578 11754 tablet_bootstrap.cc:654] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.486290 11953 log.cc:1199] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/2d76845ed48045b7b3632179be022e5f
I20260925 01:49:51.486533 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4ae934a7969f4cb2aae617f37447aa50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.486809 11953 ts_tablet_manager.cc:1950] T 2d76845ed48045b7b3632179be022e5f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:49:51.487525 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ae934a7969f4cb2aae617f37447aa50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.489272 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_799924aa3f2542a7ac6dbdd10143019b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.489929 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_799924aa3f2542a7ac6dbdd10143019b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.489995 11965 raft_consensus.cc:515] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.491853 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 27) took 5102 ms. Trace:
I20260925 01:49:51.492861 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 with delete_type TABLET_DATA_DELETED (replaced by tablet b60706e2087b4ec7b63f6747534a4b0f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.495405 11755 raft_consensus.cc:359] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.495639 11755 raft_consensus.cc:385] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.495711 11755 raft_consensus.cc:740] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.496006 11755 consensus_queue.cc:260] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.496565 11755 ts_tablet_manager.cc:1434] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260925 01:49:51.499549 11239 raft_consensus.cc:2393] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:51.501329 11931 ts_tablet_manager.cc:1916] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.502580 11965 leader_election.cc:290] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:51.469115 11753 consensus_queue.cc:260] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.517822 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 927bc1194884470e9fc977ca870f1b0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.522213 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.522614 11946 rpcz_store.cc:276] 0925 01:49:46.371002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.371080 (+ 78us) service_pool.cc:224] Handling call
0925 01:49:51.349063 (+4977983us) ts_tablet_manager.cc:1151] Deleting tablet ff92ca86767f4ba6905da62b6a4b892c
0925 01:49:51.349073 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.433309 (+ 84236us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.451067 (+ 17758us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.473782 (+ 22715us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4977716}
I20260925 01:49:51.523041 11946 tablet_replica.cc:333] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:51.524514 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_992ecd7522c34d958da6f855b4bb8346"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.525517 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_992ecd7522c34d958da6f855b4bb8346 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.529278 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ab286e1355354606bcc30f9697f9156d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.530140 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab286e1355354606bcc30f9697f9156d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.549496 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet f2618c46630c4295949b36f3d0087941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.550243 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:51.550485 11379 raft_consensus.cc:3060] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.554142 11965 raft_consensus.cc:493] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.555747 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 67921f86c4f6422e97d7f306262569f8 (table default.Table_c33c7eb6481e4876aed3d7038afa9f93 [id=107d0cda55154f5e84ce4dd14d36364a]). Expected version 2 got 0
I20260925 01:49:51.557876 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7ad0a76f459148b29a5a3c029573cc5b" } modify_external_catalogs: true
I20260925 01:49:51.558254 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7ad0a76f459148b29a5a3c029573cc5b" } modify_external_catalogs: true
I20260925 01:49:51.560443 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f97ead49634bf6b03e292544af4d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:51.561935 11456 leader_election.cc:343] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a9e1f114c2a749d4af6a366c044f5ea5
I20260925 01:49:51.562229 11965 raft_consensus.cc:515] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.562942 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5036ab1f1580484c8b9367dfab1a8a84" } modify_external_catalogs: true
I20260925 01:49:51.563048 11965 leader_election.cc:290] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:51.563246 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5036ab1f1580484c8b9367dfab1a8a84" } modify_external_catalogs: true
I20260925 01:49:51.561329 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:51.566731 11523 raft_consensus.cc:3060] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.568892 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 31353cc95e014e5bb24e5e5cefab1503
I20260925 01:49:51.570092 11523 raft_consensus.cc:2468] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:51.570268 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f97ead49634bf6b03e292544af4d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.572666 11176 leader_election.cc:304] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:49:51.573091 11176 leader_election.cc:343] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b9937c3776f549dea887ace26dae492c
I20260925 01:49:51.573340 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4adf83738ae7445bbbe57ce8e26c87ce" } new_table_name: "default.Table_126b13b368c348bea98d7d87748aaf1c" modify_external_catalogs: true
I20260925 01:49:51.573424 11965 raft_consensus.cc:2804] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:51.573570 11965 raft_consensus.cc:697] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:51.573880 11965 consensus_queue.cc:237] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.575634 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_09e74499a02540e4b52702ff9edba4bf" } modify_external_catalogs: true
I20260925 01:49:51.575831 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_09e74499a02540e4b52702ff9edba4bf" } modify_external_catalogs: true
I20260925 01:49:51.577229 12137 raft_consensus.cc:493] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.577564 12137 raft_consensus.cc:515] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.578162 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 39) took 5064 ms. Trace:
I20260925 01:49:51.578280 12137 leader_election.cc:290] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.579478 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9937c3776f549dea887ace26dae492c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:51.580173 11177 leader_election.cc:304] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:51.580665 12263 raft_consensus.cc:2749] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:51.587191 11953 rpcz_store.cc:276] 0925 01:49:46.484378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.484468 (+ 90us) service_pool.cc:224] Handling call
0925 01:49:50.976766 (+4492298us) ts_tablet_manager.cc:1151] Deleting tablet 2d76845ed48045b7b3632179be022e5f
0925 01:49:50.976776 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.168110 (+191334us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.483561 (+315451us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.548527 (+ 64966us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4470459}
I20260925 01:49:51.587935 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 2d76845ed48045b7b3632179be022e5f (table default.Table_7e3942ff37734d5aa89cfb724ea34ca7 [id=c213f0abfafd451b99a639859fc4bb18]) successfully deleted
I20260925 01:49:51.588217 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 96b68399843a422b8da3ddfab2c522e6
I20260925 01:49:51.587949 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ad64de020ae64170995d164f0ae43e85" } new_table_name: "default.Table_d3283efd340e4467bff4bc8b33862b02" modify_external_catalogs: true
I20260925 01:49:51.588366 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 98ffeb9d70374afdb72a728d7b211d33
I20260925 01:49:51.588793 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 98ffeb9d70374afdb72a728d7b211d33 deleted and replaced by tablet a8055cc9b06045449e6133298c8074e1
W20260925 01:49:51.589327 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 519d954b6a214d0b8e960e128cfcea10 consensus state has no leader
I20260925 01:49:51.589881 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8c1abd3c2cb34915a595ea73a8d10743
I20260925 01:49:51.591395 11931 ts_tablet_manager.cc:1929] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.591531 11931 log.cc:1199] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/7900db92b35048aaa200ed3183031d6b
I20260925 01:49:51.591701 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 9771b89303094974902c4ad1f1c8608e (DEFAULT_TABLE table=default.Table_b2c0a186ead548bca5ccee40cb8df40f [id=0715eef3ce6a4fa292556da81676ed28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.592029 11931 ts_tablet_manager.cc:1950] T 7900db92b35048aaa200ed3183031d6b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:51.592994 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 125) took 3015 ms. Trace:
I20260925 01:49:51.593575 11379 raft_consensus.cc:2468] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:51.595494 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 86c8c3bba9614539bfe3018461ad21f8
I20260925 01:49:51.596024 11953 tablet_replica.cc:333] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:51.596320 11953 raft_consensus.cc:2243] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:51.596614 11953 raft_consensus.cc:2272] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.597307 11953 ts_tablet_manager.cc:1916] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.598654 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet 96b68399843a422b8da3ddfab2c522e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.599622 11755 tablet_bootstrap.cc:492] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:51.600507 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.603461 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f3e4b358fe414d429eeb14421237c8ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.604282 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3e4b358fe414d429eeb14421237c8ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:51.604417 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 811b957c4e6647ccaa688d7273ec9eeb has no consensus state
I20260925 01:49:51.604543 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9771b89303094974902c4ad1f1c8608e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.605937 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_17e3438d1c3f4f16b6d2239eda8e5844"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.606633 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17e3438d1c3f4f16b6d2239eda8e5844 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.607658 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_08253081d4394fcb8947f45c2fb695e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.607846 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4aba0779435d4c10be3a8cd86662cb8a" } new_table_name: "default.Table_a0cea089195844d4a3f2e191f31d3750" modify_external_catalogs: true
W20260925 01:49:51.608253 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08253081d4394fcb8947f45c2fb695e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.609463 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 with delete_type TABLET_DATA_DELETED (replaced by tablet a8055cc9b06045449e6133298c8074e1) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.612893 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b308f3b1fe9d45f992a1532840f21395"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.613509 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b308f3b1fe9d45f992a1532840f21395 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.594606 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.615139 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_69808203cbf24446a89a1c2eae6aadc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.615964 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69808203cbf24446a89a1c2eae6aadc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.619112 11755 tablet_bootstrap.cc:654] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.619264 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bf94da756bf24c42b0debbb732b59861" } modify_external_catalogs: true
I20260925 01:49:51.619557 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bf94da756bf24c42b0debbb732b59861" } modify_external_catalogs: true
I20260925 01:49:51.622750 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ab286e1355354606bcc30f9697f9156d" } new_table_name: "default.Table_0d011eae3e3e4b40a2df36dd1362b71e" modify_external_catalogs: true
I20260925 01:49:51.623510 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1cdf87a2bed04ce0a5ad9c7eda026822"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.624171 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cdf87a2bed04ce0a5ad9c7eda026822 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.625905 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 491d790067644090aa4d25f4060cc2ec (table default.Table_cfe6eab0e20b4395bac0c7c4e39622bb [id=c4f3427ae0cd45ee8e7351746b7933c3]) successfully deleted
I20260925 01:49:51.627507 11754 tablet_bootstrap.cc:492] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:51.627787 11754 ts_tablet_manager.cc:1403] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.269s user 0.004s sys 0.009s
I20260925 01:49:51.629051 11754 raft_consensus.cc:359] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.629289 11754 raft_consensus.cc:385] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.629388 11754 raft_consensus.cc:740] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.629684 11754 consensus_queue.cc:260] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:51.635192 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ae497a92e49746a79cbbfe3c82b2b544 because the tablet was not found. No further retry: Not found: Tablet not found: ae497a92e49746a79cbbfe3c82b2b544
I20260925 01:49:51.635707 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c91274a8eb214f14b4baeb24cabdd8c6" } new_table_name: "default.Table_3bcedabba6c244178b5f3479e7996282" modify_external_catalogs: true
I20260925 01:49:51.593116 11931 rpcz_store.cc:276] 0925 01:49:48.577693 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.606260 (+ 28567us) service_pool.cc:224] Handling call
0925 01:49:51.443382 (+2837122us) ts_tablet_manager.cc:1151] Deleting tablet 7900db92b35048aaa200ed3183031d6b
0925 01:49:51.443395 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.587464 (+144069us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.591317 (+ 3853us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.592933 (+ 1616us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2836855}
I20260925 01:49:51.638662 11931 tablet_replica.cc:333] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:51.638911 11931 raft_consensus.cc:2243] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:51.638888 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.639751 11351 tablet_service.cc:1511] Processing CreateTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 (DEFAULT_TABLE table=default.Table_5494c67817c04f7db697678f00ba117d [id=75fabdd6afe3465ea2fa07ac644cda0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.643338 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 81024a75b31e45e098d108bae4cc17c9 (DEFAULT_TABLE table=default.Table_e2abaeb692e1458dacd8e8bab6cf101f [id=3a20320201fe4834bd86c120b86856a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.644981 11946 raft_consensus.cc:2243] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:51.645362 11946 pending_rounds.cc:70] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:51.645474 11931 raft_consensus.cc:2272] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.645538 11946 pending_rounds.cc:77] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072837267640320 op_type: NO_OP noop_request { }
I20260925 01:49:51.645742 11946 raft_consensus.cc:2889] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:51.645974 11946 raft_consensus.cc:2272] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.646381 11931 ts_tablet_manager.cc:1916] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.650817 11754 ts_tablet_manager.cc:1434] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.023s user 0.001s sys 0.002s
I20260925 01:49:51.658188 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 8afcf8f6d0e24472a3190059df032698 (DEFAULT_TABLE table=default.Table_77556b8645c143cba6b3bee14942c58b [id=749545cadfbc47f3a12a9d327cfda9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.658799 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e5d28d466741a0a085a4f9938fffd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.660876 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81024a75b31e45e098d108bae4cc17c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.661926 12263 consensus_queue.cc:1048] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:51.663022 11754 tablet_bootstrap.cc:492] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:51.665825 11754 tablet_bootstrap.cc:654] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:51.667860 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35b123ac1e894239875404438ed19927 consensus state has no leader
W20260925 01:49:51.667961 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 115394us
W20260925 01:49:51.668628 11456 leader_election.cc:343] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:51.669154 11456 consensus_peers.cc:597] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:51.670341 12137 raft_consensus.cc:493] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.670498 12137 raft_consensus.cc:515] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.671797 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afcf8f6d0e24472a3190059df032698. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.671810 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f385af75e11c4643b4e7c2d899ee99a4 has no consensus state
W20260925 01:49:51.673008 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f46004be36b543a395a783a13b1b14cf consensus state has no leader
I20260925 01:49:51.673657 11946 ts_tablet_manager.cc:1916] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.673745 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 99913eb35197442880a27b3c288237f4
I20260925 01:49:51.669935 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_98e49819b069428c81b83d226192a743 [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 1 got 0
I20260925 01:49:51.670527 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1396d679e5824c469490170d257f6a9b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.675472 11237 raft_consensus.cc:2468] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:51.681243 11456 leader_election.cc:304] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:51.681592 12288 raft_consensus.cc:2804] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:51.681670 12288 raft_consensus.cc:493] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:51.681756 12288 raft_consensus.cc:3060] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:51.682912 11664 consensus_peers.cc:597] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 -> Peer ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823): Couldn't send request to peer ca2cee7752c249f68a372ef5c6a18bff. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.252:44823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 01:49:51.683143 11176 consensus_peers.cc:597] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:51.678153 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 (DEFAULT_TABLE table=default.Table_fbb2f99ff1e94b04ac906f20c094f645 [id=fc1e6e3a4c5845d3865d8bf7bf658dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.684507 11753 ts_tablet_manager.cc:1434] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.132s user 0.000s sys 0.003s
I20260925 01:49:51.685250 11753 tablet_bootstrap.cc:492] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:51.687353 12137 leader_election.cc:290] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.687637 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5048a0fca2e64ffa9f19000f48a4c090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.688174 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3289c6dc8e84a358f877a197412d901" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.688478 11237 raft_consensus.cc:2393] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:51.690163 11754 tablet_bootstrap.cc:492] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:51.690413 11754 ts_tablet_manager.cc:1403] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.002s
I20260925 01:49:51.691764 11754 raft_consensus.cc:359] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.692067 11754 raft_consensus.cc:385] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.692169 11754 raft_consensus.cc:740] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.692432 11754 consensus_queue.cc:260] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.693313 11352 tablet_service.cc:1511] Processing CreateTablet for tablet cc4a51356880486a928181ee701f74d0 (DEFAULT_TABLE table=default.Table_abb11ad0c29f45e2a38ef498da7e605b [id=ad62203df2f049f2988e6c7ad5b5188d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.694254 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4a51356880486a928181ee701f74d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.696506 11360 tablet_service.cc:1511] Processing CreateTablet for tablet e9462215644a41ccb2f269f64e35392a (DEFAULT_TABLE table=default.Table_1a45113614774c6dbf41445536534f11 [id=c57122da57314b6d92c6760c5fb32b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.697078 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 99913eb35197442880a27b3c288237f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:51.699311 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 consensus state has no leader
I20260925 01:49:51.699455 12288 raft_consensus.cc:515] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.700706 12288 leader_election.cc:290] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.701350 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1396d679e5824c469490170d257f6a9b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:51.701655 11237 raft_consensus.cc:3060] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.702132 11753 tablet_bootstrap.cc:654] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.703090 11931 ts_tablet_manager.cc:1929] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:51.703299 11931 log.cc:1199] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/4195e3f8e93e40fe9dfd72710d319dca
I20260925 01:49:51.703909 11931 ts_tablet_manager.cc:1950] T 4195e3f8e93e40fe9dfd72710d319dca P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:51.704521 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 (DEFAULT_TABLE table=default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:51.704990 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 75a8e09b8838443c9bfff440ff1f877d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75a8e09b8838443c9bfff440ff1f877d already in progress: creating tablet
I20260925 01:49:51.706020 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_93ee32c298354a5bbb21cb437993fe10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.706483 11237 raft_consensus.cc:2468] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
W20260925 01:49:51.706852 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93ee32c298354a5bbb21cb437993fe10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.707093 11456 leader_election.cc:304] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:51.707487 12288 raft_consensus.cc:2804] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:51.707670 12288 raft_consensus.cc:697] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:51.708153 12288 consensus_queue.cc:237] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.708462 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bfb00ac43aff4ba89b0dc0e6f9298bbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.709228 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfb00ac43aff4ba89b0dc0e6f9298bbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.715891 11754 ts_tablet_manager.cc:1434] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.025s user 0.003s sys 0.000s
I20260925 01:49:51.719070 12105 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:51.719367 12105 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.702270 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_98e49819b069428c81b83d226192a743 [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 1 got 0
I20260925 01:49:51.720606 11946 ts_tablet_manager.cc:1929] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.720798 11946 log.cc:1199] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/95dfbc1ce9db4f01bf6ec8965b62c994
I20260925 01:49:51.720954 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9462215644a41ccb2f269f64e35392a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.721591 11946 ts_tablet_manager.cc:1950] T 95dfbc1ce9db4f01bf6ec8965b62c994 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:51.722040 12105 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:51.722311 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 (DEFAULT_TABLE table=default.Table_d143a5ee928e48efae3ed675e65f4871 [id=bf9b5cb2e68745dabd9184ea927e76a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.722680 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 28) took 5295 ms. Trace:
I20260925 01:49:51.722976 11946 rpcz_store.cc:276] 0925 01:49:46.427164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.427221 (+ 57us) service_pool.cc:224] Handling call
0925 01:49:51.522912 (+5095691us) ts_tablet_manager.cc:1151] Deleting tablet 95dfbc1ce9db4f01bf6ec8965b62c994
0925 01:49:51.522924 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.698474 (+175550us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.720445 (+ 21971us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.722636 (+ 2191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37452,"tablet-delete.queue_time_us":5095416}
I20260925 01:49:51.723765 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c8c3bba9614539bfe3018461ad21f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.724467 11754 tablet_bootstrap.cc:492] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:51.726526 11754 tablet_bootstrap.cc:654] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.726769 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 602af3d6e7bb44f8a316691019f85c25 (DEFAULT_TABLE table=default.Table_868285a9866c47e5a5eb6932b93a6fbc [id=a58f0d622f6a4d59997065e3cc28f2d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.729137 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 7900db92b35048aaa200ed3183031d6b (table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]) successfully deleted
I20260925 01:49:51.729610 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 127) took 2985 ms. Trace:
I20260925 01:49:51.729773 11931 rpcz_store.cc:276] 0925 01:49:48.744425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.744501 (+ 76us) service_pool.cc:224] Handling call
0925 01:49:51.638557 (+2894056us) ts_tablet_manager.cc:1151] Deleting tablet 4195e3f8e93e40fe9dfd72710d319dca
0925 01:49:51.638571 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.677595 (+ 39024us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.702933 (+ 25338us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.729558 (+ 26625us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3890,"tablet-delete.queue_time_us":2890460}
I20260925 01:49:51.730227 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 9771b89303094974902c4ad1f1c8608e (DEFAULT_TABLE table=default.Table_b2c0a186ead548bca5ccee40cb8df40f [id=0715eef3ce6a4fa292556da81676ed28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.730448 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 129) took 2969 ms. Trace:
I20260925 01:49:51.730705 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9771b89303094974902c4ad1f1c8608e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.730587 11931 rpcz_store.cc:276] 0925 01:49:48.760907 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.760979 (+ 72us) service_pool.cc:224] Handling call
0925 01:49:51.730238 (+2969259us) ts_tablet_manager.cc:1151] Deleting tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b
0925 01:49:51.730253 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.730403 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2968937}
I20260925 01:49:51.730962 11931 tablet_replica.cc:333] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:51.731192 11931 raft_consensus.cc:2243] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:51.731515 11931 pending_rounds.cc:70] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:51.731608 11931 pending_rounds.cc:77] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072857773277184 op_type: NO_OP noop_request { }
I20260925 01:49:51.731765 11931 raft_consensus.cc:2889] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:51.731940 11931 raft_consensus.cc:2272] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.742146 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6071e9aeccf94c38b3a13b08027ad884"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.742664 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3ba459a81845699435c2e44f5c9f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.743775 11946 tablet_replica.cc:333] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:51.744179 11946 raft_consensus.cc:2243] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:51.744324 11931 ts_tablet_manager.cc:1916] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.744724 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 8afcf8f6d0e24472a3190059df032698 (DEFAULT_TABLE table=default.Table_77556b8645c143cba6b3bee14942c58b [id=749545cadfbc47f3a12a9d327cfda9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.745460 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.747635 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afcf8f6d0e24472a3190059df032698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.746629 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 96b68399843a422b8da3ddfab2c522e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.748270 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 with delete_type TABLET_DATA_DELETED (replaced by tablet a8055cc9b06045449e6133298c8074e1) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.748919 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 96b68399843a422b8da3ddfab2c522e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.741032 12315 tablet.cc:1751] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:51.746614 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.746786 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 8afcf8f6d0e24472a3190059df032698 (DEFAULT_TABLE table=default.Table_77556b8645c143cba6b3bee14942c58b [id=749545cadfbc47f3a12a9d327cfda9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.749482 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 with delete_type TABLET_DATA_DELETED (replaced by tablet a8055cc9b06045449e6133298c8074e1) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.749758 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8afcf8f6d0e24472a3190059df032698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.750254 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.750928 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.751073 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602af3d6e7bb44f8a316691019f85c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.751929 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:51.752627 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 490649us
I20260925 01:49:51.752836 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.752861 11946 raft_consensus.cc:2272] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.753868 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 81024a75b31e45e098d108bae4cc17c9 (DEFAULT_TABLE table=default.Table_e2abaeb692e1458dacd8e8bab6cf101f [id=3a20320201fe4834bd86c120b86856a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.754369 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81024a75b31e45e098d108bae4cc17c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.756153 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 81024a75b31e45e098d108bae4cc17c9 (DEFAULT_TABLE table=default.Table_e2abaeb692e1458dacd8e8bab6cf101f [id=3a20320201fe4834bd86c120b86856a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.756927 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81024a75b31e45e098d108bae4cc17c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.759538 11354 tablet_service.cc:1511] Processing CreateTablet for tablet aaa2f7ef888846ec9667916ba47084db (DEFAULT_TABLE table=default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.760046 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa2f7ef888846ec9667916ba47084db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.761231 11209 tablet_service.cc:1511] Processing CreateTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 (DEFAULT_TABLE table=default.Table_5494c67817c04f7db697678f00ba117d [id=75fabdd6afe3465ea2fa07ac644cda0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.747432 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_22a3f87d316e46268ed60c79ab7a9824"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.762348 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22a3f87d316e46268ed60c79ab7a9824 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:51.764062 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6071e9aeccf94c38b3a13b08027ad884 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.765082 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 (DEFAULT_TABLE table=default.Table_ec6a77ed80f04e6d8eaa7f81d505133f [id=0f94e9a1c0e44ed2a4fe40673de847db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.763917 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 (DEFAULT_TABLE table=default.Table_0edb84dafd8f46f6856de68ddb449886 [id=ea287d157483442c87bc629e0b7df82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.766757 11314 leader_election.cc:304] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:51.767103 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e5d28d466741a0a085a4f9938fffd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.743716 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 9771b89303094974902c4ad1f1c8608e (DEFAULT_TABLE table=default.Table_b2c0a186ead548bca5ccee40cb8df40f [id=0715eef3ce6a4fa292556da81676ed28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.778842 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_82ebda3635eb4fdbb40fd316f06241b8" } modify_external_catalogs: true
I20260925 01:49:51.779096 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_82ebda3635eb4fdbb40fd316f06241b8" } modify_external_catalogs: true
I20260925 01:49:51.780553 12080 raft_consensus.cc:2749] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:51.776820 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9771b89303094974902c4ad1f1c8608e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.793242 11485 tablet_service.cc:1511] Processing CreateTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 (DEFAULT_TABLE table=default.Table_5494c67817c04f7db697678f00ba117d [id=75fabdd6afe3465ea2fa07ac644cda0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.793762 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4e5d28d466741a0a085a4f9938fffd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.796944 11753 tablet_bootstrap.cc:492] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:51.797127 11753 ts_tablet_manager.cc:1403] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.112s user 0.000s sys 0.007s
I20260925 01:49:51.798131 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329a5af9fb654d4c894e1cf4fd636c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.798931 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f19bccf3c5540cb828ec7bfc89a1c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.799417 11314 leader_election.cc:304] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:51.799595 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:49:51.799527 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2da4b76cb6af4fe8bb2540ddec9231de" } new_table_name: "default.Table_2428d63259334c4e96044516c1560465" modify_external_catalogs: true
I20260925 01:49:51.802511 11931 ts_tablet_manager.cc:1929] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.802651 11931 log.cc:1199] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/357963616763428fa69c7670e760f84e
I20260925 01:49:51.802668 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ec6a77ed80f04e6d8eaa7f81d505133f" } modify_external_catalogs: true
I20260925 01:49:51.802873 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ec6a77ed80f04e6d8eaa7f81d505133f" } modify_external_catalogs: true
I20260925 01:49:51.805305 11931 ts_tablet_manager.cc:1950] T 357963616763428fa69c7670e760f84e P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:51.800815 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.806515 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 126) took 3077 ms. Trace:
I20260925 01:49:51.806475 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d435f3e4da774c15a1f5f56480c2d888" } new_table_name: "default.Table_f12eeda830be434fbc7fa9b8827978d4" modify_external_catalogs: true
I20260925 01:49:51.806653 11931 rpcz_store.cc:276] 0925 01:49:48.729529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.988526 (+258997us) service_pool.cc:224] Handling call
0925 01:49:51.730868 (+2742342us) ts_tablet_manager.cc:1151] Deleting tablet 357963616763428fa69c7670e760f84e
0925 01:49:51.730890 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.771586 (+ 40696us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.802406 (+ 30820us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.806478 (+ 4072us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2596676}
W20260925 01:49:51.807806 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3150980bb72435886486156aa98d342 consensus state has no leader
I20260925 01:49:51.807804 11755 tablet_bootstrap.cc:492] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:51.807977 11755 ts_tablet_manager.cc:1403] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.231s user 0.006s sys 0.005s
I20260925 01:49:51.808135 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 153) took 2633 ms. Trace:
I20260925 01:49:51.808270 11931 rpcz_store.cc:276] 0925 01:49:49.174857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.175060 (+ 203us) service_pool.cc:224] Handling call
0925 01:49:51.807964 (+2632904us) ts_tablet_manager.cc:1151] Deleting tablet 00906edfa6b648229bcba8e59d68b969
0925 01:49:51.807978 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.808099 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2632690}
I20260925 01:49:51.808913 11755 raft_consensus.cc:359] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:51.809121 11755 raft_consensus.cc:385] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.809230 11755 raft_consensus.cc:740] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.809438 12080 raft_consensus.cc:2804] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:51.810453 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 154) took 2635 ms. Trace:
I20260925 01:49:51.810570 11931 rpcz_store.cc:276] 0925 01:49:49.175037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.175313 (+ 276us) service_pool.cc:224] Handling call
0925 01:49:51.810310 (+2634997us) ts_tablet_manager.cc:1151] Deleting tablet 1f778b87d307483b9edb17dce7355a65
0925 01:49:51.810322 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.810421 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2551308}
I20260925 01:49:51.810999 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3bcedabba6c244178b5f3479e7996282" } modify_external_catalogs: true
I20260925 01:49:51.811271 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3bcedabba6c244178b5f3479e7996282" } modify_external_catalogs: true
I20260925 01:49:51.811432 12080 raft_consensus.cc:697] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:51.811722 12080 consensus_queue.cc:237] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.813128 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4f19bccf3c5540cb828ec7bfc89a1c17
I20260925 01:49:51.814667 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_95ebdd9395354eba91e3babd76028061" } modify_external_catalogs: true
I20260925 01:49:51.814996 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_95ebdd9395354eba91e3babd76028061" } modify_external_catalogs: true
I20260925 01:49:51.815230 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 155) took 2599 ms. Trace:
I20260925 01:49:51.815363 11931 rpcz_store.cc:276] 0925 01:49:49.215929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.216015 (+ 86us) service_pool.cc:224] Handling call
0925 01:49:51.815070 (+2599055us) ts_tablet_manager.cc:1151] Deleting tablet 9cd2e1bf7d3e4459a84235b9c3f5383c
0925 01:49:51.815085 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.815193 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2552404}
W20260925 01:49:51.816591 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b98ad0f02eb74eba897040401a164f5c consensus state has no leader
I20260925 01:49:51.816923 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 158) took 2358 ms. Trace:
I20260925 01:49:51.817054 11931 rpcz_store.cc:276] 0925 01:49:49.458450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.458522 (+ 72us) service_pool.cc:224] Handling call
0925 01:49:51.816757 (+2358235us) ts_tablet_manager.cc:1151] Deleting tablet 644b28192e3b45e7b5370d55804cb043
0925 01:49:51.816767 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.816890 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2357952}
I20260925 01:49:51.818604 11931 tablet_replica.cc:333] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:51.821290 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 (DEFAULT_TABLE table=default.Table_fbb2f99ff1e94b04ac906f20c094f645 [id=fc1e6e3a4c5845d3865d8bf7bf658dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.821983 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5048a0fca2e64ffa9f19000f48a4c090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.822388 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 (DEFAULT_TABLE table=default.Table_fbb2f99ff1e94b04ac906f20c094f645 [id=fc1e6e3a4c5845d3865d8bf7bf658dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.823942 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5048a0fca2e64ffa9f19000f48a4c090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.824975 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.818921 11931 raft_consensus.cc:2243] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:51.827391 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 35b123ac1e894239875404438ed19927
I20260925 01:49:51.827610 11931 raft_consensus.cc:2272] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.828662 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b123ac1e894239875404438ed19927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.830204 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f1b6ea676a1f4d99807029d8401251ef
I20260925 01:49:51.830863 11211 tablet_service.cc:1511] Processing CreateTablet for tablet e9462215644a41ccb2f269f64e35392a (DEFAULT_TABLE table=default.Table_1a45113614774c6dbf41445536534f11 [id=c57122da57314b6d92c6760c5fb32b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.831285 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9462215644a41ccb2f269f64e35392a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.835775 11314 leader_election.cc:343] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.831431 11946 ts_tablet_manager.cc:1916] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.836306 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet f1b6ea676a1f4d99807029d8401251ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.838485 11931 ts_tablet_manager.cc:1916] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.842151 11314 leader_election.cc:304] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:51.843602 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_96968765ba9045588fca7ce661775b0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.844362 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96968765ba9045588fca7ce661775b0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.845780 11946 ts_tablet_manager.cc:1929] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:51.850090 11209 tablet_service.cc:1511] Processing CreateTablet for tablet cc4a51356880486a928181ee701f74d0 (DEFAULT_TABLE table=default.Table_abb11ad0c29f45e2a38ef498da7e605b [id=ad62203df2f049f2988e6c7ad5b5188d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.850548 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4a51356880486a928181ee701f74d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.857477 11953 ts_tablet_manager.cc:1929] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.857579 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_62d80cb30e374cc1ad9618b1df6adc21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.858184 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6c24eba1677646b18f3abd49f86f6afb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.858367 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62d80cb30e374cc1ad9618b1df6adc21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:51.858702 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c24eba1677646b18f3abd49f86f6afb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.859933 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_02a831c4d17044d8b03bad381ad3327a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.860427 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02a831c4d17044d8b03bad381ad3327a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.862514 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f9bc2f31552244b3a2372edb87acf2e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.863166 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9bc2f31552244b3a2372edb87acf2e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.865484 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.866459 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.871506 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8e91b8fa674944b5a4cf4095fc5d57b6" } new_table_name: "default.Table_c3cabf2f3b004ef7b3b7cff6f5640752" modify_external_catalogs: true
I20260925 01:49:51.871759 12309 raft_consensus.cc:2749] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:51.873497 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 602af3d6e7bb44f8a316691019f85c25 (DEFAULT_TABLE table=default.Table_868285a9866c47e5a5eb6932b93a6fbc [id=a58f0d622f6a4d59997065e3cc28f2d7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:51.874815 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 51135.2us
I20260925 01:49:51.875555 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602af3d6e7bb44f8a316691019f85c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.875767 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_064d8e4efcc9494089e586a0eb83a55f" } new_table_name: "default.Table_1c719484abbc48d985408ab5f7a3e42c" modify_external_catalogs: true
W20260925 01:49:51.875960 11314 consensus_peers.cc:597] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:51.876166 11314 leader_election.cc:343] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.877090 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5021ab79dc4eaf9ed612f7125a6dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.877336 11237 raft_consensus.cc:2468] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:51.878098 11953 log.cc:1199] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c75a4ed161734d30ab5ad2e2b00d77c9
I20260925 01:49:51.882222 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 99913eb35197442880a27b3c288237f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.882737 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 (DEFAULT_TABLE table=default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.883198 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c8c3bba9614539bfe3018461ad21f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.884881 11953 ts_tablet_manager.cc:1950] T c75a4ed161734d30ab5ad2e2b00d77c9 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:51.885144 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1ffecf54f1b3464eae523b831ac20bc0" } modify_external_catalogs: true
I20260925 01:49:51.885367 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1ffecf54f1b3464eae523b831ac20bc0" } modify_external_catalogs: true
I20260925 01:49:51.885972 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 43) took 5397 ms. Trace:
I20260925 01:49:51.886780 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b2c1222a9e064057bef3e7159e2d9ec3" } new_table_name: "default.Table_beeadc8d27b04484885e077b167d04df" modify_external_catalogs: true
I20260925 01:49:51.890826 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 95dfbc1ce9db4f01bf6ec8965b62c994 (table default.Table_7cc3b8c6b31b42e4813477df8a30a4a2 [id=1250f31018b04ced9587bb443f4091ea]) successfully deleted
I20260925 01:49:51.891950 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 (DEFAULT_TABLE table=default.Table_0edb84dafd8f46f6856de68ddb449886 [id=ea287d157483442c87bc629e0b7df82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.892385 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329a5af9fb654d4c894e1cf4fd636c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.894037 11218 tablet_service.cc:1511] Processing CreateTablet for tablet aaa2f7ef888846ec9667916ba47084db (DEFAULT_TABLE table=default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.894476 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa2f7ef888846ec9667916ba47084db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.895581 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.895669 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 (DEFAULT_TABLE table=default.Table_ec6a77ed80f04e6d8eaa7f81d505133f [id=0f94e9a1c0e44ed2a4fe40673de847db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.896028 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f19bccf3c5540cb828ec7bfc89a1c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.899966 11953 rpcz_store.cc:276] 0925 01:49:46.488491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.489114 (+ 623us) service_pool.cc:224] Handling call
0925 01:49:51.590307 (+5101193us) ts_tablet_manager.cc:1151] Deleting tablet c75a4ed161734d30ab5ad2e2b00d77c9
0925 01:49:51.590318 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.709928 (+119610us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.849765 (+139837us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.885932 (+ 36167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5083822}
I20260925 01:49:51.900614 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c75a4ed161734d30ab5ad2e2b00d77c9 (table default.Table_8f04a495ad294ac38a1fe39d586033d7 [id=3414ecadb9c24609b4011cc0ba7c73dd]) successfully deleted
W20260925 01:49:51.902698 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a00b69e42e1465981d6c3eec217393f has no consensus state
W20260925 01:49:51.905040 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e95fb28febd94a26ba9682fb9a462872 consensus state has no leader
W20260925 01:49:51.905774 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b97f703869d4471cb940ef654203ec2b consensus state has no leader
I20260925 01:49:51.906486 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.905875 11755 consensus_queue.cc:260] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:51.906564 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 30a5240093dd442a93bff006a965bc41
I20260925 01:49:51.907500 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 (DEFAULT_TABLE table=default.Table_d143a5ee928e48efae3ed675e65f4871 [id=bf9b5cb2e68745dabd9184ea927e76a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.907951 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3ba459a81845699435c2e44f5c9f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.909215 11953 tablet_replica.cc:333] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:51.911724 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 30a5240093dd442a93bff006a965bc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:51.912281 11755 ts_tablet_manager.cc:1434] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.104s user 0.002s sys 0.000s
I20260925 01:49:51.916353 11953 raft_consensus.cc:2243] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:51.916687 11953 raft_consensus.cc:2272] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.919149 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_28e00c8070064e4f9769a09dac622b6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.847911 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 99913eb35197442880a27b3c288237f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:51.849151 12069 consensus_queue.cc:1048] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:51.920197 11946 log.cc:1199] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/31fe174270f24ff780c212eaef90ef0d
W20260925 01:49:51.920352 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28e00c8070064e4f9769a09dac622b6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.920657 11946 ts_tablet_manager.cc:1950] T 31fe174270f24ff780c212eaef90ef0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:51.921551 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 29) took 5493 ms. Trace:
I20260925 01:49:51.921669 11946 rpcz_store.cc:276] 0925 01:49:46.427657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.427721 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:51.743665 (+5315944us) ts_tablet_manager.cc:1151] Deleting tablet 31fe174270f24ff780c212eaef90ef0d
0925 01:49:51.743677 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.842661 (+ 98984us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.845708 (+ 3047us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.921496 (+ 75788us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5315755}
I20260925 01:49:51.922207 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 30) took 5494 ms. Trace:
I20260925 01:49:51.922297 11946 rpcz_store.cc:276] 0925 01:49:46.428053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.430012 (+ 1959us) service_pool.cc:224] Handling call
0925 01:49:51.922003 (+5491991us) ts_tablet_manager.cc:1151] Deleting tablet ccffbe61eea34333abdc6da94612c0f6
0925 01:49:51.922016 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.922153 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5491786}
I20260925 01:49:51.922341 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_89979b06d2f04faa8b7f18b057afdbf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:51.922612 11946 tablet_replica.cc:333] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:51.865512 11753 raft_consensus.cc:359] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.869724 11503 tablet_service.cc:1511] Processing CreateTablet for tablet cc4a51356880486a928181ee701f74d0 (DEFAULT_TABLE table=default.Table_abb11ad0c29f45e2a38ef498da7e605b [id=ad62203df2f049f2988e6c7ad5b5188d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.922828 11946 raft_consensus.cc:2243] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:51.922940 11753 raft_consensus.cc:385] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:49:51.923051 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89979b06d2f04faa8b7f18b057afdbf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.923043 11946 raft_consensus.cc:2272] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:51.923211 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc4a51356880486a928181ee701f74d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.923655 11946 ts_tablet_manager.cc:1916] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.924413 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet 8b16a38a30ff44fb8d7eb01498f9b9c7 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:51.923053 11753 raft_consensus.cc:740] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.925057 11753 consensus_queue.cc:260] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:51.925634 11753 ts_tablet_manager.cc:1434] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.128s user 0.000s sys 0.002s
I20260925 01:49:51.925989 11753 tablet_bootstrap.cc:492] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:51.871150 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 (DEFAULT_TABLE table=default.Table_d143a5ee928e48efae3ed675e65f4871 [id=bf9b5cb2e68745dabd9184ea927e76a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.872787 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 (DEFAULT_TABLE table=default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.928432 11753 tablet_bootstrap.cc:654] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.928682 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3ba459a81845699435c2e44f5c9f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.931594 11755 tablet_bootstrap.cc:492] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:51.874898 11502 tablet_service.cc:1511] Processing CreateTablet for tablet e9462215644a41ccb2f269f64e35392a (DEFAULT_TABLE table=default.Table_1a45113614774c6dbf41445536534f11 [id=c57122da57314b6d92c6760c5fb32b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.877849 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5021ab79dc4eaf9ed612f7125a6dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:51.881047 11457 leader_election.cc:304] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:51.940277 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f1d2d998d834c21ab83694daae37520 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:51.889413 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 602af3d6e7bb44f8a316691019f85c25 (DEFAULT_TABLE table=default.Table_868285a9866c47e5a5eb6932b93a6fbc [id=a58f0d622f6a4d59997065e3cc28f2d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.892299 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 (DEFAULT_TABLE table=default.Table_0edb84dafd8f46f6856de68ddb449886 [id=ea287d157483442c87bc629e0b7df82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.893180 11501 tablet_service.cc:1511] Processing CreateTablet for tablet aaa2f7ef888846ec9667916ba47084db (DEFAULT_TABLE table=default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.894824 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 (DEFAULT_TABLE table=default.Table_ec6a77ed80f04e6d8eaa7f81d505133f [id=0f94e9a1c0e44ed2a4fe40673de847db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:51.942808 12069 raft_consensus.cc:2749] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:51.942932 11953 ts_tablet_manager.cc:1916] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:51.943200 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c8c3bba9614539bfe3018461ad21f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.944375 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa2f7ef888846ec9667916ba47084db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.945118 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f19bccf3c5540cb828ec7bfc89a1c17. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:51.945744 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 60864us
W20260925 01:49:51.948439 11457 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260925 01:49:51.955128 11671 master_service.cc:960] ReplaceTablet: received request to replace tablet a9944a1422d14ae2b22451e67c477d5b from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:51.956362 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:51.957362 12315 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:49:51.958494 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9462215644a41ccb2f269f64e35392a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.966549 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 602af3d6e7bb44f8a316691019f85c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.967931 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]) successfully deleted
W20260925 01:49:51.968240 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b because the tablet was not found. No further retry: Not found: Tablet not found: b0ad8ca37e3c49a4a03fc3460bf0bc5b
I20260925 01:49:51.968725 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 357963616763428fa69c7670e760f84e (table default.Table_dec5804091454eb1a0d870700050c904 [id=4ea66d3270f54caaa02e4084c6696342]) successfully deleted
W20260925 01:49:51.968988 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 00906edfa6b648229bcba8e59d68b969 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00906edfa6b648229bcba8e59d68b969 already in progress: creating tablet
W20260925 01:49:51.969244 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1f778b87d307483b9edb17dce7355a65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f778b87d307483b9edb17dce7355a65 already in progress: creating tablet
W20260925 01:49:51.969508 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cd2e1bf7d3e4459a84235b9c3f5383c already in progress: creating tablet
W20260925 01:49:51.969760 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 644b28192e3b45e7b5370d55804cb043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 644b28192e3b45e7b5370d55804cb043 already in progress: creating tablet
I20260925 01:49:51.971468 11754 tablet_bootstrap.cc:492] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:51.971678 11754 ts_tablet_manager.cc:1403] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.247s user 0.013s sys 0.013s
I20260925 01:49:51.974607 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:51.975493 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.975821 11931 ts_tablet_manager.cc:1929] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:51.978309 11239 raft_consensus.cc:3060] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:51.978451 11754 raft_consensus.cc:359] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:51.969259 11314 leader_election.cc:343] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:51.980698 11754 raft_consensus.cc:385] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:51.982157 11754 raft_consensus.cc:740] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:51.984274 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329a5af9fb654d4c894e1cf4fd636c13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:51.984351 11931 log.cc:1199] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/fa619556e5af473998080f4bbc9e5d1e
I20260925 01:49:51.984871 11931 ts_tablet_manager.cc:1950] T fa619556e5af473998080f4bbc9e5d1e P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:51.990132 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 31fe174270f24ff780c212eaef90ef0d (table default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d]) successfully deleted
W20260925 01:49:51.990576 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ccffbe61eea34333abdc6da94612c0f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccffbe61eea34333abdc6da94612c0f6 already in progress: creating tablet
I20260925 01:49:51.993427 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 159) took 2516 ms. Trace:
I20260925 01:49:51.987461 11755 tablet_bootstrap.cc:654] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:51.993552 11931 rpcz_store.cc:276] 0925 01:49:49.468822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.469761 (+ 939us) service_pool.cc:224] Handling call
0925 01:49:51.818518 (+2348757us) ts_tablet_manager.cc:1151] Deleting tablet fa619556e5af473998080f4bbc9e5d1e
0925 01:49:51.818532 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.867471 (+ 48939us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.972741 (+105270us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:51.985641 (+ 12900us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347827}
I20260925 01:49:51.985685 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet f1b6ea676a1f4d99807029d8401251ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:51.994297 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3c14d4f477e248bdaddf42e4370c5557"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:51.994982 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c14d4f477e248bdaddf42e4370c5557 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:51.995618 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]) successfully deleted
I20260925 01:49:52.000181 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c5ab983011a64d018825a79f53480036"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.000793 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5ab983011a64d018825a79f53480036 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.001189 11314 leader_election.cc:304] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:52.001574 12080 raft_consensus.cc:2749] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:52.003419 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3b5c5e5eccf6419294fcf649547572ac" } modify_external_catalogs: true
I20260925 01:49:52.003638 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3b5c5e5eccf6419294fcf649547572ac" } modify_external_catalogs: true
I20260925 01:49:52.004730 11754 consensus_queue.cc:260] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.007344 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 30a5240093dd442a93bff006a965bc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.009006 11754 ts_tablet_manager.cc:1434] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.037s user 0.000s sys 0.003s
I20260925 01:49:52.009409 11754 tablet_bootstrap.cc:492] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:52.010529 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 160) took 2535 ms. Trace:
I20260925 01:49:52.010653 11931 rpcz_store.cc:276] 0925 01:49:49.473675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.473757 (+ 82us) service_pool.cc:224] Handling call
0925 01:49:52.006875 (+2533118us) ts_tablet_manager.cc:1151] Deleting tablet 93329036763146beb8e6a9b039cc1ec1
0925 01:49:52.006896 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.008875 (+ 1979us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2532687}
I20260925 01:49:52.010918 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fdcdf308781f4f5ab7f4be9110e4434a" } new_table_name: "default.Table_acb7d558d3a9463e9cef61036b44d1c1" modify_external_catalogs: true
I20260925 01:49:52.011113 11931 tablet_replica.cc:333] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:52.011354 11931 raft_consensus.cc:2243] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:52.011686 11931 pending_rounds.cc:70] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:52.011752 11931 pending_rounds.cc:77] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072861489590272 op_type: NO_OP noop_request { }
I20260925 01:49:52.011916 11931 raft_consensus.cc:2889] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:52.012035 11931 raft_consensus.cc:2272] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:52.012511 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 93329036763146beb8e6a9b039cc1ec1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93329036763146beb8e6a9b039cc1ec1 already in progress: creating tablet
I20260925 01:49:52.015435 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0edb84dafd8f46f6856de68ddb449886" } modify_external_catalogs: true
I20260925 01:49:52.015625 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0edb84dafd8f46f6856de68ddb449886" } modify_external_catalogs: true
I20260925 01:49:52.019274 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b308f3b1fe9d45f992a1532840f21395" } new_table_name: "default.Table_232e67b3ae3d4a90837f84f8df8b7482" modify_external_catalogs: true
I20260925 01:49:52.025245 11754 tablet_bootstrap.cc:654] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:52.026263 11965 raft_consensus.cc:493] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:52.026415 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0749a0ae58df4ff8b74a86f072332fad has no consensus state
I20260925 01:49:52.027130 11965 raft_consensus.cc:515] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.030234 11965 leader_election.cc:290] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:52.030260 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9704bbf8ddbe4f129bccb5a8e30be536" } modify_external_catalogs: true
I20260925 01:49:52.030479 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9704bbf8ddbe4f129bccb5a8e30be536" } modify_external_catalogs: true
I20260925 01:49:52.031775 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa7a3941254478c800f9e366e3f7b06" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.032088 11379 raft_consensus.cc:2468] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:52.033138 11931 ts_tablet_manager.cc:1916] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.033485 11177 leader_election.cc:304] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:52.034654 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6a8f6bbf5d5d430f89f28a60bf15e379" } modify_external_catalogs: true
I20260925 01:49:52.034861 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6a8f6bbf5d5d430f89f28a60bf15e379" } modify_external_catalogs: true
I20260925 01:49:52.034889 11965 raft_consensus.cc:2804] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:52.035056 11965 raft_consensus.cc:493] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:52.036123 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.041041 12069 raft_consensus.cc:493] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.041797 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa7a3941254478c800f9e366e3f7b06" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:52.042217 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
W20260925 01:49:52.043174 11176 leader_election.cc:343] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.047753 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.053505 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1f1d2d998d834c21ab83694daae37520
I20260925 01:49:52.054167 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 1f1d2d998d834c21ab83694daae37520 deleted and replaced by tablet 4930edeb2edd4e7494dbf1761b5d20c0
I20260925 01:49:52.057735 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet f1b6ea676a1f4d99807029d8401251ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.057971 12069 raft_consensus.cc:515] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.058657 12069 leader_election.cc:290] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:52.058820 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b123ac1e894239875404438ed19927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.058947 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f1d2d998d834c21ab83694daae37520 with delete_type TABLET_DATA_DELETED (replaced by tablet 4930edeb2edd4e7494dbf1761b5d20c0) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.059878 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet 30a5240093dd442a93bff006a965bc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.062544 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 24cd89d238bf4220a48ecdf59cca5e6d
W20260925 01:49:52.063325 11456 leader_election.cc:343] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a3ec6c34d22241e5bda3ec6665a47fc7
I20260925 01:49:52.066887 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 31ecfc5a2a80449c9905c83b6bcb3652
I20260925 01:49:52.066892 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.067730 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 329a5af9fb654d4c894e1cf4fd636c13
I20260925 01:49:52.067885 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.069321 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.070669 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.070978 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f1d2d998d834c21ab83694daae37520 with delete_type TABLET_DATA_DELETED (replaced by tablet 4930edeb2edd4e7494dbf1761b5d20c0) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.071290 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f1d2d998d834c21ab83694daae37520 with delete_type TABLET_DATA_DELETED (replaced by tablet 4930edeb2edd4e7494dbf1761b5d20c0) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.072156 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b4bfc0be56f644a58a63e250d8b3e1fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.072808 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4bfc0be56f644a58a63e250d8b3e1fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.074420 11677 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030]). Expected version 3 got 0
I20260925 01:49:52.075261 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.075372 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.075623 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.075948 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.081049 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.084232 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a9944a1422d14ae2b22451e67c477d5b
I20260925 01:49:52.084960 11671 catalog_manager.cc:6934] ReplaceTablet: tablet a9944a1422d14ae2b22451e67c477d5b deleted and replaced by tablet c86a78873e8847fa95bead4774bea606
I20260925 01:49:52.085471 11965 raft_consensus.cc:3060] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:52.086547 11755 tablet_bootstrap.cc:492] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:52.089875 12263 raft_consensus.cc:493] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.091513 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet a9944a1422d14ae2b22451e67c477d5b with delete_type TABLET_DATA_DELETED (replaced by tablet c86a78873e8847fa95bead4774bea606) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.092432 11494 tablet_service.cc:1511] Processing CreateTablet for tablet e7b6bde824d74acfaaffc23a0b05db8b (DEFAULT_TABLE table=default.Table_bfb00ac43aff4ba89b0dc0e6f9298bbb [id=2a9ff32ac39e45a898876d49c1332249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.092855 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b6bde824d74acfaaffc23a0b05db8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.092522 12263 raft_consensus.cc:515] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.093871 12263 leader_election.cc:290] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:52.094293 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet a9944a1422d14ae2b22451e67c477d5b with delete_type TABLET_DATA_DELETED (replaced by tablet c86a78873e8847fa95bead4774bea606) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.094534 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b123ac1e894239875404438ed19927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.094534 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba19192502634f8599407d923114a627" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:52.095947 11211 tablet_service.cc:1511] Processing CreateTablet for tablet e7b6bde824d74acfaaffc23a0b05db8b (DEFAULT_TABLE table=default.Table_bfb00ac43aff4ba89b0dc0e6f9298bbb [id=2a9ff32ac39e45a898876d49c1332249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.097416 11216 tablet_service.cc:1511] Processing CreateTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 (DEFAULT_TABLE table=default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:52.101527 11176 leader_election.cc:343] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.101900 11484 tablet_service.cc:1511] Processing CreateTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 (DEFAULT_TABLE table=default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.102442 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 341dca6f396449daadcaf8bbb77ed04b (DEFAULT_TABLE table=default.Table_1cdf87a2bed04ce0a5ad9c7eda026822 [id=fffcb55426084429ade6e3c4daa22722]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.102880 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341dca6f396449daadcaf8bbb77ed04b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.103008 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b6bde824d74acfaaffc23a0b05db8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.105486 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7ab16b6170ce4446ab693383a6d4cc0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.106168 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ab16b6170ce4446ab693383a6d4cc0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.106441 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff70e44b72d1425c81751ff0b3d93b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.106642 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 0749a0ae58df4ff8b74a86f072332fad (DEFAULT_TABLE table=default.Table_232e67b3ae3d4a90837f84f8df8b7482 [id=2f63b14356454c6d851e30c358c79191]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.107630 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_69808203cbf24446a89a1c2eae6aadc0" } new_table_name: "default.Table_8f39791058ce4e92a65ff7c9e0fad5c7" modify_external_catalogs: true
I20260925 01:49:52.109685 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff70e44b72d1425c81751ff0b3d93b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.110826 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 (DEFAULT_TABLE table=default.Table_17e3438d1c3f4f16b6d2239eda8e5844 [id=a5bd4c860d4a438caec8cb47b396f3fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.113888 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 0749a0ae58df4ff8b74a86f072332fad (DEFAULT_TABLE table=default.Table_232e67b3ae3d4a90837f84f8df8b7482 [id=2f63b14356454c6d851e30c358c79191]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.114418 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0749a0ae58df4ff8b74a86f072332fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.115828 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 9513d1d55fe846f5b1a2b7d315209002 (DEFAULT_TABLE table=default.Table_69808203cbf24446a89a1c2eae6aadc0 [id=fc884308e078422c86ce1d6f7b0af92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.116282 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9513d1d55fe846f5b1a2b7d315209002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.109349 11965 raft_consensus.cc:515] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.117959 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa7a3941254478c800f9e366e3f7b06" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:52.118116 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f0078624576649ef939ea7242932cca4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:52.118357 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_45e7213362f74039a9576e25db157d24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.118669 11176 leader_election.cc:343] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:52.118955 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0078624576649ef939ea7242932cca4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.119115 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4cf67d6ebac74fe195aff1bffe6cde96" } new_table_name: "default.Table_96bc6986d6f54927954333032937dd6e" modify_external_catalogs: true
I20260925 01:49:52.119554 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c11632e9ce934a888e72894235561dcd" } new_table_name: "default.Table_c30cad1a9ce0463e9076a14f144ba438" modify_external_catalogs: true
I20260925 01:49:52.120323 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c28c8f00a8634ef89e4773b62e095b74
W20260925 01:49:52.124401 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45e7213362f74039a9576e25db157d24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.125520 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c8f00a8634ef89e4773b62e095b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.125502 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_71c7a46468e24855b65e14b9221f5930" } modify_external_catalogs: true
I20260925 01:49:52.126241 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0749a0ae58df4ff8b74a86f072332fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.127475 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 (DEFAULT_TABLE table=default.Table_17e3438d1c3f4f16b6d2239eda8e5844 [id=a5bd4c860d4a438caec8cb47b396f3fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.127909 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b92054aaa704c7ebd6b075c30db2616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.130278 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 9513d1d55fe846f5b1a2b7d315209002 (DEFAULT_TABLE table=default.Table_69808203cbf24446a89a1c2eae6aadc0 [id=fc884308e078422c86ce1d6f7b0af92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.130836 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9513d1d55fe846f5b1a2b7d315209002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.138365 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b92054aaa704c7ebd6b075c30db2616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.140647 11953 ts_tablet_manager.cc:1929] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:52.145792 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_71c7a46468e24855b65e14b9221f5930" } modify_external_catalogs: true
I20260925 01:49:52.146437 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6734b38bddb6462f81a668efbe01fad0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.147550 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6734b38bddb6462f81a668efbe01fad0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:52.150898 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9513d1d55fe846f5b1a2b7d315209002 consensus state has no leader
I20260925 01:49:52.152235 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3d10755c25e9452c8175928253480e9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.152802 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d10755c25e9452c8175928253480e9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.153311 11946 ts_tablet_manager.cc:1929] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:52.153474 11946 log.cc:1199] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/3eb4dac3099346a7975229d472a3919e
I20260925 01:49:52.149945 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3ee0ad1909f644498b594873c3d11c23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:52.153925 11946 ts_tablet_manager.cc:1950] T 3eb4dac3099346a7975229d472a3919e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:52.156337 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 31) took 5725 ms. Trace:
I20260925 01:49:52.156627 11946 rpcz_store.cc:276] 0925 01:49:46.430401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.434046 (+ 3645us) service_pool.cc:224] Handling call
0925 01:49:51.922526 (+5488480us) ts_tablet_manager.cc:1151] Deleting tablet 3eb4dac3099346a7975229d472a3919e
0925 01:49:51.922534 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.962682 (+ 40148us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.153190 (+190508us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.156269 (+ 3079us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5488252}
I20260925 01:49:52.157361 11946 tablet_replica.cc:333] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:52.157859 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c8f00a8634ef89e4773b62e095b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.158118 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.158171 11965 leader_election.cc:290] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:52.161769 11946 raft_consensus.cc:2243] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.161988 11946 raft_consensus.cc:2272] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.162540 11946 ts_tablet_manager.cc:1916] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:52.163106 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ee0ad1909f644498b594873c3d11c23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.163281 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 3eb4dac3099346a7975229d472a3919e (table default.Table_ebef853028984518b5b550224ea8e5dc [id=4e06f81ce5a94972bd01063957cf921f]) successfully deleted
I20260925 01:49:52.163812 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 341dca6f396449daadcaf8bbb77ed04b (DEFAULT_TABLE table=default.Table_1cdf87a2bed04ce0a5ad9c7eda026822 [id=fffcb55426084429ade6e3c4daa22722]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.169850 11221 tablet_service.cc:1511] Processing CreateTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 (DEFAULT_TABLE table=default.Table_0d011eae3e3e4b40a2df36dd1362b71e [id=6edf9644aff24924b25ac5b41147c40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.173833 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f385af75e11c4643b4e7c2d899ee99a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.170873 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_359930648bba4aa1b2c8e3b294aac1e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.175348 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_359930648bba4aa1b2c8e3b294aac1e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.180838 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341dca6f396449daadcaf8bbb77ed04b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:52.184278 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b61b1bf5a8d446918edc6d166b7712ef consensus state has no leader
W20260925 01:49:52.185740 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba378e9d37c64a8ebd56894b2101ed8f consensus state has no leader
I20260925 01:49:52.196388 11350 tablet_service.cc:1511] Processing CreateTablet for tablet e7b6bde824d74acfaaffc23a0b05db8b (DEFAULT_TABLE table=default.Table_bfb00ac43aff4ba89b0dc0e6f9298bbb [id=2a9ff32ac39e45a898876d49c1332249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.197803 11353 tablet_service.cc:1511] Processing CreateTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 (DEFAULT_TABLE table=default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.198621 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba19192502634f8599407d923114a627" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.199440 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 341dca6f396449daadcaf8bbb77ed04b (DEFAULT_TABLE table=default.Table_1cdf87a2bed04ce0a5ad9c7eda026822 [id=fffcb55426084429ade6e3c4daa22722]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.200171 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa7a3941254478c800f9e366e3f7b06" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:52.200431 11372 raft_consensus.cc:3060] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:52.201618 11177 leader_election.cc:343] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.201824 11177 leader_election.cc:304] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:52.202157 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 (DEFAULT_TABLE table=default.Table_4ae934a7969f4cb2aae617f37447aa50 [id=a011ca83653c46f2a9a8cfaeace6319d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.202379 11965 raft_consensus.cc:2749] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:52.203087 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a37a6deaeb24c99824b62fbb2d603b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.208848 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b6bde824d74acfaaffc23a0b05db8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.213124 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341dca6f396449daadcaf8bbb77ed04b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.213378 11354 tablet_service.cc:1511] Processing CreateTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 (DEFAULT_TABLE table=default.Table_0d011eae3e3e4b40a2df36dd1362b71e [id=6edf9644aff24924b25ac5b41147c40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.218223 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e297a48065794637b13d401d13c54906"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:52.218648 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 (DEFAULT_TABLE table=default.Table_799924aa3f2542a7ac6dbdd10143019b [id=c9e6146deaba4cb5b413613ca81a419d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.219033 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet a9944a1422d14ae2b22451e67c477d5b with delete_type TABLET_DATA_DELETED (replaced by tablet c86a78873e8847fa95bead4774bea606) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.219228 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728157ec17ed4df5a4a8559df6c1ac78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.220592 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cb4260d7591d4bf1b0c9e2a926970fe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.222236 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb4260d7591d4bf1b0c9e2a926970fe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:52.222299 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e297a48065794637b13d401d13c54906 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.223934 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ef156363e7164df8bef902f6f27e3116" } new_table_name: "default.Table_26432ca1da60402cab9f0d15c955ee62" modify_external_catalogs: true
I20260925 01:49:52.229322 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 9513d1d55fe846f5b1a2b7d315209002 (DEFAULT_TABLE table=default.Table_69808203cbf24446a89a1c2eae6aadc0 [id=fc884308e078422c86ce1d6f7b0af92e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.229729 11953 log.cc:1199] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ff92ca86767f4ba6905da62b6a4b892c
I20260925 01:49:52.230526 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7ab16b6170ce4446ab693383a6d4cc0d" } new_table_name: "default.Table_b880ff4c65f9490d82a5543163a16ef5" modify_external_catalogs: true
I20260925 01:49:52.232209 11754 tablet_bootstrap.cc:492] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:52.232589 11754 ts_tablet_manager.cc:1403] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.223s user 0.002s sys 0.008s
I20260925 01:49:52.233959 11754 raft_consensus.cc:359] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.234362 11754 raft_consensus.cc:385] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.234551 11754 raft_consensus.cc:740] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.237358 11754 consensus_queue.cc:260] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.237529 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6715233be44b9aad5210d17500f59d (DEFAULT_TABLE table=default.Table_cc6c271622254896bab14472c1455e8f [id=55ffdd6e6ba74e3cae87646903fb68cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.239734 11754 ts_tablet_manager.cc:1434] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260925 01:49:52.244576 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb (DEFAULT_TABLE table=default.Table_d3283efd340e4467bff4bc8b33862b02 [id=297da19bbbb7417a9d7a928bf0c92edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.245810 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb (DEFAULT_TABLE table=default.Table_aef1efeefaf4495bb03c12af5e28505b [id=d97f3281c5084ab184e72bb9ff6c8c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.250995 11206 tablet_service.cc:1511] Processing CreateTablet for tablet bd594870fa6a4ba190a18a48d821d72c (DEFAULT_TABLE table=default.Table_1ef54231b09343c68073a0b4a490545b [id=c5063b64da5341b9a9e9282585d74695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.252096 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad (DEFAULT_TABLE table=default.Table_5995b17dc74742079004a9f3dadc82b8 [id=19ba7adc361640ed8767b565d92b0ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.252991 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 113d7ccee4e349e19d3948e09d2c533d (DEFAULT_TABLE table=default.Table_f3e4b358fe414d429eeb14421237c8ac [id=c633dead809249008fc80c9f840f4ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.253459 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113d7ccee4e349e19d3948e09d2c533d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.254940 11211 tablet_service.cc:1511] Processing CreateTablet for tablet e40083a885974e3595ec2fb5b16d4a5d (DEFAULT_TABLE table=default.Table_0c8444676dd247048ee61b454fa4e0c3 [id=3eb929859fec4e119e50eb65fa8b0b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.255497 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40083a885974e3595ec2fb5b16d4a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.258627 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f1e725fe84552943563aa95687842 (DEFAULT_TABLE table=default.Table_08253081d4394fcb8947f45c2fb695e7 [id=564bdd9ee3404040b32798c6890aff6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.259044 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f1e725fe84552943563aa95687842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.260511 11931 ts_tablet_manager.cc:1929] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:52.260664 11931 log.cc:1199] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/cedc909f3c864a7cbbd12dbdfb3315ec
I20260925 01:49:52.261204 11931 ts_tablet_manager.cc:1950] T cedc909f3c864a7cbbd12dbdfb3315ec P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:52.265925 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c33c7eb6481e4876aed3d7038afa9f93" } modify_external_catalogs: true
I20260925 01:49:52.266202 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c33c7eb6481e4876aed3d7038afa9f93" } modify_external_catalogs: true
I20260925 01:49:52.269446 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6715233be44b9aad5210d17500f59d (DEFAULT_TABLE table=default.Table_cc6c271622254896bab14472c1455e8f [id=55ffdd6e6ba74e3cae87646903fb68cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.273346 12069 raft_consensus.cc:493] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac4ec033f794d7a90b52aa4e0b6155d)
I20260925 01:49:52.273545 12069 raft_consensus.cc:515] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.274391 12069 leader_election.cc:290] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:52.276503 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_77556b8645c143cba6b3bee14942c58b" } modify_external_catalogs: true
I20260925 01:49:52.276790 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_77556b8645c143cba6b3bee14942c58b" } modify_external_catalogs: true
I20260925 01:49:52.278571 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6715233be44b9aad5210d17500f59d (DEFAULT_TABLE table=default.Table_cc6c271622254896bab14472c1455e8f [id=55ffdd6e6ba74e3cae87646903fb68cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.279733 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b2202b3e9b174d9a9bff1f005144d412" } modify_external_catalogs: true
I20260925 01:49:52.279930 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b2202b3e9b174d9a9bff1f005144d412" } modify_external_catalogs: true
I20260925 01:49:52.282846 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 (DEFAULT_TABLE table=default.Table_799924aa3f2542a7ac6dbdd10143019b [id=c9e6146deaba4cb5b413613ca81a419d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.285468 11754 tablet_bootstrap.cc:492] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:52.285328 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 8a00b69e42e1465981d6c3eec217393f (DEFAULT_TABLE table=default.Table_1c719484abbc48d985408ab5f7a3e42c [id=ce0e7e5581b649feab00f639935dba9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.285820 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811b957c4e6647ccaa688d7273ec9eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.286649 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd594870fa6a4ba190a18a48d821d72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.288101 11501 tablet_service.cc:1511] Processing CreateTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 (DEFAULT_TABLE table=default.Table_0d011eae3e3e4b40a2df36dd1362b71e [id=6edf9644aff24924b25ac5b41147c40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.289631 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 226498ea628a475d8fcab28a6598a819
I20260925 01:49:52.278127 11755 ts_tablet_manager.cc:1403] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.174s user 0.006s sys 0.002s
I20260925 01:49:52.293715 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5122b8c24d3442a1a52ff0b003d65ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.294337 11207 tablet_service.cc:1511] Processing CreateTablet for tablet a8055cc9b06045449e6133298c8074e1 (DEFAULT_TABLE table=default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.294373 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33967e5e11524b78bb86ce7a3e2e16ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.297495 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 8e28aeabdf724784b8ed27535ea0701b (DEFAULT_TABLE table=default.Table_d9ec82d6876c42f4ba2646cb90d5c35b [id=8713b7aabc1a423fa360ce93bc949629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.297673 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 226498ea628a475d8fcab28a6598a819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.283115 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 (DEFAULT_TABLE table=default.Table_4ae934a7969f4cb2aae617f37447aa50 [id=a011ca83653c46f2a9a8cfaeace6319d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.306228 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 7347b31f782c4508b004c7523dc11dbb (DEFAULT_TABLE table=default.Table_992ecd7522c34d958da6f855b4bb8346 [id=3c7c1c6e189f47409dafd2c532f7cf12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.308053 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 161) took 2773 ms. Trace:
I20260925 01:49:52.308338 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8055cc9b06045449e6133298c8074e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.309122 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb (DEFAULT_TABLE table=default.Table_d3283efd340e4467bff4bc8b33862b02 [id=297da19bbbb7417a9d7a928bf0c92edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.309643 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6715233be44b9aad5210d17500f59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.315657 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4271efd546954005b792c8c40c4b6c88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.316409 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4271efd546954005b792c8c40c4b6c88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.316705 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e28aeabdf724784b8ed27535ea0701b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.318365 11931 rpcz_store.cc:276] 0925 01:49:49.507188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.507397 (+ 209us) service_pool.cc:224] Handling call
0925 01:49:52.011004 (+2503607us) ts_tablet_manager.cc:1151] Deleting tablet cedc909f3c864a7cbbd12dbdfb3315ec
0925 01:49:52.011019 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.084043 (+ 73024us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.260423 (+176380us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.280478 (+ 20055us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2499700}
I20260925 01:49:52.319073 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a00b69e42e1465981d6c3eec217393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.319290 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811b957c4e6647ccaa688d7273ec9eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.319603 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7347b31f782c4508b004c7523dc11dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.320140 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet cedc909f3c864a7cbbd12dbdfb3315ec (table default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7]) successfully deleted
I20260925 01:49:52.320483 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb (DEFAULT_TABLE table=default.Table_aef1efeefaf4495bb03c12af5e28505b [id=d97f3281c5084ab184e72bb9ff6c8c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.321370 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a37a6deaeb24c99824b62fbb2d603b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.321447 11931 tablet_replica.cc:333] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:52.321660 11931 raft_consensus.cc:2243] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.323386 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_992ecd7522c34d958da6f855b4bb8346" } modify_external_catalogs: true
I20260925 01:49:52.323650 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_992ecd7522c34d958da6f855b4bb8346" } modify_external_catalogs: true
I20260925 01:49:52.325029 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad (DEFAULT_TABLE table=default.Table_5995b17dc74742079004a9f3dadc82b8 [id=19ba7adc361640ed8767b565d92b0ada]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.330636 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 113d7ccee4e349e19d3948e09d2c533d (DEFAULT_TABLE table=default.Table_f3e4b358fe414d429eeb14421237c8ac [id=c633dead809249008fc80c9f840f4ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.330794 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_55f4b9d844104a95a649ebdd7d7def2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:52.331504 11753 tablet_bootstrap.cc:492] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:49:52.331619 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55f4b9d844104a95a649ebdd7d7def2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.333454 11493 tablet_service.cc:1511] Processing CreateTablet for tablet e40083a885974e3595ec2fb5b16d4a5d (DEFAULT_TABLE table=default.Table_0c8444676dd247048ee61b454fa4e0c3 [id=3eb929859fec4e119e50eb65fa8b0b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.338513 11485 tablet_service.cc:1511] Processing CreateTablet for tablet bd594870fa6a4ba190a18a48d821d72c (DEFAULT_TABLE table=default.Table_1ef54231b09343c68073a0b4a490545b [id=c5063b64da5341b9a9e9282585d74695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.338990 11753 ts_tablet_manager.cc:1403] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.406s user 0.002s sys 0.004s
I20260925 01:49:52.348258 11931 raft_consensus.cc:2272] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.349285 11931 ts_tablet_manager.cc:1916] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.350183 11754 tablet_bootstrap.cc:654] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:52.351161 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6715233be44b9aad5210d17500f59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.354169 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728157ec17ed4df5a4a8559df6c1ac78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.357604 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33967e5e11524b78bb86ce7a3e2e16ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.358860 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40083a885974e3595ec2fb5b16d4a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.359880 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113d7ccee4e349e19d3948e09d2c533d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.361060 11753 raft_consensus.cc:359] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.361279 11753 raft_consensus.cc:385] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.361371 11753 raft_consensus.cc:740] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.361636 11753 consensus_queue.cc:260] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.362397 11753 ts_tablet_manager.cc:1434] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260925 01:49:52.362823 11753 tablet_bootstrap.cc:492] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:52.365008 11753 tablet_bootstrap.cc:654] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:52.365491 12263 raft_consensus.cc:493] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.366495 12263 raft_consensus.cc:515] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.369131 12263 leader_election.cc:290] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:52.369406 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67921f86c4f6422e97d7f306262569f8" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:52.370709 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd594870fa6a4ba190a18a48d821d72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.372119 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f1e725fe84552943563aa95687842 (DEFAULT_TABLE table=default.Table_08253081d4394fcb8947f45c2fb695e7 [id=564bdd9ee3404040b32798c6890aff6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.372610 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f1e725fe84552943563aa95687842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.373528 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f385af75e11c4643b4e7c2d899ee99a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.375006 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5122b8c24d3442a1a52ff0b003d65ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.384218 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f385af75e11c4643b4e7c2d899ee99a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.386044 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c8f00a8634ef89e4773b62e095b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.386464 11755 raft_consensus.cc:359] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:52.386724 11755 raft_consensus.cc:385] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.386639 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb (DEFAULT_TABLE table=default.Table_aef1efeefaf4495bb03c12af5e28505b [id=d97f3281c5084ab184e72bb9ff6c8c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.386814 11755 raft_consensus.cc:740] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.387089 11755 consensus_queue.cc:260] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:52.387652 11755 ts_tablet_manager.cc:1434] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.028s user 0.001s sys 0.000s
I20260925 01:49:52.387984 11755 tablet_bootstrap.cc:492] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:52.388259 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 0749a0ae58df4ff8b74a86f072332fad (DEFAULT_TABLE table=default.Table_232e67b3ae3d4a90837f84f8df8b7482 [id=2f63b14356454c6d851e30c358c79191]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:52.392652 11176 leader_election.cc:343] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.393348 11372 raft_consensus.cc:2468] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:52.394085 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67921f86c4f6422e97d7f306262569f8" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.394888 11953 ts_tablet_manager.cc:1950] T ff92ca86767f4ba6905da62b6a4b892c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:52.395156 11177 leader_election.cc:304] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:52.395644 12263 raft_consensus.cc:2804] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:52.396238 12263 raft_consensus.cc:697] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:52.396600 12263 consensus_queue.cc:237] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:52.400420 11177 leader_election.cc:343] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.400578 11177 leader_election.cc:304] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:52.410259 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 (DEFAULT_TABLE table=default.Table_799924aa3f2542a7ac6dbdd10143019b [id=c9e6146deaba4cb5b413613ca81a419d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.410586 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 (DEFAULT_TABLE table=default.Table_17e3438d1c3f4f16b6d2239eda8e5844 [id=a5bd4c860d4a438caec8cb47b396f3fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.410981 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 (DEFAULT_TABLE table=default.Table_4ae934a7969f4cb2aae617f37447aa50 [id=a011ca83653c46f2a9a8cfaeace6319d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:52.411634 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 126234us
I20260925 01:49:52.412117 11314 leader_election.cc:304] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:52.412479 12080 raft_consensus.cc:2804] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:52.412595 12080 raft_consensus.cc:493] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:52.412706 12080 raft_consensus.cc:3060] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:52.414371 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6715233be44b9aad5210d17500f59d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.414930 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5122b8c24d3442a1a52ff0b003d65ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.415355 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9513d1d55fe846f5b1a2b7d315209002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.415771 12080 raft_consensus.cc:515] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.416663 12080 leader_election.cc:290] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:52.418778 11755 tablet_bootstrap.cc:654] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:52.424863 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be89c0911dfa4b9d83d6bd88755be2b2 consensus state has no leader
I20260925 01:49:52.425061 12080 consensus_queue.cc:1048] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:52.426740 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb (DEFAULT_TABLE table=default.Table_d3283efd340e4467bff4bc8b33862b02 [id=297da19bbbb7417a9d7a928bf0c92edd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.427636 11345 tablet_service.cc:1511] Processing CreateTablet for tablet bd594870fa6a4ba190a18a48d821d72c (DEFAULT_TABLE table=default.Table_1ef54231b09343c68073a0b4a490545b [id=c5063b64da5341b9a9e9282585d74695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.427922 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3ed6d725fb664332abe7a92a862f05f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:52.428295 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad (DEFAULT_TABLE table=default.Table_5995b17dc74742079004a9f3dadc82b8 [id=19ba7adc361640ed8767b565d92b0ada]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:52.428546 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ed6d725fb664332abe7a92a862f05f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:52.428704 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9663d7f4008e4ee0a3ba4373258242eb has no consensus state
I20260925 01:49:52.429072 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d82fb9eb56a0497cb5f94dc964e94656" } new_table_name: "default.Table_fdb22e002b0644ecb997d9d8ed3203ee" modify_external_catalogs: true
I20260925 01:49:52.430400 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 67921f86c4f6422e97d7f306262569f8
I20260925 01:49:52.431269 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a4b81d45884b4b448624e0ce194da08b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.431809 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4b81d45884b4b448624e0ce194da08b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.435647 11671 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]). Expected version 1 got 0
I20260925 01:49:52.436707 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_14e085ebe19844c79a4ed115d2911dd2" } new_table_name: "default.Table_febb4e0759ac4d36856d1ad53244b4be" modify_external_catalogs: true
I20260925 01:49:52.452417 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0749a0ae58df4ff8b74a86f072332fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.452773 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728157ec17ed4df5a4a8559df6c1ac78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.453133 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8afcf8f6d0e24472a3190059df032698
I20260925 01:49:52.453171 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4f1e725fe84552943563aa95687842 (DEFAULT_TABLE table=default.Table_08253081d4394fcb8947f45c2fb695e7 [id=564bdd9ee3404040b32798c6890aff6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.454121 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_08253081d4394fcb8947f45c2fb695e7" } new_table_name: "default.Table_926b0c54f75341d4adb363f2d234edfb" modify_external_catalogs: true
I20260925 01:49:52.454962 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4f1e725fe84552943563aa95687842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.455190 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff70e44b72d1425c81751ff0b3d93b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.455339 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7347b31f782c4508b004c7523dc11dbb
I20260925 01:49:52.455648 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 818a792969a245f5b0fe5f80128206ba
I20260925 01:49:52.456324 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f110a2374d274614a54c59ddd37553d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.457039 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f110a2374d274614a54c59ddd37553d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.458294 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 7347b31f782c4508b004c7523dc11dbb (DEFAULT_TABLE table=default.Table_992ecd7522c34d958da6f855b4bb8346 [id=3c7c1c6e189f47409dafd2c532f7cf12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.460783 12069 raft_consensus.cc:493] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.470325 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 113d7ccee4e349e19d3948e09d2c533d (DEFAULT_TABLE table=default.Table_f3e4b358fe414d429eeb14421237c8ac [id=c633dead809249008fc80c9f840f4ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.471591 11965 raft_consensus.cc:2749] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:52.477102 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 44) took 5962 ms. Trace:
I20260925 01:49:52.477243 11953 rpcz_store.cc:276] 0925 01:49:46.488611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.489143 (+ 532us) service_pool.cc:224] Handling call
0925 01:49:51.902656 (+5413513us) ts_tablet_manager.cc:1151] Deleting tablet ff92ca86767f4ba6905da62b6a4b892c
0925 01:49:51.902668 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:51.996451 (+ 93783us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.140548 (+144097us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.450870 (+310322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2677,"tablet-delete.queue_time_us":5396000}
I20260925 01:49:52.478433 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 8a00b69e42e1465981d6c3eec217393f (DEFAULT_TABLE table=default.Table_1c719484abbc48d985408ab5f7a3e42c [id=ce0e7e5581b649feab00f639935dba9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.478785 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 226498ea628a475d8fcab28a6598a819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.478998 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 67921f86c4f6422e97d7f306262569f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.479151 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afcf8f6d0e24472a3190059df032698 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.479300 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 7347b31f782c4508b004c7523dc11dbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.479446 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 818a792969a245f5b0fe5f80128206ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:52.471195 12080 raft_consensus.cc:493] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.480455 11953 tablet_replica.cc:333] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:52.480742 11953 raft_consensus.cc:2243] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:52.482595 11953 pending_rounds.cc:70] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:52.482684 11953 pending_rounds.cc:77] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072855441952768 op_type: NO_OP noop_request { }
I20260925 01:49:52.484341 11953 raft_consensus.cc:2889] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:52.484477 11953 raft_consensus.cc:2272] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.486384 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 67921f86c4f6422e97d7f306262569f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.487291 11349 tablet_service.cc:1511] Processing CreateTablet for tablet a8055cc9b06045449e6133298c8074e1 (DEFAULT_TABLE table=default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.487547 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 8e28aeabdf724784b8ed27535ea0701b (DEFAULT_TABLE table=default.Table_d9ec82d6876c42f4ba2646cb90d5c35b [id=8713b7aabc1a423fa360ce93bc949629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.487702 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afcf8f6d0e24472a3190059df032698 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.488366 11497 tablet_service.cc:1511] Processing CreateTablet for tablet a8055cc9b06045449e6133298c8074e1 (DEFAULT_TABLE table=default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.490131 11953 ts_tablet_manager.cc:1916] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.490173 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 818a792969a245f5b0fe5f80128206ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.490366 11965 raft_consensus.cc:493] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.491317 11965 raft_consensus.cc:515] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.492093 11965 leader_election.cc:290] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:52.497162 12069 raft_consensus.cc:515] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.497448 11347 tablet_service.cc:1511] Processing CreateTablet for tablet e40083a885974e3595ec2fb5b16d4a5d (DEFAULT_TABLE table=default.Table_0c8444676dd247048ee61b454fa4e0c3 [id=3eb929859fec4e119e50eb65fa8b0b2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.497732 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 811b957c4e6647ccaa688d7273ec9eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.497859 12069 leader_election.cc:290] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:52.498548 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 8e28aeabdf724784b8ed27535ea0701b (DEFAULT_TABLE table=default.Table_d9ec82d6876c42f4ba2646cb90d5c35b [id=8713b7aabc1a423fa360ce93bc949629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.498677 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 7347b31f782c4508b004c7523dc11dbb (DEFAULT_TABLE table=default.Table_992ecd7522c34d958da6f855b4bb8346 [id=3c7c1c6e189f47409dafd2c532f7cf12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.499104 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113d7ccee4e349e19d3948e09d2c533d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.499591 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd594870fa6a4ba190a18a48d821d72c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.500308 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33967e5e11524b78bb86ce7a3e2e16ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.500655 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a37a6deaeb24c99824b62fbb2d603b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.501505 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b92054aaa704c7ebd6b075c30db2616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.501662 12080 raft_consensus.cc:515] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:52.503780 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7347b31f782c4508b004c7523dc11dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.502343 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 7347b31f782c4508b004c7523dc11dbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:52.505877 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e28aeabdf724784b8ed27535ea0701b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.510620 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a00b69e42e1465981d6c3eec217393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.514542 11931 ts_tablet_manager.cc:1929] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:52.514711 11931 log.cc:1199] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:49:52.516479 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8055cc9b06045449e6133298c8074e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:52.518255 11314 consensus_peers.cc:597] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4195e3f8e93e40fe9dfd72710d319dca. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:52.518975 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 70516us
W20260925 01:49:52.519621 11314 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.526274 11931 ts_tablet_manager.cc:1950] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:52.527372 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 167) took 2893 ms. Trace:
I20260925 01:49:52.527756 11931 rpcz_store.cc:276] 0925 01:49:49.634392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.634577 (+ 185us) service_pool.cc:224] Handling call
0925 01:49:52.318771 (+2684194us) ts_tablet_manager.cc:1151] Deleting tablet ea0fa393abfe4c5cb5a7f821ffdfaea7
0925 01:49:52.318782 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.381799 (+ 63017us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.512880 (+131081us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.527323 (+ 14443us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2683929}
I20260925 01:49:52.528339 11931 tablet_replica.cc:333] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:52.528766 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 (table default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a]) successfully deleted
I20260925 01:49:52.529721 11931 raft_consensus.cc:2243] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.529968 11931 raft_consensus.cc:2272] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.530872 11931 ts_tablet_manager.cc:1916] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.547405 11754 tablet_bootstrap.cc:492] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:52.547690 11754 ts_tablet_manager.cc:1403] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.276s user 0.013s sys 0.013s
I20260925 01:49:52.553609 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_63e88824670a483ca885e3276b461039"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:52.553623 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0f46031226094ac9a29b4b94c3713863"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.554775 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f46031226094ac9a29b4b94c3713863 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.555555 11754 raft_consensus.cc:359] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.555824 11754 raft_consensus.cc:385] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.556003 11754 raft_consensus.cc:740] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:52.556671 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63e88824670a483ca885e3276b461039 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.559810 12080 leader_election.cc:290] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:52.567431 11754 consensus_queue.cc:260] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.575136 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e28aeabdf724784b8ed27535ea0701b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.576088 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40083a885974e3595ec2fb5b16d4a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.576417 11754 ts_tablet_manager.cc:1434] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.029s user 0.002s sys 0.002s
W20260925 01:49:52.577764 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0157a45817246cfaa0b016afdbd59cb consensus state has no leader
I20260925 01:49:52.578353 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e707fcfa3d654b4ba15af22016782fb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.579110 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e707fcfa3d654b4ba15af22016782fb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.580237 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8055cc9b06045449e6133298c8074e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.581070 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5ee00c6a9b644c778e571ff1952327d1" } modify_external_catalogs: true
I20260925 01:49:52.581291 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5ee00c6a9b644c778e571ff1952327d1" } modify_external_catalogs: true
W20260925 01:49:52.581986 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7da55c488da540048a94324fa347c1ef consensus state has no leader
I20260925 01:49:52.582079 11754 tablet_bootstrap.cc:492] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:52.586401 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7347b31f782c4508b004c7523dc11dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.587141 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 8a00b69e42e1465981d6c3eec217393f (DEFAULT_TABLE table=default.Table_1c719484abbc48d985408ab5f7a3e42c [id=ce0e7e5581b649feab00f639935dba9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:52.587384 12263 raft_consensus.cc:493] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.587625 12263 raft_consensus.cc:515] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.588580 12263 leader_election.cc:290] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:49:52.590818 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c4f1e725fe84552943563aa95687842 consensus state has no leader
I20260925 01:49:52.591595 11754 tablet_bootstrap.cc:654] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:52.599038 11931 ts_tablet_manager.cc:1929] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:52.599303 11931 log.cc:1199] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/1396d679e5824c469490170d257f6a9b
I20260925 01:49:52.599936 11931 ts_tablet_manager.cc:1950] T 1396d679e5824c469490170d257f6a9b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:52.600890 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 168) took 2937 ms. Trace:
I20260925 01:49:52.601547 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a00b69e42e1465981d6c3eec217393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:52.601190 11931 rpcz_store.cc:276] 0925 01:49:49.663049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.666173 (+ 3124us) service_pool.cc:224] Handling call
0925 01:49:52.528271 (+2862098us) ts_tablet_manager.cc:1151] Deleting tablet 1396d679e5824c469490170d257f6a9b
0925 01:49:52.528281 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.542909 (+ 14628us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.598934 (+ 56025us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.600836 (+ 1902us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2861410}
I20260925 01:49:52.612324 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 1396d679e5824c469490170d257f6a9b (table default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951]) successfully deleted
I20260925 01:49:52.614282 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 170) took 2794 ms. Trace:
I20260925 01:49:52.615772 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 226498ea628a475d8fcab28a6598a819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.617241 11931 rpcz_store.cc:276] 0925 01:49:49.819827 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.820168 (+ 341us) service_pool.cc:224] Handling call
0925 01:49:52.613904 (+2793736us) ts_tablet_manager.cc:1151] Deleting tablet a9068770de0b473488bd8ea4752fb15d
0925 01:49:52.613924 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.614109 (+ 185us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2791149}
W20260925 01:49:52.618105 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a9068770de0b473488bd8ea4752fb15d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9068770de0b473488bd8ea4752fb15d already in progress: creating tablet
I20260925 01:49:52.623755 11931 tablet_replica.cc:333] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:52.626492 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 7347b31f782c4508b004c7523dc11dbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.626945 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 818a792969a245f5b0fe5f80128206ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.619953 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 67921f86c4f6422e97d7f306262569f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.627663 11931 raft_consensus.cc:2243] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.627985 11931 raft_consensus.cc:2272] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.631448 11931 ts_tablet_manager.cc:1916] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.670132 11946 ts_tablet_manager.cc:1929] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:52.671998 11953 ts_tablet_manager.cc:1929] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:52.674005 11946 log.cc:1199] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a9e1f114c2a749d4af6a366c044f5ea5
I20260925 01:49:52.674856 11946 ts_tablet_manager.cc:1950] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:52.675998 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 32) took 6241 ms. Trace:
I20260925 01:49:52.676208 11946 rpcz_store.cc:276] 0925 01:49:46.434455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.437009 (+ 2554us) service_pool.cc:224] Handling call
0925 01:49:52.157211 (+5720202us) ts_tablet_manager.cc:1151] Deleting tablet a9e1f114c2a749d4af6a366c044f5ea5
0925 01:49:52.157223 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.536172 (+378949us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.653091 (+116919us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.675469 (+ 22378us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5719964}
I20260925 01:49:52.677129 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 33) took 6239 ms. Trace:
I20260925 01:49:52.677321 11946 rpcz_store.cc:276] 0925 01:49:46.437461 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.438661 (+ 1200us) service_pool.cc:224] Handling call
0925 01:49:52.676811 (+6238150us) ts_tablet_manager.cc:1151] Deleting tablet bb98d5a38f43450c80d057d9eb2f92d1
0925 01:49:52.676824 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.676981 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6237902}
I20260925 01:49:52.677815 11946 tablet_replica.cc:333] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:52.681775 11931 ts_tablet_manager.cc:1929] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:52.681939 11931 log.cc:1199] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c3289c6dc8e84a358f877a197412d901
I20260925 01:49:52.691840 11931 ts_tablet_manager.cc:1950] T c3289c6dc8e84a358f877a197412d901 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:52.692836 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 176) took 2846 ms. Trace:
I20260925 01:49:52.692976 11931 rpcz_store.cc:276] 0925 01:49:49.845927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.846002 (+ 75us) service_pool.cc:224] Handling call
0925 01:49:52.623644 (+2777642us) ts_tablet_manager.cc:1151] Deleting tablet c3289c6dc8e84a358f877a197412d901
0925 01:49:52.623659 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.667781 (+ 44122us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.681660 (+ 13879us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.692796 (+ 11136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2776776}
I20260925 01:49:52.693617 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c3289c6dc8e84a358f877a197412d901 (table default.Table_cd9ac2e25d7147f7907421d1e9590f4d [id=5af8648813b343d1885f0e3d4b587ec7]) successfully deleted
I20260925 01:49:52.707283 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 175) took 2861 ms. Trace:
I20260925 01:49:52.707590 11931 rpcz_store.cc:276] 0925 01:49:49.845061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.845167 (+ 106us) service_pool.cc:224] Handling call
0925 01:49:52.705858 (+2860691us) ts_tablet_manager.cc:1151] Deleting tablet c7944aa1ac8f4c5d8ea3aa2acae41257
0925 01:49:52.705876 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.706043 (+ 167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2858901}
W20260925 01:49:52.708499 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7944aa1ac8f4c5d8ea3aa2acae41257 already in progress: creating tablet
I20260925 01:49:52.709228 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 177) took 2598 ms. Trace:
I20260925 01:49:52.709527 11931 rpcz_store.cc:276] 0925 01:49:50.110887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.112217 (+ 1330us) service_pool.cc:224] Handling call
0925 01:49:52.709005 (+2596788us) ts_tablet_manager.cc:1151] Deleting tablet 2e96576354fe46bf9bfcde18f0a53390
0925 01:49:52.709023 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.709179 (+ 156us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2596401}
W20260925 01:49:52.710865 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2e96576354fe46bf9bfcde18f0a53390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e96576354fe46bf9bfcde18f0a53390 already in progress: creating tablet
I20260925 01:49:52.711483 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 178) took 2600 ms. Trace:
I20260925 01:49:52.711683 11931 rpcz_store.cc:276] 0925 01:49:50.111080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.112640 (+ 1560us) service_pool.cc:224] Handling call
0925 01:49:52.711293 (+2598653us) ts_tablet_manager.cc:1151] Deleting tablet 85d859207bbc4aefb26c726dce404c44
0925 01:49:52.711309 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.711440 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2598344}
I20260925 01:49:52.621742 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afcf8f6d0e24472a3190059df032698 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.690322 11755 tablet_bootstrap.cc:492] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:52.712273 11755 ts_tablet_manager.cc:1403] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.324s user 0.013s sys 0.028s
W20260925 01:49:52.712332 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 85d859207bbc4aefb26c726dce404c44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85d859207bbc4aefb26c726dce404c44 already in progress: creating tablet
I20260925 01:49:52.712690 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 180) took 2457 ms. Trace:
I20260925 01:49:52.712807 11931 rpcz_store.cc:276] 0925 01:49:50.254878 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.255034 (+ 156us) service_pool.cc:224] Handling call
0925 01:49:52.712579 (+2457545us) ts_tablet_manager.cc:1151] Deleting tablet 8d208d580a2c4c27bd614ccc88088384
0925 01:49:52.712589 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.712655 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2457279}
I20260925 01:49:52.713238 11753 tablet_bootstrap.cc:492] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:49:52.713245 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8d208d580a2c4c27bd614ccc88088384 because the tablet was not found. No further retry: Not found: Tablet not found: 8d208d580a2c4c27bd614ccc88088384
I20260925 01:49:52.713421 11753 ts_tablet_manager.cc:1403] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.351s user 0.001s sys 0.005s
I20260925 01:49:52.713281 11755 raft_consensus.cc:359] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.713534 11931 tablet_replica.cc:333] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:52.713519 11755 raft_consensus.cc:385] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.713615 11755 raft_consensus.cc:740] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.713758 11931 raft_consensus.cc:2243] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.713959 11931 raft_consensus.cc:2272] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.713887 11755 consensus_queue.cc:260] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.714596 11755 ts_tablet_manager.cc:1434] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:52.714934 11755 tablet_bootstrap.cc:492] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:52.716866 11755 tablet_bootstrap.cc:654] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:52.698719 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccffbe61eea34333abdc6da94612c0f6" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:52.699393 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 178815us
I20260925 01:49:52.699574 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eb584e929c46f891d28ad01e6d78ae" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.743110 11931 ts_tablet_manager.cc:1916] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.743707 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a9e1f114c2a749d4af6a366c044f5ea5 (table default.Table_43fcb0af03694aafb7d0f246fb1b2815 [id=3dd1eb1f66404d10a4398f52c951bf72]) successfully deleted
W20260925 01:49:52.744220 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bb98d5a38f43450c80d057d9eb2f92d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb98d5a38f43450c80d057d9eb2f92d1 already in progress: creating tablet
I20260925 01:49:52.742522 11753 raft_consensus.cc:359] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:52.747807 11753 raft_consensus.cc:385] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.747979 11753 raft_consensus.cc:740] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:49:52.757546 11665 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet be89c0911dfa4b9d83d6bd88755be2b2 (table default.Table_26432ca1da60402cab9f0d15c955ee62 [id=653678819a1849b2a923a6793976ae8c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet be89c0911dfa4b9d83d6bd88755be2b2 consensus state has no leader
I20260925 01:49:52.759100 11755 tablet_bootstrap.cc:492] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:52.759457 11755 ts_tablet_manager.cc:1403] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.000s
I20260925 01:49:52.760864 11755 raft_consensus.cc:359] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.761351 11755 raft_consensus.cc:385] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.761502 11755 raft_consensus.cc:740] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.761847 11755 consensus_queue.cc:260] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.763926 11753 consensus_queue.cc:260] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:52.766357 11754 tablet_bootstrap.cc:492] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:52.769650 11755 ts_tablet_manager.cc:1434] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260925 01:49:52.771226 11754 ts_tablet_manager.cc:1403] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.189s user 0.010s sys 0.014s
I20260925 01:49:52.773675 11754 raft_consensus.cc:359] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.774247 12352 raft_consensus.cc:493] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.774509 12352 raft_consensus.cc:515] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.775600 12352 leader_election.cc:290] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:52.779047 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:52.785413 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.785557 11946 raft_consensus.cc:2243] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.785702 11376 raft_consensus.cc:2468] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:52.785784 11946 raft_consensus.cc:2272] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.786856 11946 ts_tablet_manager.cc:1916] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.792626 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.793062 11379 raft_consensus.cc:2393] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:52.794986 12364 raft_consensus.cc:493] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:52.795384 12364 raft_consensus.cc:515] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.797137 12364 leader_election.cc:290] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:52.802834 11456 leader_election.cc:343] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b0ad8ca37e3c49a4a03fc3460bf0bc5b
W20260925 01:49:52.803468 11456 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b05053f5646f4748a99647b7dbfae686
I20260925 01:49:52.808379 11953 log.cc:1199] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c3289c6dc8e84a358f877a197412d901
I20260925 01:49:52.809855 11953 ts_tablet_manager.cc:1950] T c3289c6dc8e84a358f877a197412d901 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:52.810714 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 41) took 6322 ms. Trace:
I20260925 01:49:52.811012 11953 rpcz_store.cc:276] 0925 01:49:46.488268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.489068 (+ 800us) service_pool.cc:224] Handling call
0925 01:49:52.477693 (+5988625us) ts_tablet_manager.cc:1151] Deleting tablet c3289c6dc8e84a358f877a197412d901
0925 01:49:52.477709 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.548750 (+ 71041us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.671907 (+123157us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.810630 (+138723us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5970471}
I20260925 01:49:52.811859 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c3289c6dc8e84a358f877a197412d901 (table default.Table_cd9ac2e25d7147f7907421d1e9590f4d [id=5af8648813b343d1885f0e3d4b587ec7]) successfully deleted
W20260925 01:49:52.790812 11177 leader_election.cc:343] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.813021 11754 raft_consensus.cc:385] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.813174 11754 raft_consensus.cc:740] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:52.813527 11177 leader_election.cc:343] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.811877 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa7a3941254478c800f9e366e3f7b06" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:52.812104 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee95aba7a8f4d8db4ed0b8a862dab63" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:52.813611 11754 consensus_queue.cc:260] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.814005 11239 raft_consensus.cc:2468] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:52.814638 11754 ts_tablet_manager.cc:1434] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260925 01:49:52.816079 11754 tablet_bootstrap.cc:492] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:52.819145 11754 tablet_bootstrap.cc:654] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:52.830534 11754 tablet_bootstrap.cc:492] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:52.831775 11754 ts_tablet_manager.cc:1403] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.003s
I20260925 01:49:52.833856 11754 raft_consensus.cc:359] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:52.836058 11754 raft_consensus.cc:385] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.836506 11754 raft_consensus.cc:740] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.837288 11754 consensus_queue.cc:260] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:52.838591 11755 tablet_bootstrap.cc:492] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:52.845867 11754 ts_tablet_manager.cc:1434] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260925 01:49:52.847272 11754 tablet_bootstrap.cc:492] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:52.850996 11931 ts_tablet_manager.cc:1929] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:52.863268 11456 leader_election.cc:304] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:52.863821 12364 raft_consensus.cc:2804] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:52.862435 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 50) took 6239 ms. Trace:
I20260925 01:49:52.866140 11931 log.cc:1199] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/e7623999b3c04ca69672a1e43fa6921f
I20260925 01:49:52.868952 11931 ts_tablet_manager.cc:1950] T e7623999b3c04ca69672a1e43fa6921f P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:52.869724 11953 rpcz_store.cc:276] 0925 01:49:46.617984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.618093 (+ 109us) service_pool.cc:224] Handling call
0925 01:49:52.855467 (+6237374us) ts_tablet_manager.cc:1151] Deleting tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c
0925 01:49:52.855700 (+ 233us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.857621 (+ 1921us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6236778}
I20260925 01:49:52.871295 11946 ts_tablet_manager.cc:1929] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:52.871518 11946 log.cc:1199] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b0ad8ca37e3c49a4a03fc3460bf0bc5b
W20260925 01:49:52.872192 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 48041us
I20260925 01:49:52.872653 12364 raft_consensus.cc:493] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:52.872784 12364 raft_consensus.cc:3060] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:52.873957 11946 ts_tablet_manager.cc:1950] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:52.878242 11455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260925 01:49:52.879715 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccffbe61eea34333abdc6da94612c0f6" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:52.880403 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eb584e929c46f891d28ad01e6d78ae" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:52.881891 11754 tablet_bootstrap.cc:654] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:52.883481 11176 leader_election.cc:343] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.883723 11176 leader_election.cc:304] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:49:52.884402 11176 leader_election.cc:343] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:52.884624 11176 leader_election.cc:304] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:52.885676 12374 raft_consensus.cc:2749] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:52.885958 12374 raft_consensus.cc:2749] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:52.890523 11177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 44437.2us
I20260925 01:49:52.891575 12371 tablet.cc:1751] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:52.893725 12364 raft_consensus.cc:515] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.895639 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 34) took 6456 ms. Trace:
I20260925 01:49:52.895793 11946 rpcz_store.cc:276] 0925 01:49:46.439126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.441785 (+ 2659us) service_pool.cc:224] Handling call
0925 01:49:52.677713 (+6235928us) ts_tablet_manager.cc:1151] Deleting tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b
0925 01:49:52.677725 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.791823 (+114098us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.860636 (+ 68813us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.895584 (+ 34948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106794,"tablet-delete.queue_time_us":6235689}
I20260925 01:49:52.896263 11946 tablet_replica.cc:333] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:52.896593 11946 raft_consensus.cc:2243] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:52.896993 11946 raft_consensus.cc:2272] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.898260 11946 ts_tablet_manager.cc:1916] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.898793 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b (table default.Table_b693b8f3dca9446f917874b3d6f6d0ca [id=8dcfe1cef923411faea69f4f694a51e6]) successfully deleted
I20260925 01:49:52.903369 12364 leader_election.cc:290] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:52.906610 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c already in progress: creating tablet
I20260925 01:49:52.912031 11953 tablet_replica.cc:333] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:52.912418 11953 raft_consensus.cc:2243] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.912732 11953 raft_consensus.cc:2272] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.913517 11953 ts_tablet_manager.cc:1916] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.924943 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05053f5646f4748a99647b7dbfae686" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.925247 11376 raft_consensus.cc:2468] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:52.926947 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee95aba7a8f4d8db4ed0b8a862dab63" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.927186 11376 raft_consensus.cc:2468] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:52.928926 11753 ts_tablet_manager.cc:1434] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.215s user 0.018s sys 0.034s
I20260925 01:49:52.932566 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee95aba7a8f4d8db4ed0b8a862dab63" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:52.932852 11238 raft_consensus.cc:3060] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:52.933039 11456 consensus_peers.cc:597] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e7623999b3c04ca69672a1e43fa6921f. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:52.933174 11753 tablet_bootstrap.cc:492] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:52.933404 11456 consensus_peers.cc:597] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1396d679e5824c469490170d257f6a9b. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:52.936959 11238 raft_consensus.cc:2468] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:52.937189 11753 tablet_bootstrap.cc:654] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:52.937912 11456 leader_election.cc:304] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:52.938686 12366 raft_consensus.cc:2804] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:52.938736 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 181) took 2661 ms. Trace:
I20260925 01:49:52.938951 12366 raft_consensus.cc:697] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:52.938899 11931 rpcz_store.cc:276] 0925 01:49:50.277471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.277678 (+ 207us) service_pool.cc:224] Handling call
0925 01:49:52.713470 (+2435792us) ts_tablet_manager.cc:1151] Deleting tablet e7623999b3c04ca69672a1e43fa6921f
0925 01:49:52.713479 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.785331 (+ 71852us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.850905 (+ 65574us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.938580 (+ 87675us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2435444}
I20260925 01:49:52.939459 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 182) took 2539 ms. Trace:
I20260925 01:49:52.939616 11931 rpcz_store.cc:276] 0925 01:49:50.399717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.399786 (+ 69us) service_pool.cc:224] Handling call
0925 01:49:52.939206 (+2539420us) ts_tablet_manager.cc:1151] Deleting tablet 73d9a26bbfd74a30a2ae0a61aacca4d1
0925 01:49:52.939216 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.939337 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2539171}
I20260925 01:49:52.939630 12366 consensus_queue.cc:237] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.940033 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 183) took 2540 ms. Trace:
I20260925 01:49:52.940128 11931 rpcz_store.cc:276] 0925 01:49:50.399921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.400072 (+ 151us) service_pool.cc:224] Handling call
0925 01:49:52.939848 (+2539776us) ts_tablet_manager.cc:1151] Deleting tablet 5b11c6526dbc4177b3a54b3c952bbd31
0925 01:49:52.939856 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.939980 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2539597}
I20260925 01:49:52.940629 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 185) took 2532 ms. Trace:
I20260925 01:49:52.940719 11931 rpcz_store.cc:276] 0925 01:49:50.407909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.419696 (+ 11787us) service_pool.cc:224] Handling call
0925 01:49:52.940433 (+2520737us) ts_tablet_manager.cc:1151] Deleting tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56
0925 01:49:52.940447 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.940567 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2520470}
I20260925 01:49:52.941090 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 187) took 2504 ms. Trace:
I20260925 01:49:52.941205 11931 rpcz_store.cc:276] 0925 01:49:50.436666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.436994 (+ 328us) service_pool.cc:224] Handling call
0925 01:49:52.940939 (+2503945us) ts_tablet_manager.cc:1151] Deleting tablet 784de8c6e6e1434a91106dd19cd9262a
0925 01:49:52.940950 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.941036 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2499865}
I20260925 01:49:52.941594 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 186) took 2517 ms. Trace:
I20260925 01:49:52.941687 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet e7623999b3c04ca69672a1e43fa6921f (table default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327]) successfully deleted
I20260925 01:49:52.941737 11931 rpcz_store.cc:276] 0925 01:49:50.423789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.423888 (+ 99us) service_pool.cc:224] Handling call
0925 01:49:52.941418 (+2517530us) ts_tablet_manager.cc:1151] Deleting tablet a3358b78a1da48388d1f72536b1ed0a2
0925 01:49:52.941426 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.941503 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2499848}
W20260925 01:49:52.942094 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 already in progress: creating tablet
W20260925 01:49:52.942382 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5b11c6526dbc4177b3a54b3c952bbd31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b11c6526dbc4177b3a54b3c952bbd31 already in progress: creating tablet
W20260925 01:49:52.942682 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 already in progress: creating tablet
I20260925 01:49:52.877601 11755 tablet_bootstrap.cc:654] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:52.943413 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a3358b78a1da48388d1f72536b1ed0a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3358b78a1da48388d1f72536b1ed0a2 already in progress: creating tablet
I20260925 01:49:52.949143 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa7a3941254478c800f9e366e3f7b06" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:52.949617 11380 raft_consensus.cc:2393] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:52.949721 12377 tablet.cc:1751] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:52.951411 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ee95aba7a8f4d8db4ed0b8a862dab63" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:52.951752 11380 raft_consensus.cc:3060] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:52.954476 12376 tablet.cc:1751] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:52.955611 11754 tablet_bootstrap.cc:492] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:52.959615 11380 raft_consensus.cc:2468] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:52.961627 11518 raft_consensus.cc:3060] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:52.962376 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 205128us
I20260925 01:49:52.965147 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5e7e88dc65b94eeeb4237ab59d5977e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:52.965377 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_aef2ce9ee7344e2ab73d9f0fb5c8c21b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:52.965827 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e7e88dc65b94eeeb4237ab59d5977e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.965978 11754 ts_tablet_manager.cc:1403] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.109s user 0.006s sys 0.020s
I20260925 01:49:52.966957 11754 raft_consensus.cc:359] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.967167 11754 raft_consensus.cc:385] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.967231 11754 raft_consensus.cc:740] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.967278 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b187688e2bdb475496c7d6278e6a6754" } new_table_name: "default.Table_7eb435d3e2ec4209bdd1f04597fcadd8" modify_external_catalogs: true
I20260925 01:49:52.967492 11754 consensus_queue.cc:260] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.968009 11754 ts_tablet_manager.cc:1434] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:52.968564 11931 tablet_replica.cc:333] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:52.968871 11931 raft_consensus.cc:2243] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:52.969051 11931 raft_consensus.cc:2272] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:52.968938 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e2abaeb692e1458dacd8e8bab6cf101f" } modify_external_catalogs: true
I20260925 01:49:52.969328 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e2abaeb692e1458dacd8e8bab6cf101f" } modify_external_catalogs: true
I20260925 01:49:52.970425 11754 tablet_bootstrap.cc:492] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:52.972141 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_09e8e9221d6b40e4ad019a42371a5e5f" } new_table_name: "default.Table_99d13693bec4412ea02371deaf0384b0" modify_external_catalogs: true
I20260925 01:49:52.973246 11931 ts_tablet_manager.cc:1916] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:52.973479 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_77d531160dc245eaaac97f131d587441" } modify_external_catalogs: true
I20260925 01:49:52.973672 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_77d531160dc245eaaac97f131d587441" } modify_external_catalogs: true
I20260925 01:49:52.974756 11754 tablet_bootstrap.cc:654] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:52.976248 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aef2ce9ee7344e2ab73d9f0fb5c8c21b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:52.980589 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_17e3438d1c3f4f16b6d2239eda8e5844" } modify_external_catalogs: true
I20260925 01:49:52.980906 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_17e3438d1c3f4f16b6d2239eda8e5844" } modify_external_catalogs: true
I20260925 01:49:52.982016 11754 tablet_bootstrap.cc:492] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:52.982227 11754 ts_tablet_manager.cc:1403] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.001s
I20260925 01:49:52.983232 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5021ab79dc4eaf9ed612f7125a6dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:52.988210 11754 raft_consensus.cc:359] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.988629 11754 raft_consensus.cc:385] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:52.988795 11754 raft_consensus.cc:740] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:52.989207 11754 consensus_queue.cc:260] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:52.990017 11754 ts_tablet_manager.cc:1434] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260925 01:49:52.990504 11754 tablet_bootstrap.cc:492] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:52.992872 11946 ts_tablet_manager.cc:1929] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:52.993249 11946 log.cc:1199] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/2d76845ed48045b7b3632179be022e5f
I20260925 01:49:52.994041 11946 ts_tablet_manager.cc:1950] T 2d76845ed48045b7b3632179be022e5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:52.996613 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 35) took 6554 ms. Trace:
I20260925 01:49:52.997257 11946 rpcz_store.cc:276] 0925 01:49:46.442374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.442733 (+ 359us) service_pool.cc:224] Handling call
0925 01:49:52.896184 (+6453451us) ts_tablet_manager.cc:1151] Deleting tablet 2d76845ed48045b7b3632179be022e5f
0925 01:49:52.896198 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.915573 (+ 19375us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.985765 (+ 70192us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:52.996540 (+ 10775us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6453231}
I20260925 01:49:52.998430 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 2d76845ed48045b7b3632179be022e5f (table default.Table_7e3942ff37734d5aa89cfb724ea34ca7 [id=c213f0abfafd451b99a639859fc4bb18]) successfully deleted
I20260925 01:49:52.999112 11946 tablet_replica.cc:333] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:52.999413 11946 raft_consensus.cc:2243] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:52.999895 11946 raft_consensus.cc:2272] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.000572 11946 ts_tablet_manager.cc:1916] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.003756 11754 tablet_bootstrap.cc:654] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:53.006990 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0c01195f07b84b359a974fab5ed52582 consensus state has no leader
I20260925 01:49:53.009003 11753 tablet_bootstrap.cc:492] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.009469 11753 ts_tablet_manager.cc:1403] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.077s user 0.000s sys 0.012s
I20260925 01:49:53.011322 11753 raft_consensus.cc:359] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.011636 11753 raft_consensus.cc:385] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.011875 11753 raft_consensus.cc:740] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.011847 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b2c0a186ead548bca5ccee40cb8df40f" } modify_external_catalogs: true
I20260925 01:49:53.012245 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b2c0a186ead548bca5ccee40cb8df40f" } modify_external_catalogs: true
I20260925 01:49:53.012298 11753 consensus_queue.cc:260] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.013420 11753 ts_tablet_manager.cc:1434] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:49:53.014081 11753 tablet_bootstrap.cc:492] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.014945 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5021ab79dc4eaf9ed612f7125a6dca" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:53.015219 11238 raft_consensus.cc:3060] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.018023 12080 raft_consensus.cc:493] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.018214 12080 raft_consensus.cc:515] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.018872 12080 leader_election.cc:290] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.019459 11238 raft_consensus.cc:2468] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
W20260925 01:49:53.027755 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60411b0feafe4fef9c4fdc364163f1df consensus state has no leader
I20260925 01:49:53.028321 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ee607bb78c5e460d97313b3352e1e93f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.028456 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ca11a48fdf91477da5a1262664f1bb58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.036031 11946 ts_tablet_manager.cc:1929] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.036197 11946 log.cc:1199] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c96165d1a85d4ee99748563078ae2a3e
I20260925 01:49:53.036700 11946 ts_tablet_manager.cc:1950] T c96165d1a85d4ee99748563078ae2a3e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.037613 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 36) took 6594 ms. Trace:
I20260925 01:49:53.037736 11946 rpcz_store.cc:276] 0925 01:49:46.443130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.447984 (+ 4854us) service_pool.cc:224] Handling call
0925 01:49:52.998936 (+6550952us) ts_tablet_manager.cc:1151] Deleting tablet c96165d1a85d4ee99748563078ae2a3e
0925 01:49:52.998945 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.032220 (+ 33275us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.035936 (+ 3716us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.037567 (+ 1631us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6550728}
I20260925 01:49:53.038244 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c96165d1a85d4ee99748563078ae2a3e (table default.Table_9ef5c3e705a5472e95916b5b9e5a6700 [id=ca8c84b0f3fd4aac9fb747b21cfec090]) successfully deleted
I20260925 01:49:53.039186 11753 tablet_bootstrap.cc:654] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:53.044386 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee607bb78c5e460d97313b3352e1e93f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:53.047948 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca11a48fdf91477da5a1262664f1bb58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.060725 11946 tablet_replica.cc:333] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.061966 12080 raft_consensus.cc:493] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.062228 12080 raft_consensus.cc:515] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.062909 12080 leader_election.cc:290] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.064368 11946 raft_consensus.cc:2243] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.064774 11946 raft_consensus.cc:2272] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.065709 11946 ts_tablet_manager.cc:1916] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.077612 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8f39791058ce4e92a65ff7c9e0fad5c7" } new_table_name: "default.Table_76c89167538945999999e21b0ddaba59" modify_external_catalogs: true
I20260925 01:49:53.083693 11676 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_acb7d558d3a9463e9cef61036b44d1c1 [id=0d689fa6870547f3a57c6b6149b94754] alter complete (version 1)
I20260925 01:49:53.085078 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9f6df51cac0f4c3b9111cab561c1ecc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.085779 11946 ts_tablet_manager.cc:1929] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.086199 11946 log.cc:1199] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a3ec6c34d22241e5bda3ec6665a47fc7
I20260925 01:49:53.086548 12080 raft_consensus.cc:493] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:53.086825 12080 raft_consensus.cc:515] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.087029 11946 ts_tablet_manager.cc:1950] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.087657 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 37) took 6639 ms. Trace:
I20260925 01:49:53.087837 12080 leader_election.cc:290] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.087791 11946 rpcz_store.cc:276] 0925 01:49:46.448489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.449259 (+ 770us) service_pool.cc:224] Handling call
0925 01:49:53.060636 (+6611377us) ts_tablet_manager.cc:1151] Deleting tablet a3ec6c34d22241e5bda3ec6665a47fc7
0925 01:49:53.060650 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.073594 (+ 12944us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.081964 (+ 8370us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.087599 (+ 5635us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6611127}
I20260925 01:49:53.090662 11946 tablet_replica.cc:333] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.090214 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a3ec6c34d22241e5bda3ec6665a47fc7 (table default.Table_854ab4951a1b404a99eb1caa32ea46e0 [id=2df4a02c11a14e6584003a727651841e]) successfully deleted
I20260925 01:49:53.091284 11946 raft_consensus.cc:2243] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.091879 11946 pending_rounds.cc:70] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
W20260925 01:49:53.092037 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f6df51cac0f4c3b9111cab561c1ecc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.092278 11946 pending_rounds.cc:77] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072855441952768 op_type: NO_OP noop_request { }
I20260925 01:49:53.092792 11946 raft_consensus.cc:2889] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:53.093322 11946 raft_consensus.cc:2272] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.095037 11946 ts_tablet_manager.cc:1916] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.028475 11754 tablet_bootstrap.cc:492] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.102480 11754 ts_tablet_manager.cc:1403] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.112s user 0.005s sys 0.006s
I20260925 01:49:53.103789 11754 raft_consensus.cc:359] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.104125 11754 raft_consensus.cc:385] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.104281 11754 raft_consensus.cc:740] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.104705 11754 consensus_queue.cc:260] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.105269 12364 raft_consensus.cc:493] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.105499 11754 ts_tablet_manager.cc:1434] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260925 01:49:53.105520 12364 raft_consensus.cc:515] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.029505 11931 ts_tablet_manager.cc:1929] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.106381 11931 log.cc:1199] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/2d76845ed48045b7b3632179be022e5f
I20260925 01:49:53.106494 12364 leader_election.cc:290] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:53.107101 11931 ts_tablet_manager.cc:1950] T 2d76845ed48045b7b3632179be022e5f P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.108146 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 184) took 2708 ms. Trace:
I20260925 01:49:53.108210 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82ac4f3b4d48fbbb33c21f5630d749" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:53.108441 11931 rpcz_store.cc:276] 0925 01:49:50.400060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.423240 (+ 23180us) service_pool.cc:224] Handling call
0925 01:49:52.941958 (+2518718us) ts_tablet_manager.cc:1151] Deleting tablet 2d76845ed48045b7b3632179be022e5f
0925 01:49:52.941966 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.022987 (+ 81021us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.029351 (+ 6364us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.108098 (+ 78747us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2499922}
W20260925 01:49:53.109176 11456 leader_election.cc:343] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.109298 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 189) took 2590 ms. Trace:
I20260925 01:49:53.109524 11931 rpcz_store.cc:276] 0925 01:49:50.518371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.518751 (+ 380us) service_pool.cc:224] Handling call
0925 01:49:53.108950 (+2590199us) ts_tablet_manager.cc:1151] Deleting tablet 257e6f224f99427eb68fd61fa1aadae0
0925 01:49:53.108969 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.109216 (+ 247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2589751}
I20260925 01:49:53.109938 11931 tablet_replica.cc:333] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.110929 11754 tablet_bootstrap.cc:492] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.113270 11754 tablet_bootstrap.cc:654] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.113941 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 2d76845ed48045b7b3632179be022e5f (table default.Table_7e3942ff37734d5aa89cfb724ea34ca7 [id=c213f0abfafd451b99a639859fc4bb18]) successfully deleted
W20260925 01:49:53.114552 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 257e6f224f99427eb68fd61fa1aadae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 257e6f224f99427eb68fd61fa1aadae0 already in progress: creating tablet
I20260925 01:49:53.114692 11931 raft_consensus.cc:2243] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.114972 11931 raft_consensus.cc:2272] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.115806 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d55100401c234d6593420fe96b17dfa6" } new_table_name: "default.Table_af127cdb830b4a768749a38a1651365c" modify_external_catalogs: true
I20260925 01:49:53.116072 11931 ts_tablet_manager.cc:1916] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:53.125135 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9513d1d55fe846f5b1a2b7d315209002 consensus state has no leader
I20260925 01:49:53.126632 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_366edf53ad054347ab1fdcaccf94d77e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.127687 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_366edf53ad054347ab1fdcaccf94d77e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.128463 11946 ts_tablet_manager.cc:1929] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.129122 11946 log.cc:1199] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c3289c6dc8e84a358f877a197412d901
I20260925 01:49:53.129808 11946 ts_tablet_manager.cc:1950] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.130861 11754 tablet_bootstrap.cc:492] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.131093 11754 ts_tablet_manager.cc:1403] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.001s
I20260925 01:49:53.131983 11754 raft_consensus.cc:359] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.132239 11754 raft_consensus.cc:385] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.132364 11754 raft_consensus.cc:740] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.132809 11754 consensus_queue.cc:260] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.134974 11931 ts_tablet_manager.cc:1929] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.135118 11931 log.cc:1199] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8dd27c6d835948ba859b4c11d8ebf783
I20260925 01:49:53.135488 11931 ts_tablet_manager.cc:1950] T 8dd27c6d835948ba859b4c11d8ebf783 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.135991 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_febb4e0759ac4d36856d1ad53244b4be" } new_table_name: "default.Table_09960c3dd1a34636a5446ca4f5d57b31" modify_external_catalogs: true
I20260925 01:49:53.136297 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 188) took 2675 ms. Trace:
I20260925 01:49:53.136423 11931 rpcz_store.cc:276] 0925 01:49:50.460349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.461135 (+ 786us) service_pool.cc:224] Handling call
0925 01:49:53.109813 (+2648678us) ts_tablet_manager.cc:1151] Deleting tablet 8dd27c6d835948ba859b4c11d8ebf783
0925 01:49:53.109823 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.126474 (+ 16651us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.134905 (+ 8431us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.136236 (+ 1331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2551708}
I20260925 01:49:53.136907 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8dd27c6d835948ba859b4c11d8ebf783 (table default.Table_7eb435d3e2ec4209bdd1f04597fcadd8 [id=e93d9881c42d4a51a90c1ffb5fe17930]) successfully deleted
I20260925 01:49:53.137650 11754 ts_tablet_manager.cc:1434] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 01:49:53.141714 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 190) took 2455 ms. Trace:
I20260925 01:49:53.143002 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 38) took 6693 ms. Trace:
I20260925 01:49:53.143810 11946 rpcz_store.cc:276] 0925 01:49:46.449736 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.449780 (+ 44us) service_pool.cc:224] Handling call
0925 01:49:53.090503 (+6640723us) ts_tablet_manager.cc:1151] Deleting tablet c3289c6dc8e84a358f877a197412d901
0925 01:49:53.090514 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.103944 (+ 13430us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.128368 (+ 24424us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.142926 (+ 14558us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6640548}
I20260925 01:49:53.144697 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c3289c6dc8e84a358f877a197412d901 (table default.Table_cd9ac2e25d7147f7907421d1e9590f4d [id=5af8648813b343d1885f0e3d4b587ec7]) successfully deleted
I20260925 01:49:53.145318 11931 rpcz_store.cc:276] 0925 01:49:50.685939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.686001 (+ 62us) service_pool.cc:224] Handling call
0925 01:49:53.141431 (+2455430us) ts_tablet_manager.cc:1151] Deleting tablet c28c9e51d80a442486b78be32c74a94f
0925 01:49:53.141443 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.141561 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2455112}
W20260925 01:49:53.146204 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c28c9e51d80a442486b78be32c74a94f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c28c9e51d80a442486b78be32c74a94f already in progress: creating tablet
I20260925 01:49:53.142194 11754 tablet_bootstrap.cc:492] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.150471 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 198) took 2311 ms. Trace:
I20260925 01:49:53.151381 11754 tablet_bootstrap.cc:654] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.150645 11931 rpcz_store.cc:276] 0925 01:49:50.838549 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.849800 (+ 11251us) service_pool.cc:224] Handling call
0925 01:49:53.150207 (+2300407us) ts_tablet_manager.cc:1151] Deleting tablet 15376374d9f2401fb9bb83d2f0acf7b3
0925 01:49:53.150224 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.150397 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2300109}
W20260925 01:49:53.153831 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 15376374d9f2401fb9bb83d2f0acf7b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15376374d9f2401fb9bb83d2f0acf7b3 already in progress: creating tablet
I20260925 01:49:53.154613 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 199) took 2303 ms. Trace:
I20260925 01:49:53.154780 11931 rpcz_store.cc:276] 0925 01:49:50.850604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.851955 (+ 1351us) service_pool.cc:224] Handling call
0925 01:49:53.154280 (+2302325us) ts_tablet_manager.cc:1151] Deleting tablet 01d50e428bfc46caa130f96ccc7e8f40
0925 01:49:53.154293 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.154471 (+ 178us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2302132}
W20260925 01:49:53.156708 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 01d50e428bfc46caa130f96ccc7e8f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d50e428bfc46caa130f96ccc7e8f40 already in progress: creating tablet
I20260925 01:49:53.157308 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 200) took 2304 ms. Trace:
I20260925 01:49:53.157475 11931 rpcz_store.cc:276] 0925 01:49:50.852324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.855813 (+ 3489us) service_pool.cc:224] Handling call
0925 01:49:53.157085 (+2301272us) ts_tablet_manager.cc:1151] Deleting tablet 06fca09010f841c5a7b58678560065f3
0925 01:49:53.157099 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.157239 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2301047}
W20260925 01:49:53.158108 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 06fca09010f841c5a7b58678560065f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06fca09010f841c5a7b58678560065f3 already in progress: creating tablet
I20260925 01:49:53.158396 11946 tablet_replica.cc:333] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.158696 11946 raft_consensus.cc:2243] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.160524 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:53.161228 11946 raft_consensus.cc:2272] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:53.161286 11680 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.195:44907 (request call id 81) took 794 ms (client timeout 1000 ms). Trace:
I20260925 01:49:53.161556 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 202) took 2261 ms. Trace:
W20260925 01:49:53.161504 11680 rpcz_store.cc:269] 0925 01:49:52.367265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.423856 (+ 56591us) service_pool.cc:224] Handling call
0925 01:49:52.438001 (+ 14145us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00007f46ca49765d 00007f46ca497753 00007f46c7014db1 00007f46cee03acd 00007f46cef8d738 00007f46c59611f6 00007f46c5960f25 00007f46c206763e 00007f46c206651e 00007f46c206c758 00007f46c206d0bf
0925 01:49:53.161186 (+723185us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":30892928}
I20260925 01:49:53.161692 11931 rpcz_store.cc:276] 0925 01:49:50.903320 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.903374 (+ 54us) service_pool.cc:224] Handling call
0925 01:49:53.161280 (+2257906us) ts_tablet_manager.cc:1151] Deleting tablet 45a794ad0d87475a88efc02f5ae080f4
0925 01:49:53.161290 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.161429 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2249601}
I20260925 01:49:53.162077 11946 ts_tablet_manager.cc:1916] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:53.162204 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 45a794ad0d87475a88efc02f5ae080f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a794ad0d87475a88efc02f5ae080f4 already in progress: creating tablet
I20260925 01:49:53.162686 11931 tablet_replica.cc:333] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.162598 11679 catalog_manager.cc:5838] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:53.162976 11931 raft_consensus.cc:2243] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.163149 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:53.163270 11931 raft_consensus.cc:2272] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.164034 11931 ts_tablet_manager.cc:1916] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.172283 12263 raft_consensus.cc:493] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.172619 12263 raft_consensus.cc:515] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.173604 12263 leader_election.cc:290] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.175654 11946 ts_tablet_manager.cc:1929] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.175652 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:53.175921 11946 log.cc:1199] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b05053f5646f4748a99647b7dbfae686
I20260925 01:49:53.176412 11946 ts_tablet_manager.cc:1950] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:53.177021 11176 leader_election.cc:343] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.177147 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 39) took 6726 ms. Trace:
I20260925 01:49:53.177311 11946 rpcz_store.cc:276] 0925 01:49:46.450224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.450271 (+ 47us) service_pool.cc:224] Handling call
0925 01:49:53.145090 (+6694819us) ts_tablet_manager.cc:1151] Deleting tablet b05053f5646f4748a99647b7dbfae686
0925 01:49:53.145100 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.166814 (+ 21714us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.174972 (+ 8158us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.177100 (+ 2128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6694593}
I20260925 01:49:53.177356 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8d514818f2024dce89bf6d1480c69b09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.177512 11754 tablet_bootstrap.cc:492] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.177907 11946 tablet_replica.cc:333] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.178238 11754 ts_tablet_manager.cc:1403] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.000s
I20260925 01:49:53.178238 11946 raft_consensus.cc:2243] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:53.178383 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d514818f2024dce89bf6d1480c69b09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.178428 11946 pending_rounds.cc:70] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:53.178548 11946 pending_rounds.cc:77] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072838966292480 op_type: NO_OP noop_request { }
I20260925 01:49:53.178792 11946 raft_consensus.cc:2889] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:53.179046 11946 raft_consensus.cc:2272] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.179788 11946 ts_tablet_manager.cc:1916] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.179679 11754 raft_consensus.cc:359] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.180039 11754 raft_consensus.cc:385] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.180173 11754 raft_consensus.cc:740] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.180960 11754 consensus_queue.cc:260] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.181087 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:53.182170 11754 ts_tablet_manager.cc:1434] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260925 01:49:53.184793 11931 ts_tablet_manager.cc:1929] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.184947 11931 log.cc:1199] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b9937c3776f549dea887ace26dae492c
I20260925 01:49:53.185541 11931 ts_tablet_manager.cc:1950] T b9937c3776f549dea887ace26dae492c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.186218 12364 raft_consensus.cc:493] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:53.186950 12364 raft_consensus.cc:515] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.188114 12364 leader_election.cc:290] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:53.189719 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d253f8b1e4ac41388a885178f2ed0f40 consensus state has no leader
I20260925 01:49:53.189920 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 203) took 2258 ms. Trace:
I20260925 01:49:53.190136 11931 rpcz_store.cc:276] 0925 01:49:50.931146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.931513 (+ 367us) service_pool.cc:224] Handling call
0925 01:49:53.162518 (+2231005us) ts_tablet_manager.cc:1151] Deleting tablet b9937c3776f549dea887ace26dae492c
0925 01:49:53.162529 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.168020 (+ 5491us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.184666 (+ 16646us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.189882 (+ 5216us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2187624}
I20260925 01:49:53.190858 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b9937c3776f549dea887ace26dae492c (table default.Table_7b5309958b834d63b67d8a48293e5edd [id=96eed11bd70c486199e13071d27865da]) successfully deleted
I20260925 01:49:53.192719 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 204) took 2216 ms. Trace:
I20260925 01:49:53.193559 11931 rpcz_store.cc:276] 0925 01:49:50.976166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.976611 (+ 445us) service_pool.cc:224] Handling call
0925 01:49:53.192478 (+2215867us) ts_tablet_manager.cc:1151] Deleting tablet 95ac080782664fca8661c188ab822e89
0925 01:49:53.192492 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.192647 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2215606}
W20260925 01:49:53.194555 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 95ac080782664fca8661c188ab822e89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95ac080782664fca8661c188ab822e89 already in progress: creating tablet
I20260925 01:49:53.195113 11931 tablet_replica.cc:333] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.195747 11931 raft_consensus.cc:2243] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:49:53.195899 11456 leader_election.cc:343] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 3da92b7f256647f19faeed66b4012438
I20260925 01:49:53.196696 11931 raft_consensus.cc:2272] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.197495 11931 ts_tablet_manager.cc:1916] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.197441 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f8b12242c3e44c009dd3fd05771e971f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.199126 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8b12242c3e44c009dd3fd05771e971f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.201543 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:53.201817 11518 raft_consensus.cc:2468] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:53.205286 11754 tablet_bootstrap.cc:492] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.208801 11754 tablet_bootstrap.cc:654] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.210862 12371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:52978 (request call id 256) took 1188 ms. Trace:
I20260925 01:49:53.214835 12371 rpcz_store.cc:276] 0925 01:49:52.022097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.022724 (+ 627us) service_pool.cc:224] Handling call
0925 01:49:53.210803 (+1188079us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:52.089984 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:52.096460 (+ 6476us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:52.096472 (+ 12us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:52.096484 (+ 12us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:52.096540 (+ 56us) alter_schema_op.cc:128] START. Timestamp: 1790300992096410
0925 01:49:52.096545 (+ 5us) op_driver.cc:348] REPLICATION: starting
0925 01:49:52.096832 (+ 287us) log.cc:844] Serialized 173 byte log entry
0925 01:49:52.814858 (+718026us) op_driver.cc:464] REPLICATION: finished
0925 01:49:52.891443 (+ 76585us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:49:52.893862 (+ 2419us) log.cc:844] Serialized 5 byte log entry
0925 01:49:53.141383 (+247521us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.205944 (+ 64561us) log.cc:844] Serialized 14 byte log entry
0925 01:49:53.210736 (+ 4792us) alter_schema_op.cc:73] Released schema lock
0925 01:49:53.210750 (+ 14us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":76475,"prepare.queue_time_us":66786,"prepare.run_cpu_time_us":8331,"prepare.run_wall_time_us":140352,"raft.queue_time_us":97,"raft.run_cpu_time_us":865,"raft.run_wall_time_us":864,"replication_time_us":718281,"thread_start_us":324192,"threads_started":3,"wal-append.queue_time_us":138406}]]}
I20260925 01:49:53.220103 11946 ts_tablet_manager.cc:1929] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.220224 11753 tablet_bootstrap.cc:492] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.226419 11753 ts_tablet_manager.cc:1403] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.212s user 0.020s sys 0.040s
I20260925 01:49:53.227583 11753 raft_consensus.cc:359] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.227913 11753 raft_consensus.cc:385] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.228041 11753 raft_consensus.cc:740] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.228413 11753 consensus_queue.cc:260] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.229182 11753 ts_tablet_manager.cc:1434] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:53.229926 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_67ce33e86d8543478a5454db8199d1ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.231901 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67ce33e86d8543478a5454db8199d1ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:53.232210 11455 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260925 01:49:53.232820 11753 tablet_bootstrap.cc:492] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.234606 11753 tablet_bootstrap.cc:654] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.220592 11754 tablet_bootstrap.cc:492] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.235785 11754 ts_tablet_manager.cc:1403] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.001s
I20260925 01:49:53.236032 11946 log.cc:1199] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/105fd502b74d442eb5d5031f56e5cb62
I20260925 01:49:53.236908 11754 raft_consensus.cc:359] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.237229 11754 raft_consensus.cc:385] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.237421 11754 raft_consensus.cc:740] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.237720 11754 consensus_queue.cc:260] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.237802 11221 tablet_service.cc:1511] Processing CreateTablet for tablet d401574e89014d2aaa5f98d0d9a2729f (DEFAULT_TABLE table=default.Table_6734b38bddb6462f81a668efbe01fad0 [id=977b69f7df2c41cab43ee3498fb261c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.238286 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d401574e89014d2aaa5f98d0d9a2729f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.238512 11754 ts_tablet_manager.cc:1434] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:53.238931 11754 tablet_bootstrap.cc:492] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.241968 11754 tablet_bootstrap.cc:654] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.222414 11931 ts_tablet_manager.cc:1929] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:53.242316 11931 log.cc:1199] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8b16a38a30ff44fb8d7eb01498f9b9c7
I20260925 01:49:53.243121 11931 ts_tablet_manager.cc:1950] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.244093 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 205) took 2244 ms. Trace:
I20260925 01:49:53.244262 11931 rpcz_store.cc:276] 0925 01:49:50.999450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.999514 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:53.194981 (+2195467us) ts_tablet_manager.cc:1151] Deleting tablet 8b16a38a30ff44fb8d7eb01498f9b9c7
0925 01:49:53.194992 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.204038 (+ 9046us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.222319 (+ 18281us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.243920 (+ 21601us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195216}
I20260925 01:49:53.245002 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 206) took 2095 ms. Trace:
I20260925 01:49:53.245150 11931 rpcz_store.cc:276] 0925 01:49:51.149066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.149130 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:53.244670 (+2095540us) ts_tablet_manager.cc:1151] Deleting tablet a07f37b8469a497ba3fe504cb21105d2
0925 01:49:53.244683 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.244857 (+ 174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2095306}
I20260925 01:49:53.245687 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 213) took 2053 ms. Trace:
I20260925 01:49:53.245838 11931 rpcz_store.cc:276] 0925 01:49:51.192112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.201613 (+ 9501us) service_pool.cc:224] Handling call
0925 01:49:53.245401 (+2043788us) ts_tablet_manager.cc:1151] Deleting tablet ae948bf42ae34a7ab72112d5f1f02585
0925 01:49:53.245424 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.245540 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2043546}
W20260925 01:49:53.246006 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a07f37b8469a497ba3fe504cb21105d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a07f37b8469a497ba3fe504cb21105d2 already in progress: creating tablet
I20260925 01:49:53.246537 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 226) took 1877 ms. Trace:
W20260925 01:49:53.246784 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ae948bf42ae34a7ab72112d5f1f02585 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae948bf42ae34a7ab72112d5f1f02585 already in progress: creating tablet
I20260925 01:49:53.246690 11931 rpcz_store.cc:276] 0925 01:49:51.369358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.369439 (+ 81us) service_pool.cc:224] Handling call
0925 01:49:53.246156 (+1876717us) ts_tablet_manager.cc:1151] Deleting tablet 927bc1194884470e9fc977ca870f1b0c
0925 01:49:53.246166 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.246394 (+ 228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1876515}
I20260925 01:49:53.247274 11931 tablet_replica.cc:333] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
W20260925 01:49:53.247489 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 927bc1194884470e9fc977ca870f1b0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 927bc1194884470e9fc977ca870f1b0c already in progress: creating tablet
I20260925 01:49:53.247550 11931 raft_consensus.cc:2243] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.247961 11931 raft_consensus.cc:2272] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.236891 11946 ts_tablet_manager.cc:1950] T 105fd502b74d442eb5d5031f56e5cb62 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.252969 12364 raft_consensus.cc:493] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.253214 12364 raft_consensus.cc:515] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.255437 11931 ts_tablet_manager.cc:1916] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.258477 12364 leader_election.cc:290] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.259413 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99913eb35197442880a27b3c288237f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:53.259989 11238 raft_consensus.cc:2468] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:53.260751 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 40) took 6810 ms. Trace:
I20260925 01:49:53.261525 11456 leader_election.cc:304] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.264719 12364 raft_consensus.cc:2804] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.264926 12364 raft_consensus.cc:493] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.265072 12364 raft_consensus.cc:3060] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.267735 11754 tablet_bootstrap.cc:492] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.276371 11497 tablet_service.cc:1511] Processing CreateTablet for tablet d401574e89014d2aaa5f98d0d9a2729f (DEFAULT_TABLE table=default.Table_6734b38bddb6462f81a668efbe01fad0 [id=977b69f7df2c41cab43ee3498fb261c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.277185 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d401574e89014d2aaa5f98d0d9a2729f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.282887 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 031687d4b26b4c7889dfbe3485c9f4c5
I20260925 01:49:53.283095 11754 ts_tablet_manager.cc:1403] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.002s
I20260925 01:49:53.284273 11754 raft_consensus.cc:359] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.284616 11754 raft_consensus.cc:385] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.284691 11754 raft_consensus.cc:740] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.284977 12263 raft_consensus.cc:493] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.285141 12263 raft_consensus.cc:515] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.285936 12263 leader_election.cc:290] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.286002 12364 raft_consensus.cc:515] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.286929 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82ac4f3b4d48fbbb33c21f5630d749" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:53.286929 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:53.287204 11518 raft_consensus.cc:2468] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:53.287765 12364 leader_election.cc:290] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.287765 11176 leader_election.cc:304] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.288091 12263 raft_consensus.cc:2804] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.288235 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.288354 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99913eb35197442880a27b3c288237f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:53.288553 11237 raft_consensus.cc:3060] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.291257 11946 rpcz_store.cc:276] 0925 01:49:46.450698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.454129 (+ 3431us) service_pool.cc:224] Handling call
0925 01:49:53.177813 (+6723684us) ts_tablet_manager.cc:1151] Deleting tablet 105fd502b74d442eb5d5031f56e5cb62
0925 01:49:53.177824 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.211348 (+ 33524us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.219992 (+ 8644us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.260702 (+ 40710us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6723475}
I20260925 01:49:53.292079 11237 raft_consensus.cc:2468] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:53.292632 11965 raft_consensus.cc:493] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.292727 11456 leader_election.cc:304] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.292985 12263 raft_consensus.cc:493] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.292930 11965 raft_consensus.cc:515] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.293135 12263 raft_consensus.cc:3060] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.293145 12364 raft_consensus.cc:2804] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:53.293395 12364 raft_consensus.cc:697] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:53.293723 12364 consensus_queue.cc:237] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.293876 11965 leader_election.cc:290] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:53.295015 11497 tablet_service.cc:1511] Processing CreateTablet for tablet bfc152df745b46fb84aec1c9fa017ba5 (DEFAULT_TABLE table=default.Table_45e7213362f74039a9576e25db157d24 [id=7911f341edd649f588389f6e9b530665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.296051 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc152df745b46fb84aec1c9fa017ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.296794 12263 raft_consensus.cc:515] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.296244 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 41) took 6841 ms. Trace:
I20260925 01:49:53.297132 11946 rpcz_store.cc:276] 0925 01:49:46.454573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.454722 (+ 149us) service_pool.cc:224] Handling call
0925 01:49:53.295383 (+6840661us) ts_tablet_manager.cc:1151] Deleting tablet ba19192502634f8599407d923114a627
0925 01:49:53.295394 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.296210 (+ 816us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6840444}
I20260925 01:49:53.297619 12263 leader_election.cc:290] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.297279 12288 raft_consensus.cc:493] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.298002 12288 raft_consensus.cc:515] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.298728 12288 leader_election.cc:290] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.298966 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82ac4f3b4d48fbbb33c21f5630d749" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:53.299253 11519 raft_consensus.cc:3060] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:53.300089 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ba19192502634f8599407d923114a627 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba19192502634f8599407d923114a627 already in progress: creating tablet
I20260925 01:49:53.300582 11946 tablet_replica.cc:333] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.301277 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 (DEFAULT_TABLE table=default.Table_f0078624576649ef939ea7242932cca4 [id=87123c3a37a043358c97309b26bae779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.301779 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f117df272c342b6b4ea5e5a4d7fd137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.302330 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c9e51d80a442486b78be32c74a94f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:53.302917 11176 leader_election.cc:343] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.303606 11519 raft_consensus.cc:2468] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:53.305308 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 (DEFAULT_TABLE table=default.Table_f0078624576649ef939ea7242932cca4 [id=87123c3a37a043358c97309b26bae779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.305786 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f117df272c342b6b4ea5e5a4d7fd137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.309672 11176 leader_election.cc:304] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:49:53.311306 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7da55c488da540048a94324fa347c1ef consensus state has no leader
W20260925 01:49:53.312345 11456 leader_election.cc:343] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 357963616763428fa69c7670e760f84e
I20260925 01:49:53.313167 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb (DEFAULT_TABLE table=default.Table_b880ff4c65f9490d82a5543163a16ef5 [id=201d4639a19041b7ada8bbd3985d867f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.314674 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9663d7f4008e4ee0a3ba4373258242eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.327239 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb (DEFAULT_TABLE table=default.Table_b880ff4c65f9490d82a5543163a16ef5 [id=201d4639a19041b7ada8bbd3985d867f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.328243 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9663d7f4008e4ee0a3ba4373258242eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:53.328469 11679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.193:42829 (request call id 75) took 778 ms (client timeout 1000 ms). Trace:
W20260925 01:49:53.328598 11679 rpcz_store.cc:269] 0925 01:49:52.550478 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.550555 (+ 77us) service_pool.cc:224] Handling call
0925 01:49:53.328409 (+777854us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:53.298480 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:49:53.298636 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:49:53.298647 (+ 11us) write_op.cc:435] Acquired schema lock
0925 01:49:53.298652 (+ 5us) tablet.cc:662] Decoding operations
0925 01:49:53.298793 (+ 141us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:49:53.298810 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0925 01:49:53.298817 (+ 7us) tablet.cc:685] Acquiring locks for 1 operations
0925 01:49:53.298907 (+ 90us) tablet.cc:701] Row locks acquired
0925 01:49:53.298910 (+ 3us) write_op.cc:260] PREPARE: finished
0925 01:49:53.298953 (+ 43us) write_op.cc:270] Start()
0925 01:49:53.298999 (+ 46us) write_op.cc:276] Timestamp: P: 1790300993298932 usec, L: 0
0925 01:49:53.299005 (+ 6us) op_driver.cc:348] REPLICATION: starting
0925 01:49:53.299266 (+ 261us) log.cc:844] Serialized 536 byte log entry
0925 01:49:53.325735 (+ 26469us) op_driver.cc:464] REPLICATION: finished
0925 01:49:53.326639 (+ 904us) write_op.cc:301] APPLY: starting
0925 01:49:53.326652 (+ 13us) tablet.cc:1394] starting BulkCheckPresence
0925 01:49:53.326682 (+ 30us) tablet.cc:1397] finished BulkCheckPresence
0925 01:49:53.326711 (+ 29us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:49:53.326758 (+ 47us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:49:53.326783 (+ 25us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 01:49:53.326789 (+ 6us) write_op.cc:312] APPLY: finished
0925 01:49:53.326846 (+ 57us) log.cc:844] Serialized 23 byte log entry
0925 01:49:53.326894 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:53.326908 (+ 14us) write_op.cc:454] Released schema lock
0925 01:49:53.326913 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0925 01:49:53.326980 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:53.326987 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":866,"apply.run_cpu_time_us":333,"apply.run_wall_time_us":333,"num_ops":1,"prepare.queue_time_us":134605,"prepare.run_cpu_time_us":957,"prepare.run_wall_time_us":5548,"raft.queue_time_us":4321,"raft.run_cpu_time_us":9,"raft.run_wall_time_us":11,"replication_time_us":26707}]]}
I20260925 01:49:53.329439 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_0b0ce5f884684db28023373c46961746 [id=464edb71967c4016ae7592aaad5492d6]). Expected version 2 got 0
I20260925 01:49:53.329704 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:53.329922 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0b92054aaa704c7ebd6b075c30db2616
I20260925 01:49:53.330075 11673 catalog_manager.cc:5838] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:53.330524 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030]). Expected version 3 got 0
I20260925 01:49:53.331718 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.337376 11931 ts_tablet_manager.cc:1929] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:53.337571 11931 log.cc:1199] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8bf42293dd5d452aa7ed9e0eaa78f54d
I20260925 01:49:53.338501 11931 ts_tablet_manager.cc:1950] T 8bf42293dd5d452aa7ed9e0eaa78f54d P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.339426 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 227) took 1969 ms. Trace:
I20260925 01:49:53.339699 12263 raft_consensus.cc:2804] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:53.339941 11221 tablet_service.cc:1511] Processing CreateTablet for tablet bfc152df745b46fb84aec1c9fa017ba5 (DEFAULT_TABLE table=default.Table_45e7213362f74039a9576e25db157d24 [id=7911f341edd649f588389f6e9b530665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.340739 11931 rpcz_store.cc:276] 0925 01:49:51.369854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.369894 (+ 40us) service_pool.cc:224] Handling call
0925 01:49:53.247072 (+1877178us) ts_tablet_manager.cc:1151] Deleting tablet 8bf42293dd5d452aa7ed9e0eaa78f54d
0925 01:49:53.247086 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.310527 (+ 63441us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.324636 (+ 14109us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.339388 (+ 14752us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1876836}
I20260925 01:49:53.341538 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]) successfully deleted
I20260925 01:49:53.341850 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc152df745b46fb84aec1c9fa017ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.343442 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aef2ce9ee7344e2ab73d9f0fb5c8c21b" } new_table_name: "default.Table_27cae369e3864093b7c94613cec41e94" modify_external_catalogs: true
I20260925 01:49:53.343528 12263 raft_consensus.cc:697] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:53.344473 12263 consensus_queue.cc:237] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.347275 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4735603a234e494e8530cb2f9745858c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.347965 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4735603a234e494e8530cb2f9745858c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.349298 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3a517bf44028408ba6e42751020cdd64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.349833 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a517bf44028408ba6e42751020cdd64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.353219 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 228) took 1975 ms. Trace:
I20260925 01:49:53.353500 11931 rpcz_store.cc:276] 0925 01:49:51.370448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.370497 (+ 49us) service_pool.cc:224] Handling call
0925 01:49:53.343283 (+1972786us) ts_tablet_manager.cc:1151] Deleting tablet f2618c46630c4295949b36f3d0087941
0925 01:49:53.343294 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.345431 (+ 2137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1972543}
W20260925 01:49:53.354090 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f2618c46630c4295949b36f3d0087941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2618c46630c4295949b36f3d0087941 already in progress: creating tablet
I20260925 01:49:53.354194 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c3cabf2f3b004ef7b3b7cff6f5640752" } new_table_name: "default.Table_bc57955da3db41a0aefb397290d813d2" modify_external_catalogs: true
I20260925 01:49:53.354441 11931 tablet_replica.cc:333] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.354703 11931 raft_consensus.cc:2243] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.354866 11931 raft_consensus.cc:2272] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.355665 11931 ts_tablet_manager.cc:1916] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.358832 11754 consensus_queue.cc:260] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.359350 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9d7e379c843d492d9c3c54d5d9925e95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.359899 11754 ts_tablet_manager.cc:1434] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.077s user 0.001s sys 0.001s
W20260925 01:49:53.359938 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d7e379c843d492d9c3c54d5d9925e95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.359865 11965 raft_consensus.cc:493] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:53.361595 11315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260925 01:49:53.362460 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:53.362772 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb (DEFAULT_TABLE table=default.Table_b880ff4c65f9490d82a5543163a16ef5 [id=201d4639a19041b7ada8bbd3985d867f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.362892 11360 tablet_service.cc:1511] Processing CreateTablet for tablet bfc152df745b46fb84aec1c9fa017ba5 (DEFAULT_TABLE table=default.Table_45e7213362f74039a9576e25db157d24 [id=7911f341edd649f588389f6e9b530665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.362905 11946 raft_consensus.cc:2243] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.363278 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc152df745b46fb84aec1c9fa017ba5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.363510 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9663d7f4008e4ee0a3ba4373258242eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:53.363885 11457 leader_election.cc:343] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: a9e1f114c2a749d4af6a366c044f5ea5
I20260925 01:49:53.364266 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:53.365181 11457 leader_election.cc:304] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:53.365386 11457 raft_consensus.cc:2686] T a9e1f114c2a749d4af6a366c044f5ea5 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:53.366552 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 (DEFAULT_TABLE table=default.Table_f0078624576649ef939ea7242932cca4 [id=87123c3a37a043358c97309b26bae779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.367130 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f117df272c342b6b4ea5e5a4d7fd137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.367563 11457 leader_election.cc:304] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:53.367985 12137 raft_consensus.cc:2804] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.368093 11457 leader_election.cc:304] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:53.370275 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:53.371035 11946 raft_consensus.cc:2272] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.371091 12366 raft_consensus.cc:2749] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:53.371641 11457 leader_election.cc:343] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: 1396d679e5824c469490170d257f6a9b
I20260925 01:49:53.371200 12288 raft_consensus.cc:493] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:53.372078 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.372612 12137 raft_consensus.cc:493] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.373147 12137 raft_consensus.cc:3060] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.374600 11965 raft_consensus.cc:515] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.375041 11353 tablet_service.cc:1511] Processing CreateTablet for tablet d401574e89014d2aaa5f98d0d9a2729f (DEFAULT_TABLE table=default.Table_6734b38bddb6462f81a668efbe01fad0 [id=977b69f7df2c41cab43ee3498fb261c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.375646 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d401574e89014d2aaa5f98d0d9a2729f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.376060 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.376408 11375 raft_consensus.cc:2468] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:53.378422 11379 raft_consensus.cc:2468] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:49:53.378975 11457 leader_election.cc:343] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: c3289c6dc8e84a358f877a197412d901
W20260925 01:49:53.379081 11314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260925 01:49:53.379279 11754 tablet_bootstrap.cc:492] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.379581 11965 leader_election.cc:290] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.379546 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82ac4f3b4d48fbbb33c21f5630d749" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:49:53.379887 11314 leader_election.cc:343] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.380057 11177 leader_election.cc:304] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.378336 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c9e51d80a442486b78be32c74a94f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.380607 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82ac4f3b4d48fbbb33c21f5630d749" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.381345 12288 raft_consensus.cc:515] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.382632 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:53.383252 11176 leader_election.cc:343] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.384086 11753 tablet_bootstrap.cc:492] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:49:53.384898 11456 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5acd5d878aac4261a7294e87304c9dfc
I20260925 01:49:53.385038 12288 leader_election.cc:290] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.388513 11496 tablet_service.cc:1511] Processing CreateTablet for tablet ab8d5af739854f939ab585d943e7b7ca (DEFAULT_TABLE table=default.Table_b4bfc0be56f644a58a63e250d8b3e1fc [id=ad065d5b1440401bb0897d5e5ac3cb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.389038 12373 raft_consensus.cc:2804] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.389161 12373 raft_consensus.cc:493] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.389271 12373 raft_consensus.cc:3060] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.389298 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 3702f09e45a14c80af716d642d30cdfa (DEFAULT_TABLE table=default.Table_c5ab983011a64d018825a79f53480036 [id=b23610fb50124879a61cdc044e5287b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.390960 11457 leader_election.cc:304] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:53.391186 11457 raft_consensus.cc:2686] T c3289c6dc8e84a358f877a197412d901 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:53.391325 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 81024a75b31e45e098d108bae4cc17c9
I20260925 01:49:53.392385 11753 ts_tablet_manager.cc:1403] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.155s user 0.019s sys 0.003s
I20260925 01:49:53.392324 12373 raft_consensus.cc:515] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.392647 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8d5af739854f939ab585d943e7b7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.393019 12373 leader_election.cc:290] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.393247 11355 tablet_service.cc:1511] Processing CreateTablet for tablet ab8d5af739854f939ab585d943e7b7ca (DEFAULT_TABLE table=default.Table_b4bfc0be56f644a58a63e250d8b3e1fc [id=ad065d5b1440401bb0897d5e5ac3cb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.393435 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 81024a75b31e45e098d108bae4cc17c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:53.393678 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8d5af739854f939ab585d943e7b7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.394737 11177 leader_election.cc:304] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:53.395087 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_da5dec93ea784a6682a3364edb6c93af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.395406 11177 leader_election.cc:343] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:53.395692 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da5dec93ea784a6682a3364edb6c93af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.397065 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:53.397125 12373 raft_consensus.cc:2804] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260925 01:49:53.397558 11177 leader_election.cc:343] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.397539 12137 raft_consensus.cc:515] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.397671 11177 leader_election.cc:304] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:53.398185 12137 leader_election.cc:290] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.398332 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 81024a75b31e45e098d108bae4cc17c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:53.398306 11177 leader_election.cc:343] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.398488 11946 ts_tablet_manager.cc:1916] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.398940 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3702f09e45a14c80af716d642d30cdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.399389 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 81024a75b31e45e098d108bae4cc17c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.399942 11216 tablet_service.cc:1511] Processing CreateTablet for tablet ab8d5af739854f939ab585d943e7b7ca (DEFAULT_TABLE table=default.Table_b4bfc0be56f644a58a63e250d8b3e1fc [id=ad065d5b1440401bb0897d5e5ac3cb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.400609 11965 raft_consensus.cc:2749] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:53.400863 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:53.401017 12373 raft_consensus.cc:493] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 01:49:53.400861 11176 leader_election.cc:343] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.401567 11238 raft_consensus.cc:3060] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.401836 11753 raft_consensus.cc:359] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:53.404744 11457 leader_election.cc:343] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: 1396d679e5824c469490170d257f6a9b
I20260925 01:49:53.404819 11238 raft_consensus.cc:2468] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:53.405169 12373 raft_consensus.cc:3060] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.406458 11456 leader_election.cc:304] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.407009 11753 raft_consensus.cc:385] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.407384 12137 raft_consensus.cc:2804] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:53.407446 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 829d167dc0214890b722c0197500f159
I20260925 01:49:53.407554 12137 raft_consensus.cc:697] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
W20260925 01:49:53.408176 11314 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.408346 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ddbaaa8ae6ef4cada7027949173feba5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.408921 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddbaaa8ae6ef4cada7027949173feba5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.409660 12137 consensus_queue.cc:237] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.410676 11953 ts_tablet_manager.cc:1929] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:49:53.408979 11457 leader_election.cc:343] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: a3ec6c34d22241e5bda3ec6665a47fc7
I20260925 01:49:53.410815 11953 log.cc:1199] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/e7623999b3c04ca69672a1e43fa6921f
I20260925 01:49:53.412640 11753 raft_consensus.cc:740] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.412935 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 829d167dc0214890b722c0197500f159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:53.412973 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8d5af739854f939ab585d943e7b7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.412891 11753 consensus_queue.cc:260] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.413547 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 829d167dc0214890b722c0197500f159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.413805 12373 raft_consensus.cc:515] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.414085 11753 ts_tablet_manager.cc:1434] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260925 01:49:53.414450 11753 tablet_bootstrap.cc:492] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.415738 12373 leader_election.cc:290] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.415962 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 3702f09e45a14c80af716d642d30cdfa (DEFAULT_TABLE table=default.Table_c5ab983011a64d018825a79f53480036 [id=b23610fb50124879a61cdc044e5287b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.416412 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:53.417186 11457 leader_election.cc:304] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:53.417433 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3702f09e45a14c80af716d642d30cdfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:53.417598 11457 raft_consensus.cc:2686] T a3ec6c34d22241e5bda3ec6665a47fc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:53.419147 11314 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:53.419402 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:53.420003 11176 leader_election.cc:343] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.420137 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 829d167dc0214890b722c0197500f159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:53.421654 11754 tablet_bootstrap.cc:654] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.421689 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9771b89303094974902c4ad1f1c8608e
I20260925 01:49:53.423240 12080 raft_consensus.cc:2749] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:53.424854 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 9771b89303094974902c4ad1f1c8608e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.424875 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 9771b89303094974902c4ad1f1c8608e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:53.427591 11457 leader_election.cc:343] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: b0ad8ca37e3c49a4a03fc3460bf0bc5b
I20260925 01:49:53.427801 11457 leader_election.cc:304] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:53.428438 11457 raft_consensus.cc:2686] T b0ad8ca37e3c49a4a03fc3460bf0bc5b P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:53.430404 11457 leader_election.cc:304] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:53.431859 11457 raft_consensus.cc:2686] T b05053f5646f4748a99647b7dbfae686 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:53.441841 12373 consensus_queue.cc:1048] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:53.442440 11753 tablet_bootstrap.cc:654] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.443707 11953 ts_tablet_manager.cc:1950] T e7623999b3c04ca69672a1e43fa6921f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:53.444257 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 52) took 6792 ms. Trace:
I20260925 01:49:53.454072 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 9771b89303094974902c4ad1f1c8608e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:53.454572 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef093a4a1134407ba94207137ce3e81 (DEFAULT_TABLE table=default.Table_3c14d4f477e248bdaddf42e4370c5557 [id=3084bc3a144e4f66a71dc80592cec4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.454666 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 3702f09e45a14c80af716d642d30cdfa (DEFAULT_TABLE table=default.Table_c5ab983011a64d018825a79f53480036 [id=b23610fb50124879a61cdc044e5287b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.455168 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef093a4a1134407ba94207137ce3e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.456054 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3702f09e45a14c80af716d642d30cdfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.462227 11380 raft_consensus.cc:3060] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:53.462808 11457 consensus_peers.cc:597] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1396d679e5824c469490170d257f6a9b. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:53.463294 11457 consensus_peers.cc:597] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:53.463155 11953 rpcz_store.cc:276] 0925 01:49:46.651307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.653489 (+ 2182us) service_pool.cc:224] Handling call
0925 01:49:52.911897 (+6258408us) ts_tablet_manager.cc:1151] Deleting tablet e7623999b3c04ca69672a1e43fa6921f
0925 01:49:52.911915 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:52.920510 (+ 8595us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.410251 (+489741us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.444221 (+ 33970us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6258171}
I20260925 01:49:53.463661 11953 tablet_replica.cc:333] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:53.464215 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet e7623999b3c04ca69672a1e43fa6921f (table default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327]) successfully deleted
I20260925 01:49:53.464555 11953 raft_consensus.cc:2243] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:53.466008 11457 leader_election.cc:304] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:53.468647 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef093a4a1134407ba94207137ce3e81 (DEFAULT_TABLE table=default.Table_3c14d4f477e248bdaddf42e4370c5557 [id=3084bc3a144e4f66a71dc80592cec4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.469457 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef093a4a1134407ba94207137ce3e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.470569 12288 raft_consensus.cc:3060] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.473580 11953 raft_consensus.cc:2272] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.475157 12288 raft_consensus.cc:2749] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:53.478936 11754 tablet_bootstrap.cc:492] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.479120 11754 ts_tablet_manager.cc:1403] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.119s user 0.001s sys 0.004s
I20260925 01:49:53.479619 11946 ts_tablet_manager.cc:1929] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:49:53.481611 11456 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260925 01:49:53.485169 11946 log.cc:1199] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e506eeed137e42e18e4d0e340d148aa8
I20260925 01:49:53.485707 11946 ts_tablet_manager.cc:1950] T e506eeed137e42e18e4d0e340d148aa8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.486611 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 42) took 7031 ms. Trace:
I20260925 01:49:53.486771 11946 rpcz_store.cc:276] 0925 01:49:46.455127 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.455465 (+ 338us) service_pool.cc:224] Handling call
0925 01:49:53.300490 (+6845025us) ts_tablet_manager.cc:1151] Deleting tablet e506eeed137e42e18e4d0e340d148aa8
0925 01:49:53.300509 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.412422 (+111913us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.479529 (+ 67107us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.486554 (+ 7025us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6844820}
I20260925 01:49:53.487403 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e506eeed137e42e18e4d0e340d148aa8 (table default.Table_fc17121a61824d04b8430e1c61d48de9 [id=c168421652804e92b137fe7114d3055c]) successfully deleted
I20260925 01:49:53.487936 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 49) took 6835 ms. Trace:
I20260925 01:49:53.489017 11946 rpcz_store.cc:276] 0925 01:49:46.652582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.652641 (+ 59us) service_pool.cc:224] Handling call
0925 01:49:53.487754 (+6835113us) ts_tablet_manager.cc:1151] Deleting tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c
0925 01:49:53.487766 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.487878 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6832467}
W20260925 01:49:53.492079 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c already in progress: creating tablet
I20260925 01:49:53.488933 11753 tablet_bootstrap.cc:492] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.492563 11753 ts_tablet_manager.cc:1403] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.000s
I20260925 01:49:53.493507 11753 raft_consensus.cc:359] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.493909 11753 raft_consensus.cc:385] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.494078 11753 raft_consensus.cc:740] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.494462 11753 consensus_queue.cc:260] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.497407 11753 ts_tablet_manager.cc:1434] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:49:53.497822 11753 tablet_bootstrap.cc:492] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.498104 11946 tablet_replica.cc:333] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.499505 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1a15ff4030084c1c84fadccb984297e8" } new_table_name: "default.Table_4b87558f2a98419f96b453a44aae814b" modify_external_catalogs: true
I20260925 01:49:53.499984 11946 raft_consensus.cc:2243] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.500213 11946 raft_consensus.cc:2272] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.500377 11380 raft_consensus.cc:2468] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:53.500875 11946 ts_tablet_manager.cc:1916] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.500986 11177 leader_election.cc:304] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:53.503337 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 23dc2ece3d624baa8d5d45ec6b67c6f6 (DEFAULT_TABLE table=default.Table_28e00c8070064e4f9769a09dac622b6b [id=dbd741768ab9482a8cdedb96316e4638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.504155 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 75014fc54fc7481f83da07e1d96c4370 (DEFAULT_TABLE table=default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85 [id=bc109ead6d44465f944331ce2a20a350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.504624 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75014fc54fc7481f83da07e1d96c4370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.505874 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 (DEFAULT_TABLE table=default.Table_96968765ba9045588fca7ce661775b0d [id=708c92d3ed0f40459cb0ef392cbb4096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.505805 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 23dc2ece3d624baa8d5d45ec6b67c6f6 (DEFAULT_TABLE table=default.Table_28e00c8070064e4f9769a09dac622b6b [id=dbd741768ab9482a8cdedb96316e4638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.506289 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982b2a3dcdcb44bd8ad8562f30c38f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.506445 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 75014fc54fc7481f83da07e1d96c4370 (DEFAULT_TABLE table=default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85 [id=bc109ead6d44465f944331ce2a20a350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.508292 12263 raft_consensus.cc:2804] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:53.508490 12263 raft_consensus.cc:697] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:53.508795 12263 consensus_queue.cc:237] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.509687 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 23dc2ece3d624baa8d5d45ec6b67c6f6 (DEFAULT_TABLE table=default.Table_28e00c8070064e4f9769a09dac622b6b [id=dbd741768ab9482a8cdedb96316e4638]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.509903 11965 consensus_queue.cc:1048] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:53.510001 11755 tablet_bootstrap.cc:492] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:53.510362 11755 ts_tablet_manager.cc:1403] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.672s user 0.008s sys 0.007s
I20260925 01:49:53.510681 11953 ts_tablet_manager.cc:1916] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.515292 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23dc2ece3d624baa8d5d45ec6b67c6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.517007 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75014fc54fc7481f83da07e1d96c4370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.518422 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef093a4a1134407ba94207137ce3e81 (DEFAULT_TABLE table=default.Table_3c14d4f477e248bdaddf42e4370c5557 [id=3084bc3a144e4f66a71dc80592cec4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.494858 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:53.523159 11376 raft_consensus.cc:3060] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.526577 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 75014fc54fc7481f83da07e1d96c4370 (DEFAULT_TABLE table=default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85 [id=bc109ead6d44465f944331ce2a20a350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.526782 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23dc2ece3d624baa8d5d45ec6b67c6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.531697 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75014fc54fc7481f83da07e1d96c4370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.534694 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23dc2ece3d624baa8d5d45ec6b67c6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.535593 11931 ts_tablet_manager.cc:1929] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.535776 11931 log.cc:1199] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:53.536296 11931 ts_tablet_manager.cc:1950] T 02f9e96bcdf9418ea54dc73bf68a2be6 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.537097 11754 raft_consensus.cc:359] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.537297 11754 raft_consensus.cc:385] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.537392 11754 raft_consensus.cc:740] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.537652 11754 consensus_queue.cc:260] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.540776 11754 ts_tablet_manager.cc:1434] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.062s user 0.002s sys 0.001s
I20260925 01:49:53.540830 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef093a4a1134407ba94207137ce3e81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.542768 11753 tablet_bootstrap.cc:654] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.545107 11754 tablet_bootstrap.cc:492] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.544281 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 (DEFAULT_TABLE table=default.Table_96968765ba9045588fca7ce661775b0d [id=708c92d3ed0f40459cb0ef392cbb4096]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:53.546830 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 54778us
I20260925 01:49:53.546918 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982b2a3dcdcb44bd8ad8562f30c38f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.549119 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
W20260925 01:49:53.549927 11314 leader_election.cc:343] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.550956 11314 leader_election.cc:304] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:53.551453 12080 raft_consensus.cc:2804] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.551544 12080 raft_consensus.cc:493] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.551637 12080 raft_consensus.cc:3060] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.554554 12080 raft_consensus.cc:515] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.555431 12080 leader_election.cc:290] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.556239 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 (DEFAULT_TABLE table=default.Table_96968765ba9045588fca7ce661775b0d [id=708c92d3ed0f40459cb0ef392cbb4096]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.556727 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982b2a3dcdcb44bd8ad8562f30c38f13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.559739 11674 catalog_manager.cc:5838] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:53.560279 11674 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_0b0ce5f884684db28023373c46961746 [id=464edb71967c4016ae7592aaad5492d6]). Expected version 2 got 0
I20260925 01:49:53.560400 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4795a346170948d996e3f9d6abec0c9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.560580 11674 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030]). Expected version 3 got 0
W20260925 01:49:53.561010 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4795a346170948d996e3f9d6abec0c9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.561251 11946 ts_tablet_manager.cc:1929] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.561368 11946 log.cc:1199] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/018525730c4e4134ab3a0506f1a0a6fa
I20260925 01:49:53.561797 11946 ts_tablet_manager.cc:1950] T 018525730c4e4134ab3a0506f1a0a6fa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:53.563122 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3aadd649e4b4f489bfe4b0eea13ede8 has no consensus state
I20260925 01:49:53.563488 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet 31fe174270f24ff780c212eaef90ef0d from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:53.564345 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2f36a1cff31f4f989ec8d79514bcd65f" } new_table_name: "default.Table_5e9bceacc719454ab66e9ae7f9942c69" modify_external_catalogs: true
I20260925 01:49:53.565899 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7d5f8540137149d6ac35dd7be073315f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.566475 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d5f8540137149d6ac35dd7be073315f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.567149 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba19192502634f8599407d923114a627" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:53.567575 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 50) took 6909 ms. Trace:
I20260925 01:49:53.567703 11946 rpcz_store.cc:276] 0925 01:49:46.658202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.658415 (+ 213us) service_pool.cc:224] Handling call
0925 01:49:53.497998 (+6839583us) ts_tablet_manager.cc:1151] Deleting tablet 018525730c4e4134ab3a0506f1a0a6fa
0925 01:49:53.498007 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.539940 (+ 41933us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.561160 (+ 21220us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.567534 (+ 6374us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6832200}
I20260925 01:49:53.575776 11946 tablet_replica.cc:333] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.565723 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 230) took 2131 ms. Trace:
I20260925 01:49:53.577517 11931 rpcz_store.cc:276] 0925 01:49:51.434480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.475828 (+ 41348us) service_pool.cc:224] Handling call
0925 01:49:53.354367 (+1878539us) ts_tablet_manager.cc:1151] Deleting tablet 02f9e96bcdf9418ea54dc73bf68a2be6
0925 01:49:53.354380 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.444473 (+ 90093us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.535509 (+ 91036us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.565655 (+ 30146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1861289}
I20260925 01:49:53.578280 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 02f9e96bcdf9418ea54dc73bf68a2be6 (table default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]) successfully deleted
I20260925 01:49:53.578384 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba19192502634f8599407d923114a627" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:53.578707 11238 raft_consensus.cc:2468] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:53.578984 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 229) took 2151 ms. Trace:
I20260925 01:49:53.579188 11931 rpcz_store.cc:276] 0925 01:49:51.427516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.519422 (+ 91906us) service_pool.cc:224] Handling call
0925 01:49:53.578675 (+2059253us) ts_tablet_manager.cc:1151] Deleting tablet d7f97ead49634bf6b03e292544af4d07
0925 01:49:53.578686 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.578833 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2018045}
I20260925 01:49:53.579329 11376 raft_consensus.cc:2468] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:49:53.579761 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d7f97ead49634bf6b03e292544af4d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7f97ead49634bf6b03e292544af4d07 already in progress: creating tablet
I20260925 01:49:53.580454 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00906edfa6b648229bcba8e59d68b969" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:53.580878 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00906edfa6b648229bcba8e59d68b969" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:53.581122 11238 raft_consensus.cc:2468] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:53.580451 11946 raft_consensus.cc:2243] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:53.583609 11946 pending_rounds.cc:70] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:53.583688 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0f46031226094ac9a29b4b94c3713863" } modify_external_catalogs: true
I20260925 01:49:53.583917 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0f46031226094ac9a29b4b94c3713863" } modify_external_catalogs: true
I20260925 01:49:53.585670 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 148f74b071c6420f8c78278c0cb37738 (DEFAULT_TABLE table=default.Table_f9bc2f31552244b3a2372edb87acf2e8 [id=9bac5b87f3f049f3afd533448ddc30ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.586247 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148f74b071c6420f8c78278c0cb37738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.586822 11946 pending_rounds.cc:77] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072860970897408 op_type: NO_OP noop_request { }
I20260925 01:49:53.585851 11360 tablet_service.cc:1511] Processing CreateTablet for tablet cb7bac6e89b8405e8bd541eba6278a0b (DEFAULT_TABLE table=default.Table_02a831c4d17044d8b03bad381ad3327a [id=f1315f21c4784385b931036720c0174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.591813 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7bac6e89b8405e8bd541eba6278a0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:53.593011 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e95fb28febd94a26ba9682fb9a462872 consensus state has no leader
I20260925 01:49:53.584970 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:53.594774 11518 raft_consensus.cc:2468] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:53.586453 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 148f74b071c6420f8c78278c0cb37738 (DEFAULT_TABLE table=default.Table_f9bc2f31552244b3a2372edb87acf2e8 [id=9bac5b87f3f049f3afd533448ddc30ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.584584 11501 tablet_service.cc:1511] Processing CreateTablet for tablet cb7bac6e89b8405e8bd541eba6278a0b (DEFAULT_TABLE table=default.Table_02a831c4d17044d8b03bad381ad3327a [id=f1315f21c4784385b931036720c0174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.597605 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_99d13693bec4412ea02371deaf0384b0" } new_table_name: "default.Table_947208be83344047aac510e1bce1ee26" modify_external_catalogs: true
I20260925 01:49:53.590488 11207 tablet_service.cc:1511] Processing CreateTablet for tablet cb7bac6e89b8405e8bd541eba6278a0b (DEFAULT_TABLE table=default.Table_02a831c4d17044d8b03bad381ad3327a [id=f1315f21c4784385b931036720c0174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.599179 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7bac6e89b8405e8bd541eba6278a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.599542 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148f74b071c6420f8c78278c0cb37738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.589486 11755 raft_consensus.cc:359] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.602191 11755 raft_consensus.cc:385] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.602460 11755 raft_consensus.cc:740] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.602965 11755 consensus_queue.cc:260] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.603659 11755 ts_tablet_manager.cc:1434] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.093s user 0.000s sys 0.002s
I20260925 01:49:53.609011 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7bac6e89b8405e8bd541eba6278a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.610636 11755 tablet_bootstrap.cc:492] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:53.614534 11946 raft_consensus.cc:2889] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:53.614885 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 148f74b071c6420f8c78278c0cb37738 (DEFAULT_TABLE table=default.Table_f9bc2f31552244b3a2372edb87acf2e8 [id=9bac5b87f3f049f3afd533448ddc30ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.614979 11946 raft_consensus.cc:2272] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.615100 11216 tablet_service.cc:1511] Processing CreateTablet for tablet dfee952102744ef8b287965330d7cd97 (DEFAULT_TABLE table=default.Table_6c24eba1677646b18f3abd49f86f6afb [id=152360bd208e42e5aae8e303a24954ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.615628 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee952102744ef8b287965330d7cd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.615686 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148f74b071c6420f8c78278c0cb37738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.615859 11946 ts_tablet_manager.cc:1916] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.591217 11953 ts_tablet_manager.cc:1929] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.633312 11753 tablet_bootstrap.cc:492] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.633565 11753 ts_tablet_manager.cc:1403] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.136s user 0.005s sys 0.010s
I20260925 01:49:53.633720 11177 leader_election.cc:304] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:53.634593 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 233) took 1869 ms. Trace:
I20260925 01:49:53.634773 11753 raft_consensus.cc:359] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.634857 12263 raft_consensus.cc:2804] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:53.634964 11753 raft_consensus.cc:385] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.635056 11753 raft_consensus.cc:740] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.635326 11753 consensus_queue.cc:260] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.635891 12263 raft_consensus.cc:697] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:53.636309 12263 consensus_queue.cc:237] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.638139 11953 log.cc:1199] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/018525730c4e4134ab3a0506f1a0a6fa
I20260925 01:49:53.638896 11753 ts_tablet_manager.cc:1434] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260925 01:49:53.640342 11753 tablet_bootstrap.cc:492] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.641005 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1f9796971bef489fbaf53b6c189ec489"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.641739 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f9796971bef489fbaf53b6c189ec489 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.642781 11753 tablet_bootstrap.cc:654] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.643445 11754 tablet_bootstrap.cc:654] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.646275 11946 ts_tablet_manager.cc:1929] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.646519 11946 log.cc:1199] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e7623999b3c04ca69672a1e43fa6921f
I20260925 01:49:53.647272 11946 ts_tablet_manager.cc:1950] T e7623999b3c04ca69672a1e43fa6921f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.647501 11931 rpcz_store.cc:276] 0925 01:49:51.745144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.745226 (+ 82us) service_pool.cc:224] Handling call
0925 01:49:53.610213 (+1864987us) ts_tablet_manager.cc:1151] Deleting tablet 31353cc95e014e5bb24e5e5cefab1503
0925 01:49:53.610227 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.614864 (+ 4637us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1862089}
W20260925 01:49:53.648207 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 31353cc95e014e5bb24e5e5cefab1503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31353cc95e014e5bb24e5e5cefab1503 already in progress: creating tablet
I20260925 01:49:53.648788 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 51) took 6989 ms. Trace:
I20260925 01:49:53.648983 11946 rpcz_store.cc:276] 0925 01:49:46.659424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.668027 (+ 8603us) service_pool.cc:224] Handling call
0925 01:49:53.575688 (+6907661us) ts_tablet_manager.cc:1151] Deleting tablet e7623999b3c04ca69672a1e43fa6921f
0925 01:49:53.575701 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.620121 (+ 44420us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.646153 (+ 26032us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.648742 (+ 2589us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6894635}
I20260925 01:49:53.649734 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e7623999b3c04ca69672a1e43fa6921f (table default.Table_0f4010708b5b45fe8194002faf14225e [id=2b72d2532e7e46369388217490b1d327]) successfully deleted
I20260925 01:49:53.650211 11946 tablet_replica.cc:333] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.650542 11946 raft_consensus.cc:2243] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:53.650913 11946 raft_consensus.cc:2272] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.651650 11946 ts_tablet_manager.cc:1916] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.652359 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 234) took 1905 ms. Trace:
I20260925 01:49:53.652473 11931 rpcz_store.cc:276] 0925 01:49:51.746382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.746450 (+ 68us) service_pool.cc:224] Handling call
0925 01:49:53.648584 (+1902134us) ts_tablet_manager.cc:1151] Deleting tablet 96b68399843a422b8da3ddfab2c522e6
0925 01:49:53.652155 (+ 3571us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.652299 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1900829}
W20260925 01:49:53.653007 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 96b68399843a422b8da3ddfab2c522e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b68399843a422b8da3ddfab2c522e6 already in progress: creating tablet
I20260925 01:49:53.653352 11753 tablet_bootstrap.cc:492] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.653565 11753 ts_tablet_manager.cc:1403] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260925 01:49:53.653600 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 235) took 1905 ms. Trace:
I20260925 01:49:53.653788 11931 rpcz_store.cc:276] 0925 01:49:51.748044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.748089 (+ 45us) service_pool.cc:224] Handling call
0925 01:49:53.653373 (+1905284us) ts_tablet_manager.cc:1151] Deleting tablet 98ffeb9d70374afdb72a728d7b211d33
0925 01:49:53.653383 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.653537 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1904983}
W20260925 01:49:53.654330 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 98ffeb9d70374afdb72a728d7b211d33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98ffeb9d70374afdb72a728d7b211d33 already in progress: creating tablet
I20260925 01:49:53.654524 11753 raft_consensus.cc:359] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.654755 11753 raft_consensus.cc:385] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.654829 11753 raft_consensus.cc:740] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.654937 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 236) took 1904 ms. Trace:
I20260925 01:49:53.655086 11931 rpcz_store.cc:276] 0925 01:49:51.750122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.750169 (+ 47us) service_pool.cc:224] Handling call
0925 01:49:53.654632 (+1904463us) ts_tablet_manager.cc:1151] Deleting tablet 8c1abd3c2cb34915a595ea73a8d10743
0925 01:49:53.654640 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.654791 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1904245}
I20260925 01:49:53.655113 11753 consensus_queue.cc:260] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.656330 11501 tablet_service.cc:1511] Processing CreateTablet for tablet dfee952102744ef8b287965330d7cd97 (DEFAULT_TABLE table=default.Table_6c24eba1677646b18f3abd49f86f6afb [id=152360bd208e42e5aae8e303a24954ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.656365 11350 tablet_service.cc:1511] Processing CreateTablet for tablet dfee952102744ef8b287965330d7cd97 (DEFAULT_TABLE table=default.Table_6c24eba1677646b18f3abd49f86f6afb [id=152360bd208e42e5aae8e303a24954ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.657305 11356 tablet_service.cc:1511] Processing CreateTablet for tablet abcb285ebc1a4bfd8317546823e01b09 (DEFAULT_TABLE table=default.Table_62d80cb30e374cc1ad9618b1df6adc21 [id=c2a62f15ea544ec38d4fa1c67a1141a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.657737 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee952102744ef8b287965330d7cd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.658330 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 (DEFAULT_TABLE table=default.Table_22a3f87d316e46268ed60c79ab7a9824 [id=f982909c932b49238735e89451d7ca08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.658931 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.659592 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfee952102744ef8b287965330d7cd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.659539 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 (DEFAULT_TABLE table=default.Table_22a3f87d316e46268ed60c79ab7a9824 [id=f982909c932b49238735e89451d7ca08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.660005 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.662292 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcb285ebc1a4bfd8317546823e01b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.657052 11753 ts_tablet_manager.cc:1434] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:53.657977 11497 tablet_service.cc:1511] Processing CreateTablet for tablet abcb285ebc1a4bfd8317546823e01b09 (DEFAULT_TABLE table=default.Table_62d80cb30e374cc1ad9618b1df6adc21 [id=c2a62f15ea544ec38d4fa1c67a1141a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.666455 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcb285ebc1a4bfd8317546823e01b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.657280 11212 tablet_service.cc:1511] Processing CreateTablet for tablet abcb285ebc1a4bfd8317546823e01b09 (DEFAULT_TABLE table=default.Table_62d80cb30e374cc1ad9618b1df6adc21 [id=c2a62f15ea544ec38d4fa1c67a1141a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.668707 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abcb285ebc1a4bfd8317546823e01b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.670737 11754 tablet_bootstrap.cc:492] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.670933 11754 ts_tablet_manager.cc:1403] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.126s user 0.000s sys 0.005s
I20260925 01:49:53.671772 11754 raft_consensus.cc:359] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.672217 11754 raft_consensus.cc:385] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.672322 11754 raft_consensus.cc:740] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.673691 11754 consensus_queue.cc:260] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.674141 11753 tablet_bootstrap.cc:492] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.674247 11754 ts_tablet_manager.cc:1434] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 01:49:53.674166 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 252415635b5e4b3286948e91d421d6f1 (DEFAULT_TABLE table=default.Table_89979b06d2f04faa8b7f18b057afdbf1 [id=b8aeef331373440ba0d32c79585f44b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.674579 11754 tablet_bootstrap.cc:492] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.674577 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252415635b5e4b3286948e91d421d6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.658941 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 (DEFAULT_TABLE table=default.Table_22a3f87d316e46268ed60c79ab7a9824 [id=f982909c932b49238735e89451d7ca08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.675737 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.676309 11753 tablet_bootstrap.cc:654] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.676324 11754 tablet_bootstrap.cc:654] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.681612 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 4930edeb2edd4e7494dbf1761b5d20c0 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.682128 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4930edeb2edd4e7494dbf1761b5d20c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.683220 11498 tablet_service.cc:1511] Processing CreateTablet for tablet c86a78873e8847fa95bead4774bea606 (DEFAULT_TABLE table=default.Table_1a15ff4030084c1c84fadccb984297e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.683727 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86a78873e8847fa95bead4774bea606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.685505 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 70f4777a789a48a18cfadbfb9d49a708 (DEFAULT_TABLE table=default.Table_6071e9aeccf94c38b3a13b08027ad884 [id=b0b233e44e604e0c94e47a67f8a255f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.686162 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f4777a789a48a18cfadbfb9d49a708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.690737 11203 tablet_service.cc:1511] Processing CreateTablet for tablet c86a78873e8847fa95bead4774bea606 (DEFAULT_TABLE table=default.Table_1a15ff4030084c1c84fadccb984297e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.691203 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86a78873e8847fa95bead4774bea606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.693271 11344 tablet_service.cc:1511] Processing CreateTablet for tablet c86a78873e8847fa95bead4774bea606 (DEFAULT_TABLE table=default.Table_1a15ff4030084c1c84fadccb984297e8 [id=a1a3b3d0054a4bff8de55b5c5e71880f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.693747 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86a78873e8847fa95bead4774bea606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.694411 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 70f4777a789a48a18cfadbfb9d49a708 (DEFAULT_TABLE table=default.Table_6071e9aeccf94c38b3a13b08027ad884 [id=b0b233e44e604e0c94e47a67f8a255f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.694795 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f4777a789a48a18cfadbfb9d49a708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.697508 12137 raft_consensus.cc:493] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:53.697621 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 4930edeb2edd4e7494dbf1761b5d20c0 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.697670 12137 raft_consensus.cc:515] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.698165 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4930edeb2edd4e7494dbf1761b5d20c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.698360 12137 leader_election.cc:290] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.699118 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 4930edeb2edd4e7494dbf1761b5d20c0 (DEFAULT_TABLE table=default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.699640 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4930edeb2edd4e7494dbf1761b5d20c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:53.701284 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8c1abd3c2cb34915a595ea73a8d10743 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c1abd3c2cb34915a595ea73a8d10743 already in progress: creating tablet
I20260925 01:49:53.702081 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 237) took 1950 ms. Trace:
I20260925 01:49:53.702625 11953 ts_tablet_manager.cc:1950] T 018525730c4e4134ab3a0506f1a0a6fa P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:53.703100 11931 rpcz_store.cc:276] 0925 01:49:51.751760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.751811 (+ 51us) service_pool.cc:224] Handling call
0925 01:49:53.701801 (+1949990us) ts_tablet_manager.cc:1151] Deleting tablet 86c8c3bba9614539bfe3018461ad21f8
0925 01:49:53.701816 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.701984 (+ 168us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1949698}
W20260925 01:49:53.703770 11456 leader_election.cc:343] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e686dff5ada64f05a1c7bd914c1377a4
I20260925 01:49:53.703969 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 252415635b5e4b3286948e91d421d6f1 (DEFAULT_TABLE table=default.Table_89979b06d2f04faa8b7f18b057afdbf1 [id=b8aeef331373440ba0d32c79585f44b2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:53.704167 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 86c8c3bba9614539bfe3018461ad21f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86c8c3bba9614539bfe3018461ad21f8 already in progress: creating tablet
I20260925 01:49:53.703591 12263 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.704447 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252415635b5e4b3286948e91d421d6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.704646 12263 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.706300 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:53.706960 11176 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.707206 12263 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.707536 11931 tablet_replica.cc:333] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.707785 11931 raft_consensus.cc:2243] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.708052 11931 raft_consensus.cc:2272] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.708702 11931 ts_tablet_manager.cc:1916] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.713444 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 252415635b5e4b3286948e91d421d6f1 (DEFAULT_TABLE table=default.Table_89979b06d2f04faa8b7f18b057afdbf1 [id=b8aeef331373440ba0d32c79585f44b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.714499 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:53.717854 11946 ts_tablet_manager.cc:1929] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.718840 11753 tablet_bootstrap.cc:492] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.719002 11753 ts_tablet_manager.cc:1403] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.001s
I20260925 01:49:53.719887 11753 raft_consensus.cc:359] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.720103 11753 raft_consensus.cc:385] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.720211 11753 raft_consensus.cc:740] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.720700 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.720729 11753 consensus_queue.cc:260] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.713785 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:53.721441 11238 raft_consensus.cc:2393] T e7f421bb962e407c8b459eaad6e45b61 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:49:53.722430 11753 ts_tablet_manager.cc:1434] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:53.723690 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252415635b5e4b3286948e91d421d6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.725824 11753 tablet_bootstrap.cc:492] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.726814 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 51) took 7052 ms. Trace:
I20260925 01:49:53.727854 11753 tablet_bootstrap.cc:654] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.728956 11946 log.cc:1199] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8d208d580a2c4c27bd614ccc88088384
I20260925 01:49:53.729589 11946 ts_tablet_manager.cc:1950] T 8d208d580a2c4c27bd614ccc88088384 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:53.730883 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c86a78873e8847fa95bead4774bea606 consensus state has no leader
I20260925 01:49:53.731328 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f12eeda830be434fbc7fa9b8827978d4" } modify_external_catalogs: true
I20260925 01:49:53.731526 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f12eeda830be434fbc7fa9b8827978d4" } modify_external_catalogs: true
I20260925 01:49:53.735931 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 58) took 6882 ms. Trace:
I20260925 01:49:53.736054 11946 rpcz_store.cc:276] 0925 01:49:46.848132 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.854133 (+ 6001us) service_pool.cc:224] Handling call
0925 01:49:53.650124 (+6795991us) ts_tablet_manager.cc:1151] Deleting tablet 8d208d580a2c4c27bd614ccc88088384
0925 01:49:53.650137 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.680686 (+ 30549us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.717767 (+ 37081us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.731045 (+ 13278us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6795741}
I20260925 01:49:53.736534 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8d208d580a2c4c27bd614ccc88088384 (table default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e]) successfully deleted
I20260925 01:49:53.737488 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 68) took 6571 ms. Trace:
I20260925 01:49:53.737612 11946 rpcz_store.cc:276] 0925 01:49:47.166463 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.180320 (+ 13857us) service_pool.cc:224] Handling call
0925 01:49:53.737300 (+6556980us) ts_tablet_manager.cc:1151] Deleting tablet 596f8ddbcd16458aa4f287f4f11282a1
0925 01:49:53.737313 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.737433 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6527890}
W20260925 01:49:53.738248 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 596f8ddbcd16458aa4f287f4f11282a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596f8ddbcd16458aa4f287f4f11282a1 already in progress: creating tablet
I20260925 01:49:53.738238 11376 raft_consensus.cc:2468] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:53.740613 11946 tablet_replica.cc:333] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.741600 11946 raft_consensus.cc:2243] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:53.742692 11177 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:53.743615 12263 raft_consensus.cc:2804] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.743644 11946 raft_consensus.cc:2272] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.743736 12263 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.743852 12263 raft_consensus.cc:3060] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.744376 11946 ts_tablet_manager.cc:1916] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.739282 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 70f4777a789a48a18cfadbfb9d49a708 (DEFAULT_TABLE table=default.Table_6071e9aeccf94c38b3a13b08027ad884 [id=b0b233e44e604e0c94e47a67f8a255f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:53.748162 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet 04f412cbebe04a629070aecf2753287c from {username='slave'} at 127.0.0.1:60372
W20260925 01:49:53.748656 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2feaab143fae4312915579fdb2ff1e40 consensus state has no leader
I20260925 01:49:53.748634 12263 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.749989 11672 catalog_manager.cc:5838] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:53.750816 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:53.751209 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:53.751885 11176 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.752141 12263 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.752785 11931 ts_tablet_manager.cc:1929] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.752959 11931 log.cc:1199] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/99913eb35197442880a27b3c288237f4
I20260925 01:49:53.753545 11931 ts_tablet_manager.cc:1950] T 99913eb35197442880a27b3c288237f4 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.756754 11953 rpcz_store.cc:276] 0925 01:49:46.650175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.653763 (+ 3588us) service_pool.cc:224] Handling call
0925 01:49:53.463512 (+6809749us) ts_tablet_manager.cc:1151] Deleting tablet 018525730c4e4134ab3a0506f1a0a6fa
0925 01:49:53.463522 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.473371 (+ 9849us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x617000052af0. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74e033df 00007f1c74eb3f2c 00007f1c74f24b53 00007f1c762ad583 00007f1c78e7a8b7 00007f1c78eada64 00007f1c78e8e3a0 00007f1c78e8e12d 0000000000aaef9c 00007f1c68e76aef
0925 01:49:53.514782 (+ 41411us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.591086 (+ 76304us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.703005 (+111919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19574016,"tablet-delete.queue_time_us":6809179}
I20260925 01:49:53.757498 11755 tablet_bootstrap.cc:654] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:53.760898 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e95fb28febd94a26ba9682fb9a462872 consensus state has no leader
I20260925 01:49:53.763098 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c9e51d80a442486b78be32c74a94f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.763450 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.764670 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet a3358b78a1da48388d1f72536b1ed0a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 406d31139e1e441aa6fe204168486e28) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.764542 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 242) took 1916 ms. Trace:
I20260925 01:49:53.765019 11931 rpcz_store.cc:276] 0925 01:49:51.848567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.882115 (+ 33548us) service_pool.cc:224] Handling call
0925 01:49:53.707446 (+1825331us) ts_tablet_manager.cc:1151] Deleting tablet 99913eb35197442880a27b3c288237f4
0925 01:49:53.707457 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.744037 (+ 36580us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.752661 (+ 8624us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.764496 (+ 11835us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1825027}
I20260925 01:49:53.765767 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 99913eb35197442880a27b3c288237f4 (table default.Table_bf94da756bf24c42b0debbb732b59861 [id=5a101d4224e546e686f9bf819b07c07b]) successfully deleted
I20260925 01:49:53.766527 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 251) took 1871 ms. Trace:
I20260925 01:49:53.767181 11931 rpcz_store.cc:276] 0925 01:49:51.895278 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.895339 (+ 61us) service_pool.cc:224] Handling call
0925 01:49:53.766268 (+1870929us) ts_tablet_manager.cc:1151] Deleting tablet 5d23c5d52faa4b6da2996fabb16bd74a
0925 01:49:53.766280 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.766438 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1870534}
W20260925 01:49:53.768261 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5d23c5d52faa4b6da2996fabb16bd74a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d23c5d52faa4b6da2996fabb16bd74a already in progress: creating tablet
I20260925 01:49:53.768630 11238 raft_consensus.cc:1275] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Refusing update from remote peer 514f31e4c2e54d9aaf6d4dd771d153b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:53.768980 11931 tablet_replica.cc:333] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.769327 11931 raft_consensus.cc:2243] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.769593 11931 raft_consensus.cc:2272] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.769941 12288 consensus_queue.cc:1048] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:53.773396 11946 ts_tablet_manager.cc:1929] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:53.775156 11931 ts_tablet_manager.cc:1916] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.777989 11946 log.cc:1199] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/200caea41ba4466386b091875f017956
I20260925 01:49:53.779013 11946 ts_tablet_manager.cc:1950] T 200caea41ba4466386b091875f017956 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.780738 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70f4777a789a48a18cfadbfb9d49a708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:53.781280 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 70) took 6461 ms. Trace:
I20260925 01:49:53.781394 11946 rpcz_store.cc:276] 0925 01:49:47.319560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.319615 (+ 55us) service_pool.cc:224] Handling call
0925 01:49:53.740485 (+6420870us) ts_tablet_manager.cc:1151] Deleting tablet 200caea41ba4466386b091875f017956
0925 01:49:53.740499 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.748590 (+ 8091us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.773280 (+ 24690us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.781239 (+ 7959us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6380576}
I20260925 01:49:53.783186 11953 tablet_replica.cc:333] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:53.783543 11953 raft_consensus.cc:2243] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.783947 11953 raft_consensus.cc:2272] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.784744 11953 ts_tablet_manager.cc:1916] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.785094 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 69) took 6466 ms. Trace:
I20260925 01:49:53.786260 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:53.786366 11946 rpcz_store.cc:276] 0925 01:49:47.318351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.318468 (+ 117us) service_pool.cc:224] Handling call
0925 01:49:53.784905 (+6466437us) ts_tablet_manager.cc:1151] Deleting tablet 38082c23d99148bb916b0ae74fd474b8
0925 01:49:53.784917 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.785041 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6423991}
I20260925 01:49:53.786993 11380 raft_consensus.cc:3060] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:53.787603 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 38082c23d99148bb916b0ae74fd474b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38082c23d99148bb916b0ae74fd474b8 already in progress: creating tablet
I20260925 01:49:53.788216 11946 tablet_replica.cc:333] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.789134 11946 raft_consensus.cc:2243] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.790220 11946 raft_consensus.cc:2272] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.792686 11946 ts_tablet_manager.cc:1916] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.799355 11931 ts_tablet_manager.cc:1929] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.799539 11931 log.cc:1199] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ccffbe61eea34333abdc6da94612c0f6
I20260925 01:49:53.799909 11931 ts_tablet_manager.cc:1950] T ccffbe61eea34333abdc6da94612c0f6 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.800758 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 247) took 1911 ms. Trace:
I20260925 01:49:53.800885 11931 rpcz_store.cc:276] 0925 01:49:51.889578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.906379 (+ 16801us) service_pool.cc:224] Handling call
0925 01:49:53.768861 (+1862482us) ts_tablet_manager.cc:1151] Deleting tablet ccffbe61eea34333abdc6da94612c0f6
0925 01:49:53.768873 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.779625 (+ 10752us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.799264 (+ 19639us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.800701 (+ 1437us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1862209}
I20260925 01:49:53.801429 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ccffbe61eea34333abdc6da94612c0f6 (table default.Table_b2c32d1c9f694835aa159840a4024f00 [id=fd0ffd9fb56b40f590be7bd7b9128f45]) successfully deleted
I20260925 01:49:53.802006 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 252) took 1830 ms. Trace:
I20260925 01:49:53.802182 11931 rpcz_store.cc:276] 0925 01:49:51.971148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.971360 (+ 212us) service_pool.cc:224] Handling call
0925 01:49:53.801804 (+1830444us) ts_tablet_manager.cc:1151] Deleting tablet 4f19bccf3c5540cb828ec7bfc89a1c17
0925 01:49:53.801816 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.801937 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1826169}
W20260925 01:49:53.802814 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f19bccf3c5540cb828ec7bfc89a1c17 already in progress: creating tablet
I20260925 01:49:53.803331 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 254) took 1827 ms. Trace:
I20260925 01:49:53.803478 11931 rpcz_store.cc:276] 0925 01:49:51.976350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.976446 (+ 96us) service_pool.cc:224] Handling call
0925 01:49:53.803158 (+1826712us) ts_tablet_manager.cc:1151] Deleting tablet f1b6ea676a1f4d99807029d8401251ef
0925 01:49:53.803169 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.803277 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1809261}
W20260925 01:49:53.804044 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f1b6ea676a1f4d99807029d8401251ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1b6ea676a1f4d99807029d8401251ef already in progress: creating tablet
I20260925 01:49:53.804558 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 255) took 1811 ms. Trace:
I20260925 01:49:53.804729 11931 rpcz_store.cc:276] 0925 01:49:51.993567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.993631 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:53.804380 (+1810749us) ts_tablet_manager.cc:1151] Deleting tablet 30a5240093dd442a93bff006a965bc41
0925 01:49:53.804390 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.804496 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1796891}
W20260925 01:49:53.805423 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 30a5240093dd442a93bff006a965bc41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30a5240093dd442a93bff006a965bc41 already in progress: creating tablet
I20260925 01:49:53.805930 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 258) took 1739 ms. Trace:
I20260925 01:49:53.806115 11931 rpcz_store.cc:276] 0925 01:49:52.066733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.066799 (+ 66us) service_pool.cc:224] Handling call
0925 01:49:53.805743 (+1738944us) ts_tablet_manager.cc:1151] Deleting tablet 24cd89d238bf4220a48ecdf59cca5e6d
0925 01:49:53.805752 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.805868 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1738704}
W20260925 01:49:53.806646 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 24cd89d238bf4220a48ecdf59cca5e6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24cd89d238bf4220a48ecdf59cca5e6d already in progress: creating tablet
I20260925 01:49:53.807140 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 259) took 1739 ms. Trace:
I20260925 01:49:53.807296 11931 rpcz_store.cc:276] 0925 01:49:52.067724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.067780 (+ 56us) service_pool.cc:224] Handling call
0925 01:49:53.806946 (+1739166us) ts_tablet_manager.cc:1151] Deleting tablet 31ecfc5a2a80449c9905c83b6bcb3652
0925 01:49:53.806970 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.807083 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1738941}
W20260925 01:49:53.807821 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 31ecfc5a2a80449c9905c83b6bcb3652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ecfc5a2a80449c9905c83b6bcb3652 already in progress: creating tablet
I20260925 01:49:53.808295 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 260) took 1737 ms. Trace:
I20260925 01:49:53.808430 11931 rpcz_store.cc:276] 0925 01:49:52.070522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.070591 (+ 69us) service_pool.cc:224] Handling call
0925 01:49:53.808147 (+1737556us) ts_tablet_manager.cc:1151] Deleting tablet 329a5af9fb654d4c894e1cf4fd636c13
0925 01:49:53.808156 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.808241 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1737357}
W20260925 01:49:53.808914 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 329a5af9fb654d4c894e1cf4fd636c13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329a5af9fb654d4c894e1cf4fd636c13 already in progress: creating tablet
I20260925 01:49:53.809352 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 257) took 1750 ms. Trace:
I20260925 01:49:53.809485 11931 rpcz_store.cc:276] 0925 01:49:52.059400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.071216 (+ 11816us) service_pool.cc:224] Handling call
0925 01:49:53.809210 (+1737994us) ts_tablet_manager.cc:1151] Deleting tablet 1f1d2d998d834c21ab83694daae37520
0925 01:49:53.809220 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.809302 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1737725}
W20260925 01:49:53.810041 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1f1d2d998d834c21ab83694daae37520 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f1d2d998d834c21ab83694daae37520 already in progress: creating tablet
I20260925 01:49:53.810595 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 261) took 1725 ms. Trace:
I20260925 01:49:53.810750 11931 rpcz_store.cc:276] 0925 01:49:52.085161 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.086500 (+ 1339us) service_pool.cc:224] Handling call
0925 01:49:53.810409 (+1723909us) ts_tablet_manager.cc:1151] Deleting tablet a9944a1422d14ae2b22451e67c477d5b
0925 01:49:53.810421 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.810529 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1715957}
W20260925 01:49:53.811376 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a9944a1422d14ae2b22451e67c477d5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9944a1422d14ae2b22451e67c477d5b already in progress: creating tablet
I20260925 01:49:53.811813 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 253) took 1837 ms. Trace:
I20260925 01:49:53.812045 11931 rpcz_store.cc:276] 0925 01:49:51.974789 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.087592 (+112803us) service_pool.cc:224] Handling call
0925 01:49:53.811674 (+1724082us) ts_tablet_manager.cc:1151] Deleting tablet 35b123ac1e894239875404438ed19927
0925 01:49:53.811682 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.811762 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1716985}
W20260925 01:49:53.812556 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 35b123ac1e894239875404438ed19927 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35b123ac1e894239875404438ed19927 already in progress: creating tablet
I20260925 01:49:53.812980 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 268) took 1690 ms. Trace:
I20260925 01:49:53.813997 11380 raft_consensus.cc:2468] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:49:53.814724 11931 rpcz_store.cc:276] 0925 01:49:52.122737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.122802 (+ 65us) service_pool.cc:224] Handling call
0925 01:49:53.812828 (+1690026us) ts_tablet_manager.cc:1151] Deleting tablet c28c8f00a8634ef89e4773b62e095b74
0925 01:49:53.812838 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.812916 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1654803}
W20260925 01:49:53.815254 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c28c8f00a8634ef89e4773b62e095b74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c28c8f00a8634ef89e4773b62e095b74 already in progress: creating tablet
I20260925 01:49:53.815675 11931 tablet_replica.cc:333] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.815981 11931 raft_consensus.cc:2243] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.816041 11946 ts_tablet_manager.cc:1929] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.816250 11931 raft_consensus.cc:2272] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.816988 11931 ts_tablet_manager.cc:1916] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.817371 11177 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:53.818011 12263 raft_consensus.cc:2804] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:53.818931 11946 log.cc:1199] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:53.819741 12263 raft_consensus.cc:697] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:49:53.819820 11946 ts_tablet_manager.cc:1950] T 02f9e96bcdf9418ea54dc73bf68a2be6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.821467 12263 consensus_queue.cc:237] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.823400 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 78) took 6387 ms. Trace:
I20260925 01:49:53.823892 11946 rpcz_store.cc:276] 0925 01:49:47.435959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.436014 (+ 55us) service_pool.cc:224] Handling call
0925 01:49:53.788081 (+6352067us) ts_tablet_manager.cc:1151] Deleting tablet 02f9e96bcdf9418ea54dc73bf68a2be6
0925 01:49:53.788092 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.803383 (+ 15291us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.815955 (+ 12572us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.823332 (+ 7377us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6349484}
I20260925 01:49:53.825435 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 02f9e96bcdf9418ea54dc73bf68a2be6 (table default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]) successfully deleted
I20260925 01:49:53.827128 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 79) took 6376 ms. Trace:
I20260925 01:49:53.828217 11946 rpcz_store.cc:276] 0925 01:49:47.450240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.450313 (+ 73us) service_pool.cc:224] Handling call
0925 01:49:53.826896 (+6376583us) ts_tablet_manager.cc:1151] Deleting tablet 347a144e18ab4f6e834551044a2ac4ae
0925 01:49:53.826911 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.827046 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6376260}
W20260925 01:49:53.829509 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 347a144e18ab4f6e834551044a2ac4ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 347a144e18ab4f6e834551044a2ac4ae already in progress: creating tablet
I20260925 01:49:53.830670 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 00906edfa6b648229bcba8e59d68b969 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:53.830922 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 77) took 6396 ms. Trace:
I20260925 01:49:53.832188 11946 rpcz_store.cc:276] 0925 01:49:47.434375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.434440 (+ 65us) service_pool.cc:224] Handling call
0925 01:49:53.830652 (+6396212us) ts_tablet_manager.cc:1151] Deleting tablet 19c718c83cfe49b9a745e06314e24409
0925 01:49:53.830668 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.830857 (+ 189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6375421}
W20260925 01:49:53.833307 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 19c718c83cfe49b9a745e06314e24409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19c718c83cfe49b9a745e06314e24409 already in progress: creating tablet
I20260925 01:49:53.834088 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 82) took 6382 ms. Trace:
I20260925 01:49:53.835217 11946 rpcz_store.cc:276] 0925 01:49:47.451959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.452007 (+ 48us) service_pool.cc:224] Handling call
0925 01:49:53.833831 (+6381824us) ts_tablet_manager.cc:1151] Deleting tablet 55e9d52e3f79408a99216250aefc45c8
0925 01:49:53.833846 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.833987 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6377938}
W20260925 01:49:53.836310 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 55e9d52e3f79408a99216250aefc45c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55e9d52e3f79408a99216250aefc45c8 already in progress: creating tablet
I20260925 01:49:53.837002 11946 tablet_replica.cc:333] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.837931 11931 ts_tablet_manager.cc:1929] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.838097 11931 log.cc:1199] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ba19192502634f8599407d923114a627
I20260925 01:49:53.838516 11931 ts_tablet_manager.cc:1950] T ba19192502634f8599407d923114a627 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.837953 11946 raft_consensus.cc:2243] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.839095 11946 raft_consensus.cc:2272] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.839636 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 269) took 1681 ms. Trace:
I20260925 01:49:53.839763 11931 rpcz_store.cc:276] 0925 01:49:52.157934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.158005 (+ 71us) service_pool.cc:224] Handling call
0925 01:49:53.815575 (+1657570us) ts_tablet_manager.cc:1151] Deleting tablet ba19192502634f8599407d923114a627
0925 01:49:53.815588 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.834291 (+ 18703us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.837819 (+ 3528us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.839597 (+ 1778us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1657274}
I20260925 01:49:53.840288 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ba19192502634f8599407d923114a627 (table default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915]) successfully deleted
I20260925 01:49:53.840830 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 285) took 1546 ms. Trace:
I20260925 01:49:53.841079 11931 rpcz_store.cc:276] 0925 01:49:52.294511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.294585 (+ 74us) service_pool.cc:224] Handling call
0925 01:49:53.840598 (+1546013us) ts_tablet_manager.cc:1151] Deleting tablet 226498ea628a475d8fcab28a6598a819
0925 01:49:53.840608 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.840792 (+ 184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1542770}
W20260925 01:49:53.841533 11456 consensus_peers.cc:597] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8bf42293dd5d452aa7ed9e0eaa78f54d. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:53.841677 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 226498ea628a475d8fcab28a6598a819 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 226498ea628a475d8fcab28a6598a819 already in progress: creating tablet
I20260925 01:49:53.842079 11931 tablet_replica.cc:333] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.841771 11946 ts_tablet_manager.cc:1916] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.842404 11931 raft_consensus.cc:2243] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.842653 11676 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet e245efe3485e4ae681f4621bd8608168
I20260925 01:49:53.842633 11931 raft_consensus.cc:2272] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.843321 11931 ts_tablet_manager.cc:1916] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.844343 12448 tablet.cc:1751] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260925 01:49:53.844741 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60411b0feafe4fef9c4fdc364163f1df consensus state has no leader
I20260925 01:49:53.845077 11671 master_service.cc:960] ReplaceTablet: received request to replace tablet b91957f62d8044ea8f6a3464c84b9e10 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:53.852679 12288 raft_consensus.cc:493] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.852880 12288 raft_consensus.cc:515] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.853597 12288 leader_election.cc:290] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.855319 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3358b78a1da48388d1f72536b1ed0a2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:53.855623 11237 raft_consensus.cc:2468] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:53.859822 12080 raft_consensus.cc:493] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:53.860149 12080 raft_consensus.cc:515] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.860988 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f9bc2f31552244b3a2372edb87acf2e8" } modify_external_catalogs: true
I20260925 01:49:53.861227 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f9bc2f31552244b3a2372edb87acf2e8" } modify_external_catalogs: true
I20260925 01:49:53.861431 12080 leader_election.cc:290] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.861708 11931 ts_tablet_manager.cc:1929] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.861625 11456 leader_election.cc:304] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.862017 11931 log.cc:1199] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/67921f86c4f6422e97d7f306262569f8
I20260925 01:49:53.862185 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5995b17dc74742079004a9f3dadc82b8" } modify_external_catalogs: true
I20260925 01:49:53.862260 12288 raft_consensus.cc:2804] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.862424 12288 raft_consensus.cc:493] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.862563 12288 raft_consensus.cc:3060] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.862540 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5995b17dc74742079004a9f3dadc82b8" } modify_external_catalogs: true
I20260925 01:49:53.862798 11931 ts_tablet_manager.cc:1950] T 67921f86c4f6422e97d7f306262569f8 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.863940 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 286) took 1392 ms. Trace:
I20260925 01:49:53.863957 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e310d52dc129451da019692eab3b9328" } modify_external_catalogs: true
I20260925 01:49:53.864193 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e310d52dc129451da019692eab3b9328" } modify_external_catalogs: true
I20260925 01:49:53.864106 11931 rpcz_store.cc:276] 0925 01:49:52.471068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.471246 (+ 178us) service_pool.cc:224] Handling call
0925 01:49:53.841940 (+1370694us) ts_tablet_manager.cc:1151] Deleting tablet 67921f86c4f6422e97d7f306262569f8
0925 01:49:53.841951 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.857222 (+ 15271us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.861621 (+ 4399us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.863824 (+ 2203us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1355384}
I20260925 01:49:53.864866 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 67921f86c4f6422e97d7f306262569f8 (table default.Table_c33c7eb6481e4876aed3d7038afa9f93 [id=107d0cda55154f5e84ce4dd14d36364a]) successfully deleted
I20260925 01:49:53.866509 12288 raft_consensus.cc:515] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.866796 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_de391fb6f42d400bacfbad86f1b7198e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.867511 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de391fb6f42d400bacfbad86f1b7198e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.868278 12288 leader_election.cc:290] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.870576 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3358b78a1da48388d1f72536b1ed0a2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:53.870843 11237 raft_consensus.cc:3060] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.872645 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 287) took 1394 ms. Trace:
I20260925 01:49:53.872844 11931 rpcz_store.cc:276] 0925 01:49:52.481189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.481280 (+ 91us) service_pool.cc:224] Handling call
0925 01:49:53.872125 (+1390845us) ts_tablet_manager.cc:1151] Deleting tablet 8afcf8f6d0e24472a3190059df032698
0925 01:49:53.872139 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.872335 (+ 196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1384273}
W20260925 01:49:53.873603 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8afcf8f6d0e24472a3190059df032698 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8afcf8f6d0e24472a3190059df032698 already in progress: creating tablet
I20260925 01:49:53.874289 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 289) took 1386 ms. Trace:
I20260925 01:49:53.874387 11931 rpcz_store.cc:276] 0925 01:49:52.488223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.488833 (+ 610us) service_pool.cc:224] Handling call
0925 01:49:53.873990 (+1385157us) ts_tablet_manager.cc:1151] Deleting tablet 818a792969a245f5b0fe5f80128206ba
0925 01:49:53.874001 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.874162 (+ 161us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383652}
W20260925 01:49:53.875216 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 818a792969a245f5b0fe5f80128206ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 818a792969a245f5b0fe5f80128206ba already in progress: creating tablet
I20260925 01:49:53.875926 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 288) took 1389 ms. Trace:
I20260925 01:49:53.875975 11314 leader_election.cc:304] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:53.876019 11931 rpcz_store.cc:276] 0925 01:49:52.486925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.487057 (+ 132us) service_pool.cc:224] Handling call
0925 01:49:53.875567 (+1388510us) ts_tablet_manager.cc:1151] Deleting tablet 7347b31f782c4508b004c7523dc11dbb
0925 01:49:53.875579 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.875864 (+ 285us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1371605}
I20260925 01:49:53.876327 12439 raft_consensus.cc:493] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:53.876621 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 7347b31f782c4508b004c7523dc11dbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7347b31f782c4508b004c7523dc11dbb already in progress: creating tablet
I20260925 01:49:53.876734 12439 raft_consensus.cc:515] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:53.877398 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 031687d4b26b4c7889dfbe3485c9f4c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 031687d4b26b4c7889dfbe3485c9f4c5 already in progress: creating tablet
I20260925 01:49:53.877986 12439 leader_election.cc:290] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:53.878098 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 0b92054aaa704c7ebd6b075c30db2616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b92054aaa704c7ebd6b075c30db2616 already in progress: creating tablet
I20260925 01:49:53.878667 12439 raft_consensus.cc:2804] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:49:53.878769 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 81024a75b31e45e098d108bae4cc17c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81024a75b31e45e098d108bae4cc17c9 already in progress: creating tablet
I20260925 01:49:53.879025 12439 raft_consensus.cc:697] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
W20260925 01:49:53.879382 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 829d167dc0214890b722c0197500f159 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 829d167dc0214890b722c0197500f159 already in progress: creating tablet
I20260925 01:49:53.879352 12439 consensus_queue.cc:237] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:53.880077 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9771b89303094974902c4ad1f1c8608e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9771b89303094974902c4ad1f1c8608e already in progress: creating tablet
I20260925 01:49:53.880424 11931 tablet_replica.cc:333] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.880757 11931 raft_consensus.cc:2243] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.881004 11931 raft_consensus.cc:2272] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.881639 11931 ts_tablet_manager.cc:1916] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.884859 11946 ts_tablet_manager.cc:1929] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.884994 11946 log.cc:1199] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e686dff5ada64f05a1c7bd914c1377a4
I20260925 01:49:53.885464 11946 ts_tablet_manager.cc:1950] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.885905 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 84) took 6370 ms. Trace:
I20260925 01:49:53.886018 11946 rpcz_store.cc:276] 0925 01:49:47.515235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.515465 (+ 230us) service_pool.cc:224] Handling call
0925 01:49:53.836888 (+6321423us) ts_tablet_manager.cc:1151] Deleting tablet e686dff5ada64f05a1c7bd914c1377a4
0925 01:49:53.836903 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.868994 (+ 32091us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.884768 (+ 15774us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.885873 (+ 1105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6310338}
I20260925 01:49:53.886611 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e686dff5ada64f05a1c7bd914c1377a4 (table default.Table_4b87558f2a98419f96b453a44aae814b [id=a1a3b3d0054a4bff8de55b5c5e71880f]) successfully deleted
I20260925 01:49:53.887905 11754 tablet_bootstrap.cc:492] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:53.888063 11754 ts_tablet_manager.cc:1403] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.214s user 0.007s sys 0.008s
I20260925 01:49:53.888916 11754 raft_consensus.cc:359] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.889089 11754 raft_consensus.cc:385] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.889178 11754 raft_consensus.cc:740] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.889393 11754 consensus_queue.cc:260] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.889969 11754 ts_tablet_manager.cc:1434] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:53.890339 11754 tablet_bootstrap.cc:492] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:53.891907 11237 raft_consensus.cc:2468] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:53.892095 11754 tablet_bootstrap.cc:654] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.892484 11456 leader_election.cc:304] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.892794 12288 raft_consensus.cc:2804] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:53.892939 12288 raft_consensus.cc:697] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:53.893186 12288 consensus_queue.cc:237] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.895459 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet 96b68399843a422b8da3ddfab2c522e6 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:53.896589 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 200caea41ba4466386b091875f017956 with delete_type TABLET_DATA_DELETED (replaced by tablet 17352fd6ea4e4ed9a178f1510edf4f6d) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:53.896703 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 with delete_type TABLET_DATA_DELETED (replaced by tablet b60706e2087b4ec7b63f6747534a4b0f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:53.896697 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:53.897183 11314 leader_election.cc:343] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:53.898839 11314 leader_election.cc:304] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.899221 12425 raft_consensus.cc:2804] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.899340 12425 raft_consensus.cc:493] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.899471 12425 raft_consensus.cc:3060] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.901432 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_45d17895ee264b84af096afd02e99ad0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.902262 11314 leader_election.cc:304] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:53.903594 12425 raft_consensus.cc:515] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.904382 12425 leader_election.cc:290] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.904644 12426 raft_consensus.cc:2804] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:53.904747 12426 raft_consensus.cc:493] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:53.905009 12426 raft_consensus.cc:3060] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:53.906983 12452 tablet.cc:1751] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:49:53.907451 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_98e49819b069428c81b83d226192a743" } new_table_name: "default.Table_17cf387aca9e4b949195e91a5101157e" modify_external_catalogs: true
I20260925 01:49:53.908070 11753 tablet_bootstrap.cc:492] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.908244 11753 ts_tablet_manager.cc:1403] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.186s user 0.023s sys 0.019s
I20260925 01:49:53.908345 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8e5d86dc0f4d4b34b354608684b3b584"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:53.908804 12426 raft_consensus.cc:515] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.909042 11753 raft_consensus.cc:359] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.909247 11753 raft_consensus.cc:385] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.909682 12426 leader_election.cc:290] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:53.916723 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 83) took 6425 ms. Trace:
I20260925 01:49:53.917032 11946 rpcz_store.cc:276] 0925 01:49:47.491334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.499740 (+ 8406us) service_pool.cc:224] Handling call
0925 01:49:53.916475 (+6416735us) ts_tablet_manager.cc:1151] Deleting tablet 039ee80a2822417898c1d1d779f52867
0925 01:49:53.916486 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.916636 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6388943}
I20260925 01:49:53.917865 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 85) took 6347 ms. Trace:
W20260925 01:49:53.917860 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 039ee80a2822417898c1d1d779f52867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 039ee80a2822417898c1d1d779f52867 already in progress: creating tablet
I20260925 01:49:53.912099 11931 ts_tablet_manager.cc:1929] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:53.918547 11931 log.cc:1199] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c28c9e51d80a442486b78be32c74a94f
I20260925 01:49:53.918172 11946 rpcz_store.cc:276] 0925 01:49:47.570600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.571086 (+ 486us) service_pool.cc:224] Handling call
0925 01:49:53.917634 (+6346548us) ts_tablet_manager.cc:1151] Deleting tablet 4d7b3c65d8a64734b2c432790dae07e1
0925 01:49:53.917644 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.917789 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6346252}
I20260925 01:49:53.918911 12443 raft_consensus.cc:493] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.919114 11931 ts_tablet_manager.cc:1950] T c28c9e51d80a442486b78be32c74a94f P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:53.909330 11753 raft_consensus.cc:740] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:49:53.919538 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 4d7b3c65d8a64734b2c432790dae07e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d7b3c65d8a64734b2c432790dae07e1 already in progress: creating tablet
I20260925 01:49:53.919219 12443 raft_consensus.cc:515] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.919943 11753 consensus_queue.cc:260] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.920279 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c28c9e51d80a442486b78be32c74a94f (table default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727]) successfully deleted
I20260925 01:49:53.920406 11946 tablet_replica.cc:333] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.920697 11946 raft_consensus.cc:2243] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.920734 11931 tablet_replica.cc:333] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:53.921015 12443 leader_election.cc:290] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.921451 11931 raft_consensus.cc:2243] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:53.921821 11931 pending_rounds.cc:70] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:53.921969 11931 pending_rounds.cc:77] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072869460819968 op_type: NO_OP noop_request { }
I20260925 01:49:53.922152 11931 raft_consensus.cc:2889] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260925 01:49:53.923044 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c5021ab79dc4eaf9ed612f7125a6dca consensus state has no leader
I20260925 01:49:53.924309 11931 raft_consensus.cc:2272] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.924618 11946 raft_consensus.cc:2272] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.925621 11946 ts_tablet_manager.cc:1916] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:53.928643 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45d17895ee264b84af096afd02e99ad0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.924938 11753 ts_tablet_manager.cc:1434] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s
W20260925 01:49:53.929116 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e5d86dc0f4d4b34b354608684b3b584 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.931335 11753 tablet_bootstrap.cc:492] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.933277 11753 tablet_bootstrap.cc:654] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.935051 11755 tablet_bootstrap.cc:492] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:53.935281 11755 ts_tablet_manager.cc:1403] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.325s user 0.001s sys 0.010s
I20260925 01:49:53.936067 11755 raft_consensus.cc:359] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.936347 11755 raft_consensus.cc:385] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.936460 11755 raft_consensus.cc:740] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.936785 11755 consensus_queue.cc:260] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.937784 11755 ts_tablet_manager.cc:1434] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:53.949537 12288 raft_consensus.cc:493] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:53.949719 12288 raft_consensus.cc:515] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:53.940833 11314 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5acd5d878aac4261a7294e87304c9dfc
W20260925 01:49:53.951254 11314 consensus_peers.cc:597] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31fe174270f24ff780c212eaef90ef0d. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:53.951449 12288 leader_election.cc:290] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:53.952559 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82ac4f3b4d48fbbb33c21f5630d749" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.953652 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da92b7f256647f19faeed66b4012438" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.954043 11946 ts_tablet_manager.cc:1929] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.954619 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99913eb35197442880a27b3c288237f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:53.955237 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99913eb35197442880a27b3c288237f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.943828 11953 ts_tablet_manager.cc:1929] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:53.955740 11953 log.cc:1199] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8d208d580a2c4c27bd614ccc88088384
I20260925 01:49:53.956338 11953 ts_tablet_manager.cc:1950] T 8d208d580a2c4c27bd614ccc88088384 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:53.956740 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_84db866c4d6145caa30bfc8b43b0c182"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:53.957808 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84db866c4d6145caa30bfc8b43b0c182 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:53.956599 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "357963616763428fa69c7670e760f84e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.957643 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5acd5d878aac4261a7294e87304c9dfc" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.957868 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f421bb962e407c8b459eaad6e45b61" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:53.958717 11376 raft_consensus.cc:2393] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:53.959111 11372 raft_consensus.cc:2468] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:53.960486 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 56) took 7138 ms. Trace:
I20260925 01:49:53.960922 11946 log.cc:1199] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5acd5d878aac4261a7294e87304c9dfc
I20260925 01:49:53.961645 11946 ts_tablet_manager.cc:1950] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:53.958637 11753 tablet_bootstrap.cc:492] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.962667 11753 ts_tablet_manager.cc:1403] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.001s
I20260925 01:49:53.963781 11753 raft_consensus.cc:359] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.964111 11753 raft_consensus.cc:385] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.964274 11753 raft_consensus.cc:740] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.964668 11753 consensus_queue.cc:260] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:53.968245 11753 ts_tablet_manager.cc:1434] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:49:53.970902 11753 tablet_bootstrap.cc:492] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:53.973091 11753 tablet_bootstrap.cc:654] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:53.973856 11953 rpcz_store.cc:276] 0925 01:49:46.821802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.821860 (+ 58us) service_pool.cc:224] Handling call
0925 01:49:53.757393 (+6935533us) ts_tablet_manager.cc:1151] Deleting tablet 8d208d580a2c4c27bd614ccc88088384
0925 01:49:53.757407 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.825503 (+ 68096us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.943701 (+118198us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.960431 (+ 16730us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6935317}
I20260925 01:49:53.974601 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 8d208d580a2c4c27bd614ccc88088384 (table default.Table_95548c275bf74095b2d15cdf54943a63 [id=714713ea01ec47988a90f3bbc06fee3e]) successfully deleted
I20260925 01:49:53.974851 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 67) took 6866 ms. Trace:
I20260925 01:49:53.975056 11953 rpcz_store.cc:276] 0925 01:49:47.107945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.121337 (+ 13392us) service_pool.cc:224] Handling call
0925 01:49:53.974582 (+6853245us) ts_tablet_manager.cc:1151] Deleting tablet 596f8ddbcd16458aa4f287f4f11282a1
0925 01:49:53.974592 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.974714 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6852941}
I20260925 01:49:53.975747 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 68) took 6816 ms. Trace:
I20260925 01:49:53.975921 11953 rpcz_store.cc:276] 0925 01:49:47.159197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.159275 (+ 78us) service_pool.cc:224] Handling call
0925 01:49:53.975577 (+6816302us) ts_tablet_manager.cc:1151] Deleting tablet 38082c23d99148bb916b0ae74fd474b8
0925 01:49:53.975589 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.975716 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6816041}
W20260925 01:49:53.976395 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 596f8ddbcd16458aa4f287f4f11282a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 596f8ddbcd16458aa4f287f4f11282a1 already in progress: creating tablet
W20260925 01:49:53.976749 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 38082c23d99148bb916b0ae74fd474b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38082c23d99148bb916b0ae74fd474b8 already in progress: creating tablet
I20260925 01:49:53.978713 11953 tablet_replica.cc:333] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:53.965551 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 86) took 6394 ms. Trace:
I20260925 01:49:53.980054 11946 rpcz_store.cc:276] 0925 01:49:47.570785 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.571408 (+ 623us) service_pool.cc:224] Handling call
0925 01:49:53.920285 (+6348877us) ts_tablet_manager.cc:1151] Deleting tablet 5acd5d878aac4261a7294e87304c9dfc
0925 01:49:53.920294 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.940731 (+ 20437us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.953966 (+ 13235us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:53.965491 (+ 11525us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6348630}
I20260925 01:49:53.980634 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5acd5d878aac4261a7294e87304c9dfc (table default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded]) successfully deleted
I20260925 01:49:53.980975 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 96) took 6005 ms. Trace:
I20260925 01:49:53.981115 12459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.252:44823 every 8 connection(s)
I20260925 01:49:53.981201 11946 rpcz_store.cc:276] 0925 01:49:47.975032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.982716 (+ 7684us) service_pool.cc:224] Handling call
0925 01:49:53.980736 (+5998020us) ts_tablet_manager.cc:1151] Deleting tablet e2b9df8d98e5414186ef23b8b7f9cb61
0925 01:49:53.980753 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.980911 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5992742}
W20260925 01:49:53.981817 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e2b9df8d98e5414186ef23b8b7f9cb61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2b9df8d98e5414186ef23b8b7f9cb61 already in progress: creating tablet
I20260925 01:49:53.982539 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 97) took 5780 ms. Trace:
I20260925 01:49:53.982672 11946 rpcz_store.cc:276] 0925 01:49:48.202452 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.222999 (+ 20547us) service_pool.cc:224] Handling call
0925 01:49:53.982376 (+5759377us) ts_tablet_manager.cc:1151] Deleting tablet ca17585cd523440ca1e9b754f3aedf8a
0925 01:49:53.982385 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.982486 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5759130}
I20260925 01:49:53.983492 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 99) took 5758 ms. Trace:
I20260925 01:49:53.983634 11946 rpcz_store.cc:276] 0925 01:49:48.224594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.224678 (+ 84us) service_pool.cc:224] Handling call
0925 01:49:53.983343 (+5758665us) ts_tablet_manager.cc:1151] Deleting tablet 5b65068a447744ec99e56489963b251c
0925 01:49:53.983351 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.983430 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5758331}
W20260925 01:49:53.984086 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5b65068a447744ec99e56489963b251c because the tablet was not found. No further retry: Not found: Tablet not found: 5b65068a447744ec99e56489963b251c
I20260925 01:49:53.984465 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 98) took 5760 ms. Trace:
I20260925 01:49:53.984609 11946 rpcz_store.cc:276] 0925 01:49:48.224438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.225357 (+ 919us) service_pool.cc:224] Handling call
0925 01:49:53.984353 (+5758996us) ts_tablet_manager.cc:1151] Deleting tablet c75a4ed161734d30ab5ad2e2b00d77c9
0925 01:49:53.984361 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.984417 (+ 56us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5758743}
W20260925 01:49:53.985373 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c75a4ed161734d30ab5ad2e2b00d77c9 because the tablet was not found. No further retry: Not found: Tablet not found: c75a4ed161734d30ab5ad2e2b00d77c9
I20260925 01:49:53.985737 11946 tablet_replica.cc:333] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:53.985965 11946 raft_consensus.cc:2243] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:53.986241 11946 raft_consensus.cc:2272] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.985023 11973 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.252:44823
I20260925 01:49:53.986900 11946 ts_tablet_manager.cc:1916] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:53.988771 11973 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-2/data/info.pb
I20260925 01:49:53.988095 11753 tablet_bootstrap.cc:492] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:53.989079 11753 ts_tablet_manager.cc:1403] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.002s
I20260925 01:49:53.991062 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c30cad1a9ce0463e9076a14f144ba438" } new_table_name: "default.Table_2c03f5553b874ed2b3b044920af7cf4e" modify_external_catalogs: true
I20260925 01:49:53.990082 11753 raft_consensus.cc:359] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.991750 11753 raft_consensus.cc:385] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:53.991852 11753 raft_consensus.cc:740] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:53.992939 11753 consensus_queue.cc:260] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:53.996906 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 11973
I20260925 01:49:54.004714 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dd27c6d835948ba859b4c11d8ebf783" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:53.972657 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e686dff5ada64f05a1c7bd914c1377a4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.014526 11376 raft_consensus.cc:2468] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:54.017198 11953 raft_consensus.cc:2243] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:54.017266 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b61b1bf5a8d446918edc6d166b7712ef consensus state has no leader
I20260925 01:49:54.017648 11953 raft_consensus.cc:2272] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:53.973340 11372 raft_consensus.cc:1275] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Refusing update from remote peer 514f31e4c2e54d9aaf6d4dd771d153b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:53.961674 11755 tablet_bootstrap.cc:492] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:53.979949 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3358b78a1da48388d1f72536b1ed0a2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:53.980448 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3358b78a1da48388d1f72536b1ed0a2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:54.018766 11953 ts_tablet_manager.cc:1916] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.018828 11380 raft_consensus.cc:2468] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:53.981585 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccffbe61eea34333abdc6da94612c0f6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.020460 11753 ts_tablet_manager.cc:1434] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260925 01:49:54.021129 11931 ts_tablet_manager.cc:1916] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.020463 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba19192502634f8599407d923114a627" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:54.022109 11965 raft_consensus.cc:493] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac4ec033f794d7a90b52aa4e0b6155d)
I20260925 01:49:54.022735 11755 tablet_bootstrap.cc:654] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.023929 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00906edfa6b648229bcba8e59d68b969" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:54.024132 11241 raft_consensus.cc:3060] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.025002 11753 tablet_bootstrap.cc:492] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:54.026744 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a9106d4e06b248f9ae0595a67271be8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:54.027243 11965 raft_consensus.cc:515] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:54.027848 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9106d4e06b248f9ae0595a67271be8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.028802 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f28e49791744428729279a79b6c9f1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.030304 11965 leader_election.cc:290] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:54.033255 11755 tablet_bootstrap.cc:492] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:54.033420 11755 ts_tablet_manager.cc:1403] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.001s
I20260925 01:49:54.034253 11755 raft_consensus.cc:359] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.034435 12462 sys_catalog.cc:263] Verifying existing consensus state
I20260925 01:49:54.034454 11755 raft_consensus.cc:385] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.034543 11755 raft_consensus.cc:740] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.032874 11241 raft_consensus.cc:2468] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:54.034759 11755 consensus_queue.cc:260] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:54.013967 11314 leader_election.cc:343] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:54.037869 11314 leader_election.cc:343] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.038254 11314 leader_election.cc:304] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.038671 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8551fb43d7e448a785a0c245e233db74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.039354 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8551fb43d7e448a785a0c245e233db74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.046434 12445 raft_consensus.cc:2804] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:54.046612 12445 raft_consensus.cc:493] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:54.046914 12445 raft_consensus.cc:3060] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
W20260925 01:49:54.047744 11314 consensus_peers.cc:597] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31fe174270f24ff780c212eaef90ef0d. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:54.049698 11755 ts_tablet_manager.cc:1434] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.016s user 0.003s sys 0.000s
I20260925 01:49:54.051013 11314 leader_election.cc:304] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.051179 12445 raft_consensus.cc:515] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.051820 12445 leader_election.cc:290] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.052343 12439 raft_consensus.cc:2749] T e7f421bb962e407c8b459eaad6e45b61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.053314 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f2f552e0658044e3b5909c7910548ce0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.054266 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2f552e0658044e3b5909c7910548ce0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.058766 11755 tablet_bootstrap.cc:492] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:54.059587 11953 ts_tablet_manager.cc:1929] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:54.062803 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3a517bf44028408ba6e42751020cdd64" } new_table_name: "default.Table_8d20c9d9083d44d1a86ba727ee87b628" modify_external_catalogs: true
I20260925 01:49:54.064381 11953 log.cc:1199] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/200caea41ba4466386b091875f017956
I20260925 01:49:54.065120 11953 ts_tablet_manager.cc:1950] T 200caea41ba4466386b091875f017956 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:54.071120 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 69) took 6870 ms. Trace:
W20260925 01:49:54.071656 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 236db241476a4a609869aad539fee426 has no consensus state
I20260925 01:49:54.072432 11931 ts_tablet_manager.cc:1929] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:54.072598 11931 log.cc:1199] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ca76f6f710d841fd8999b40e5a48693f
I20260925 01:49:54.073074 11931 ts_tablet_manager.cc:1950] T ca76f6f710d841fd8999b40e5a48693f P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:54.073009 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d12ae3dd5f37487295db3494777287c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.073851 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d12ae3dd5f37487295db3494777287c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.074340 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ca76f6f710d841fd8999b40e5a48693f (table default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87]) successfully deleted
I20260925 01:49:54.077275 12462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Bootstrap starting.
W20260925 01:49:54.062697 11314 leader_election.cc:343] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: e686dff5ada64f05a1c7bd914c1377a4
I20260925 01:49:54.061474 11755 tablet_bootstrap.cc:654] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.077669 11518 raft_consensus.cc:3060] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.078518 11754 tablet_bootstrap.cc:492] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:54.078711 11754 ts_tablet_manager.cc:1403] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.188s user 0.015s sys 0.062s
W20260925 01:49:54.079401 11314 leader_election.cc:343] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.079581 11754 raft_consensus.cc:359] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.079798 11754 raft_consensus.cc:385] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.079885 11754 raft_consensus.cc:740] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:54.081827 11314 leader_election.cc:343] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e686dff5ada64f05a1c7bd914c1377a4
I20260925 01:49:54.082036 11314 leader_election.cc:304] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.082439 12445 raft_consensus.cc:2749] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:54.084069 11953 rpcz_store.cc:276] 0925 01:49:47.200764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.200861 (+ 97us) service_pool.cc:224] Handling call
0925 01:49:53.978630 (+6777769us) ts_tablet_manager.cc:1151] Deleting tablet 200caea41ba4466386b091875f017956
0925 01:49:53.978643 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.024183 (+ 45540us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.059492 (+ 35309us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.071050 (+ 11558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2738,"tablet-delete.queue_time_us":6777500}
I20260925 01:49:54.085318 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 76) took 6619 ms. Trace:
I20260925 01:49:54.085479 11953 rpcz_store.cc:276] 0925 01:49:47.466137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.468135 (+ 1998us) service_pool.cc:224] Handling call
0925 01:49:54.085015 (+6616880us) ts_tablet_manager.cc:1151] Deleting tablet 19c718c83cfe49b9a745e06314e24409
0925 01:49:54.085029 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.085192 (+ 163us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6579967}
W20260925 01:49:54.085989 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 19c718c83cfe49b9a745e06314e24409 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 19c718c83cfe49b9a745e06314e24409 already in progress: creating tablet
I20260925 01:49:54.086035 11931 tablet_replica.cc:333] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:54.086341 11931 raft_consensus.cc:2243] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:54.086340 11457 leader_election.cc:343] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.087409 11931 raft_consensus.cc:2272] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.088083 11931 ts_tablet_manager.cc:1916] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.089874 11754 consensus_queue.cc:260] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.091992 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 77) took 6588 ms. Trace:
I20260925 01:49:54.092182 11953 rpcz_store.cc:276] 0925 01:49:47.506855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.507315 (+ 460us) service_pool.cc:224] Handling call
0925 01:49:54.086033 (+6578718us) ts_tablet_manager.cc:1151] Deleting tablet 02f9e96bcdf9418ea54dc73bf68a2be6
0925 01:49:54.086044 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.091829 (+ 5785us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6560246}
W20260925 01:49:54.093214 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02f9e96bcdf9418ea54dc73bf68a2be6 already in progress: creating tablet
I20260925 01:49:54.093830 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 80) took 6567 ms. Trace:
I20260925 01:49:54.094211 11457 leader_election.cc:304] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.093995 11953 rpcz_store.cc:276] 0925 01:49:47.526564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.526642 (+ 78us) service_pool.cc:224] Handling call
0925 01:49:54.093625 (+6566983us) ts_tablet_manager.cc:1151] Deleting tablet 55e9d52e3f79408a99216250aefc45c8
0925 01:49:54.093636 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.093764 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6562712}
W20260925 01:49:54.094949 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 55e9d52e3f79408a99216250aefc45c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 55e9d52e3f79408a99216250aefc45c8 already in progress: creating tablet
I20260925 01:49:54.094621 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00906edfa6b648229bcba8e59d68b969" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
W20260925 01:49:54.094642 11456 leader_election.cc:343] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ccffbe61eea34333abdc6da94612c0f6
I20260925 01:49:54.095903 12288 raft_consensus.cc:2749] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.096336 11946 ts_tablet_manager.cc:1929] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:54.096566 11946 log.cc:1199] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/3da92b7f256647f19faeed66b4012438
I20260925 01:49:54.096653 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f28e49791744428729279a79b6c9f1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:54.097998 11176 leader_election.cc:304] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:54.098457 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_09960c3dd1a34636a5446ca4f5d57b31" } new_table_name: "default.Table_31afeff7b38843a9a874569504c5d9d6" modify_external_catalogs: true
I20260925 01:49:54.098896 12263 raft_consensus.cc:2749] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:54.100167 11946 ts_tablet_manager.cc:1950] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:54.100446 11754 ts_tablet_manager.cc:1434] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260925 01:49:54.101419 11519 raft_consensus.cc:3060] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.101511 11755 tablet_bootstrap.cc:492] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:54.101689 11755 ts_tablet_manager.cc:1403] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.000s
I20260925 01:49:54.102684 11755 raft_consensus.cc:359] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.102885 11755 raft_consensus.cc:385] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.102950 11755 raft_consensus.cc:740] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.103180 11755 consensus_queue.cc:260] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.103719 11755 ts_tablet_manager.cc:1434] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260925 01:49:54.104092 11314 leader_election.cc:343] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8dd27c6d835948ba859b4c11d8ebf783
I20260925 01:49:54.104212 11314 leader_election.cc:304] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:54.104647 11314 leader_election.cc:343] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ba19192502634f8599407d923114a627
W20260925 01:49:54.104818 11314 leader_election.cc:343] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c28c9e51d80a442486b78be32c74a94f
I20260925 01:49:54.105064 11314 leader_election.cc:304] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:54.105355 12401 raft_consensus.cc:2749] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.105809 12401 raft_consensus.cc:2804] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:54.106208 12401 raft_consensus.cc:697] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:54.106664 12401 consensus_queue.cc:237] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:54.108229 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 67945.2us
I20260925 01:49:54.108553 11457 leader_election.cc:304] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:54.103853 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 73779.9us
W20260925 01:49:54.110139 11457 raft_consensus.cc:2686] T 3da92b7f256647f19faeed66b4012438 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:49:54.111083 11457 leader_election.cc:343] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.111732 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 100) took 5857 ms. Trace:
W20260925 01:49:54.111922 11457 leader_election.cc:343] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.112251 11457 leader_election.cc:304] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.113615 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 78) took 6599 ms. Trace:
I20260925 01:49:54.113726 11953 rpcz_store.cc:276] 0925 01:49:47.514375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.514866 (+ 491us) service_pool.cc:224] Handling call
0925 01:49:54.095653 (+6580787us) ts_tablet_manager.cc:1151] Deleting tablet 347a144e18ab4f6e834551044a2ac4ae
0925 01:49:54.095663 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.113553 (+ 17890us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6563973}
I20260925 01:49:54.114140 11946 rpcz_store.cc:276] 0925 01:49:48.242817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.242880 (+ 63us) service_pool.cc:224] Handling call
0925 01:49:53.985665 (+5742785us) ts_tablet_manager.cc:1151] Deleting tablet 3da92b7f256647f19faeed66b4012438
0925 01:49:53.985674 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:53.995598 (+ 9924us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.078705 (+ 83107us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.100722 (+ 22017us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5742188}
W20260925 01:49:54.114486 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 347a144e18ab4f6e834551044a2ac4ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 347a144e18ab4f6e834551044a2ac4ae already in progress: creating tablet
I20260925 01:49:54.114758 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 105) took 5643 ms. Trace:
I20260925 01:49:54.114884 11946 rpcz_store.cc:276] 0925 01:49:48.471212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.471319 (+ 107us) service_pool.cc:224] Handling call
0925 01:49:54.114609 (+5643290us) ts_tablet_manager.cc:1151] Deleting tablet 17352fd6ea4e4ed9a178f1510edf4f6d
0925 01:49:54.114621 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.114724 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5623483}
I20260925 01:49:54.115448 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 110) took 5619 ms. Trace:
I20260925 01:49:54.115572 11946 rpcz_store.cc:276] 0925 01:49:48.495960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.496019 (+ 59us) service_pool.cc:224] Handling call
0925 01:49:54.115184 (+5619165us) ts_tablet_manager.cc:1151] Deleting tablet 75a8e09b8838443c9bfff440ff1f877d
0925 01:49:54.115195 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.115382 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5618843}
I20260925 01:49:54.115890 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 109) took 5620 ms. Trace:
I20260925 01:49:54.115979 11946 rpcz_store.cc:276] 0925 01:49:48.495826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.497014 (+ 1188us) service_pool.cc:224] Handling call
0925 01:49:54.115769 (+5618755us) ts_tablet_manager.cc:1151] Deleting tablet 331380a2be9a4893927c9b94a2c3e08b
0925 01:49:54.115777 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.115848 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5606898}
I20260925 01:49:54.116324 11946 tablet_replica.cc:333] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:54.116545 11946 raft_consensus.cc:2243] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:49:54.116591 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7da55c488da540048a94324fa347c1ef consensus state has no leader
I20260925 01:49:54.116813 11946 raft_consensus.cc:2272] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.117532 11946 ts_tablet_manager.cc:1916] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.117810 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c13ddf2cd0284738a0d781b7a2ccf761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.118587 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c13ddf2cd0284738a0d781b7a2ccf761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.120091 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]) successfully deleted
W20260925 01:49:54.120414 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 17352fd6ea4e4ed9a178f1510edf4f6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17352fd6ea4e4ed9a178f1510edf4f6d already in progress: creating tablet
W20260925 01:49:54.120798 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 75a8e09b8838443c9bfff440ff1f877d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75a8e09b8838443c9bfff440ff1f877d already in progress: creating tablet
W20260925 01:49:54.121153 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 331380a2be9a4893927c9b94a2c3e08b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 331380a2be9a4893927c9b94a2c3e08b already in progress: creating tablet
I20260925 01:49:54.122336 11754 tablet_bootstrap.cc:492] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:54.123342 11457 leader_election.cc:304] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:54.123636 11457 raft_consensus.cc:2686] T 5acd5d878aac4261a7294e87304c9dfc P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:54.124790 12288 raft_consensus.cc:2749] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.128157 11755 tablet_bootstrap.cc:492] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:54.130621 11755 tablet_bootstrap.cc:654] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.131882 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 04f412cbebe04a629070aecf2753287c
I20260925 01:49:54.132545 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 79) took 6610 ms. Trace:
I20260925 01:49:54.132638 11457 leader_election.cc:304] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.132804 11673 catalog_manager.cc:6934] ReplaceTablet: tablet 04f412cbebe04a629070aecf2753287c deleted and replaced by tablet 87532a05a3cf4eccb5c27916d706adf9
I20260925 01:49:54.132710 11953 rpcz_store.cc:276] 0925 01:49:47.522355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.522422 (+ 67us) service_pool.cc:224] Handling call
0925 01:49:54.117402 (+6594980us) ts_tablet_manager.cc:1151] Deleting tablet f6058cd7c17b4544a565a5aacfb9df92
0925 01:49:54.132284 (+ 14882us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.132409 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6585607}
W20260925 01:49:54.132949 11457 raft_consensus.cc:2686] T e686dff5ada64f05a1c7bd914c1377a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:54.133215 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet 90647937eb364a7a973d04ea69cbc9aa from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:54.133486 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 84) took 6597 ms. Trace:
I20260925 01:49:54.133625 11953 rpcz_store.cc:276] 0925 01:49:47.535999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.536069 (+ 70us) service_pool.cc:224] Handling call
0925 01:49:54.133191 (+6597122us) ts_tablet_manager.cc:1151] Deleting tablet 4d7b3c65d8a64734b2c432790dae07e1
0925 01:49:54.133200 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.133361 (+ 161us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6596887}
W20260925 01:49:54.134265 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f6058cd7c17b4544a565a5aacfb9df92 because the tablet was not found. No further retry: Not found: Tablet not found: f6058cd7c17b4544a565a5aacfb9df92
I20260925 01:49:54.134511 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:54.134631 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 4d7b3c65d8a64734b2c432790dae07e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d7b3c65d8a64734b2c432790dae07e1 already in progress: creating tablet
I20260925 01:49:54.136044 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.138402 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 82) took 6604 ms. Trace:
I20260925 01:49:54.138509 11953 rpcz_store.cc:276] 0925 01:49:47.534274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.534763 (+ 489us) service_pool.cc:224] Handling call
0925 01:49:54.138161 (+6603398us) ts_tablet_manager.cc:1151] Deleting tablet 039ee80a2822417898c1d1d779f52867
0925 01:49:54.138171 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.138320 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6591318}
I20260925 01:49:54.138698 11753 tablet_bootstrap.cc:654] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:54.139168 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 039ee80a2822417898c1d1d779f52867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 039ee80a2822417898c1d1d779f52867 already in progress: creating tablet
I20260925 01:49:54.144882 11953 tablet_replica.cc:333] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:54.145002 11425 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:54.145174 11953 raft_consensus.cc:2243] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.145447 11953 raft_consensus.cc:2272] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.146181 11953 ts_tablet_manager.cc:1916] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.147539 11518 raft_consensus.cc:2468] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:54.147964 11519 raft_consensus.cc:2468] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:54.148375 11754 tablet_bootstrap.cc:654] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.148677 11965 raft_consensus.cc:493] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.151643 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.151916 11965 raft_consensus.cc:515] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.152837 11965 leader_election.cc:290] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:54.153865 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa2e2d4bfe14b5db5b1dfd67e19f11c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:54.154691 11177 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.157819 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ddbaaa8ae6ef4cada7027949173feba5" } modify_external_catalogs: true
I20260925 01:49:54.158170 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ddbaaa8ae6ef4cada7027949173feba5" } modify_external_catalogs: true
I20260925 01:49:54.161772 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa2e2d4bfe14b5db5b1dfd67e19f11c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:54.162678 11569 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:54.163018 12364 consensus_queue.cc:1048] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:49:54.164340 11176 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.164515 11176 leader_election.cc:304] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:54.165150 12263 consensus_queue.cc:1048] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:54.165647 12263 raft_consensus.cc:2749] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:54.168881 11457 leader_election.cc:343] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.169816 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 148f74b071c6420f8c78278c0cb37738
I20260925 01:49:54.170730 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b693b8f3dca9446f917874b3d6f6d0ca" } new_table_name: "default.Table_296491c83e6f4329a2fd902336673a8a" modify_external_catalogs: true
I20260925 01:49:54.171707 11931 ts_tablet_manager.cc:1929] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:54.171865 11931 log.cc:1199] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a3358b78a1da48388d1f72536b1ed0a2
I20260925 01:49:54.172433 11931 ts_tablet_manager.cc:1950] T a3358b78a1da48388d1f72536b1ed0a2 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:54.172376 11457 leader_election.cc:304] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.173003 12364 raft_consensus.cc:2749] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.173544 11931 tablet_replica.cc:333] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:54.173766 11931 raft_consensus.cc:2243] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.173969 11931 raft_consensus.cc:2272] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.174193 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 148f74b071c6420f8c78278c0cb37738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.174571 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 148f74b071c6420f8c78278c0cb37738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.174777 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 148f74b071c6420f8c78278c0cb37738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.175227 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a3358b78a1da48388d1f72536b1ed0a2 (table default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]) successfully deleted
I20260925 01:49:54.175702 11288 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:54.183646 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c9e51d80a442486b78be32c74a94f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:54.183890 11519 raft_consensus.cc:2468] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
W20260925 01:49:54.184484 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f892954cd22c48aaad2f0e20b1277844 consensus state has no leader
I20260925 01:49:54.185350 12364 raft_consensus.cc:493] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.185631 11288 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:54.185580 12364 raft_consensus.cc:515] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.185969 11931 ts_tablet_manager.cc:1916] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.186345 12364 leader_election.cc:290] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:54.187666 11456 leader_election.cc:343] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:49:54.190522 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c8971e1e09594fddab21222ee8b73730"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.191499 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8971e1e09594fddab21222ee8b73730 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.193364 12462 tablet_bootstrap.cc:700] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Time spent opening tablet: real 0.101s user 0.004s sys 0.000s
I20260925 01:49:54.203233 12364 raft_consensus.cc:493] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:54.203492 12364 raft_consensus.cc:515] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:54.204277 12364 leader_election.cc:290] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:54.205785 11456 leader_election.cc:343] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: fa619556e5af473998080f4bbc9e5d1e
W20260925 01:49:54.207536 11177 consensus_peers.cc:597] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:54.212870 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1cc809b190d34ac18fca6162fb4f25b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.213773 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cc809b190d34ac18fca6162fb4f25b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.215302 11946 ts_tablet_manager.cc:1929] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:54.217423 11953 ts_tablet_manager.cc:1929] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:54.219005 11946 log.cc:1199] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/7900db92b35048aaa200ed3183031d6b
I20260925 01:49:54.219717 11753 tablet_bootstrap.cc:492] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:54.220909 11753 ts_tablet_manager.cc:1403] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.199s user 0.002s sys 0.008s
I20260925 01:49:54.221532 11946 ts_tablet_manager.cc:1950] T 7900db92b35048aaa200ed3183031d6b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:54.222172 11931 ts_tablet_manager.cc:1929] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:54.222086 11753 raft_consensus.cc:359] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.222302 11753 raft_consensus.cc:385] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.222342 11931 log.cc:1199] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/00906edfa6b648229bcba8e59d68b969
I20260925 01:49:54.222405 11753 raft_consensus.cc:740] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.222766 11931 ts_tablet_manager.cc:1950] T 00906edfa6b648229bcba8e59d68b969 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:54.222765 11753 consensus_queue.cc:260] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.224288 11569 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:54.225476 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:54.225809 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:54.226926 11753 ts_tablet_manager.cc:1434] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:49:54.227808 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet 80fe96946b294785b8d76564e0f5fa12 from {username='slave'} at 127.0.0.1:60372
W20260925 01:49:54.228854 11456 consensus_peers.cc:597] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99913eb35197442880a27b3c288237f4. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:54.228858 11674 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:54.229740 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 00906edfa6b648229bcba8e59d68b969 (table default.Table_6ae7ffbe7b334c87a1be9c5c18761c65 [id=1c424cf98429473f9896b9c4028e11f6]) successfully deleted
I20260925 01:49:54.229873 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 114) took 5621 ms. Trace:
I20260925 01:49:54.229255 12401 raft_consensus.cc:493] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:54.230274 11754 tablet_bootstrap.cc:492] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:54.230199 12401 raft_consensus.cc:515] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:54.230443 11754 ts_tablet_manager.cc:1403] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.108s user 0.016s sys 0.008s
I20260925 01:49:54.230620 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.230409 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:54.231027 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 04f412cbebe04a629070aecf2753287c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04f412cbebe04a629070aecf2753287c already in progress: creating tablet
I20260925 01:49:54.231113 12401 leader_election.cc:290] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:49:54.231377 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 148f74b071c6420f8c78278c0cb37738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148f74b071c6420f8c78278c0cb37738 already in progress: creating tablet
I20260925 01:49:54.231495 11754 raft_consensus.cc:359] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.231704 11754 raft_consensus.cc:385] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.231802 11754 raft_consensus.cc:740] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.231957 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:54.232188 11953 log.cc:1199] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/e686dff5ada64f05a1c7bd914c1377a4
I20260925 01:49:54.232086 11754 consensus_queue.cc:260] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.232234 11931 tablet_replica.cc:333] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:54.232831 11754 ts_tablet_manager.cc:1434] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:54.232982 11953 ts_tablet_manager.cc:1950] T e686dff5ada64f05a1c7bd914c1377a4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:54.233381 11754 tablet_bootstrap.cc:492] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:54.233457 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 83) took 6699 ms. Trace:
I20260925 01:49:54.233562 11953 rpcz_store.cc:276] 0925 01:49:47.534426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.534794 (+ 368us) service_pool.cc:224] Handling call
0925 01:49:54.144772 (+6609978us) ts_tablet_manager.cc:1151] Deleting tablet e686dff5ada64f05a1c7bd914c1377a4
0925 01:49:54.144786 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.163788 (+ 19002us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.217278 (+ 53490us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.233418 (+ 16140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6595423}
I20260925 01:49:54.234323 11931 raft_consensus.cc:2243] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.234625 11931 raft_consensus.cc:2272] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.235432 11931 ts_tablet_manager.cc:1916] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.235489 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.235067 11946 rpcz_store.cc:276] 0925 01:49:48.608007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.614128 (+ 6121us) service_pool.cc:224] Handling call
0925 01:49:54.116268 (+5502140us) ts_tablet_manager.cc:1151] Deleting tablet 7900db92b35048aaa200ed3183031d6b
0925 01:49:54.116277 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.187226 (+ 70949us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.215200 (+ 27974us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.229811 (+ 14611us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5447789}
I20260925 01:49:54.236691 11754 tablet_bootstrap.cc:654] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.237656 11953 tablet_replica.cc:333] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:54.238533 11753 tablet_bootstrap.cc:492] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:54.105360 11314 consensus_peers.cc:597] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9937c3776f549dea887ace26dae492c. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:54.239583 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 85db5688ef064053870a39a906ad9071 (DEFAULT_TABLE table=default.Table_ddbaaa8ae6ef4cada7027949173feba5 [id=559aa97ecdd74867a638ecc2be209a89]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:54.239848 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 134390us
W20260925 01:49:54.240247 11314 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5acd5d878aac4261a7294e87304c9dfc
I20260925 01:49:54.240489 11753 tablet_bootstrap.cc:654] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.241662 11314 leader_election.cc:304] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.242327 11946 tablet_replica.cc:333] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:54.242641 11946 raft_consensus.cc:2243] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.243021 11946 raft_consensus.cc:2272] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.243068 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85db5688ef064053870a39a906ad9071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.243813 11946 ts_tablet_manager.cc:1916] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.244341 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet e686dff5ada64f05a1c7bd914c1377a4 (table default.Table_4b87558f2a98419f96b453a44aae814b [id=a1a3b3d0054a4bff8de55b5c5e71880f]) successfully deleted
I20260925 01:49:54.253145 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5494c67817c04f7db697678f00ba117d" } new_table_name: "default.Table_aafe9afea11140cb990569950b3f112b" modify_external_catalogs: true
I20260925 01:49:54.254704 11753 tablet_bootstrap.cc:492] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:54.254756 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 7900db92b35048aaa200ed3183031d6b (table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]) successfully deleted
I20260925 01:49:54.255308 12401 raft_consensus.cc:2804] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:54.258805 11314 leader_election.cc:304] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.259598 12401 raft_consensus.cc:697] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:54.259907 12401 consensus_queue.cc:237] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.261715 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 85db5688ef064053870a39a906ad9071 (DEFAULT_TABLE table=default.Table_ddbaaa8ae6ef4cada7027949173feba5 [id=559aa97ecdd74867a638ecc2be209a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.261931 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 5d37a05d2bcd4c94ba51fef8096f889d (DEFAULT_TABLE table=default.Table_9d7e379c843d492d9c3c54d5d9925e95 [id=f410d9cb1dc743fa9d98fa3f04a60a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.262733 12445 raft_consensus.cc:2804] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:54.262858 12445 raft_consensus.cc:493] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:54.262976 12445 raft_consensus.cc:3060] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.264813 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 47b62644673447239feb0f8f851012ef (DEFAULT_TABLE table=default.Table_f8b12242c3e44c009dd3fd05771e971f [id=57961ea65d474c928bf94f669e0159fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.265286 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b62644673447239feb0f8f851012ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.267357 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 47b62644673447239feb0f8f851012ef (DEFAULT_TABLE table=default.Table_f8b12242c3e44c009dd3fd05771e971f [id=57961ea65d474c928bf94f669e0159fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.267623 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85db5688ef064053870a39a906ad9071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.267728 12445 raft_consensus.cc:515] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.268450 12445 leader_election.cc:290] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.268625 11755 tablet_bootstrap.cc:492] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:54.268819 11755 ts_tablet_manager.cc:1403] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.141s user 0.005s sys 0.008s
I20260925 01:49:54.269891 11755 raft_consensus.cc:359] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.270103 11755 raft_consensus.cc:385] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.270223 11755 raft_consensus.cc:740] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
W20260925 01:49:54.271198 11314 leader_election.cc:343] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5acd5d878aac4261a7294e87304c9dfc
I20260925 01:49:54.271363 11314 leader_election.cc:304] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.272428 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d37a05d2bcd4c94ba51fef8096f889d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.273726 11953 raft_consensus.cc:2243] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:54.272471 11314 leader_election.cc:343] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 3da92b7f256647f19faeed66b4012438
I20260925 01:49:54.273994 11953 raft_consensus.cc:2272] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.274948 12445 raft_consensus.cc:2706] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Received election callback for term 2 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260925 01:49:54.275755 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b62644673447239feb0f8f851012ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.275966 11953 ts_tablet_manager.cc:1916] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.276811 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 5d37a05d2bcd4c94ba51fef8096f889d (DEFAULT_TABLE table=default.Table_9d7e379c843d492d9c3c54d5d9925e95 [id=f410d9cb1dc743fa9d98fa3f04a60a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.280597 11207 tablet_service.cc:1511] Processing CreateTablet for tablet d07df8063b2e4971a12af229585cfe44 (DEFAULT_TABLE table=default.Table_9f6df51cac0f4c3b9111cab561c1ecc5 [id=a3f1002dfc3c4ba38bdec9e7b2bc25b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.280793 11350 tablet_service.cc:1511] Processing CreateTablet for tablet d07df8063b2e4971a12af229585cfe44 (DEFAULT_TABLE table=default.Table_9f6df51cac0f4c3b9111cab561c1ecc5 [id=a3f1002dfc3c4ba38bdec9e7b2bc25b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.281096 11203 tablet_service.cc:1511] Processing CreateTablet for tablet d3aadd649e4b4f489bfe4b0eea13ede8 (DEFAULT_TABLE table=default.Table_27cae369e3864093b7c94613cec41e94 [id=8063be59104347b1aa72aa8fe6e3fd20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.281275 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07df8063b2e4971a12af229585cfe44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.283063 11355 tablet_service.cc:1511] Processing CreateTablet for tablet d3aadd649e4b4f489bfe4b0eea13ede8 (DEFAULT_TABLE table=default.Table_27cae369e3864093b7c94613cec41e94 [id=8063be59104347b1aa72aa8fe6e3fd20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.283401 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 33967e5e11524b78bb86ce7a3e2e16ad
I20260925 01:49:54.283970 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 35ff8a661fba41bab36966b10d4202c4 (DEFAULT_TABLE table=default.Table_e707fcfa3d654b4ba15af22016782fb2 [id=65971cee68b14bf8aa3c11df3fa2eb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.284783 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.286437 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aadd649e4b4f489bfe4b0eea13ede8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.287468 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d37a05d2bcd4c94ba51fef8096f889d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.278297 11755 consensus_queue.cc:260] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.289840 11754 tablet_bootstrap.cc:492] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:54.290119 11754 ts_tablet_manager.cc:1403] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.057s user 0.006s sys 0.003s
I20260925 01:49:54.291004 11754 raft_consensus.cc:359] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.291265 11754 raft_consensus.cc:385] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.291371 11754 raft_consensus.cc:740] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.291683 11754 consensus_queue.cc:260] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.293587 11754 ts_tablet_manager.cc:1434] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:49:54.293934 11754 tablet_bootstrap.cc:492] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:54.299686 11380 raft_consensus.cc:3060] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.301322 11679 catalog_manager.cc:5838] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:54.301796 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_17cf387aca9e4b949195e91a5101157e [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 2 got 0
I20260925 01:49:54.303989 11754 tablet_bootstrap.cc:654] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.305097 11678 catalog_manager.cc:5838] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:54.305589 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:54.305904 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_0b0ce5f884684db28023373c46961746 [id=464edb71967c4016ae7592aaad5492d6]). Expected version 2 got 0
I20260925 01:49:54.306229 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.308444 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f0157a45817246cfaa0b016afdbd59cb (table default.Table_fdb22e002b0644ecb997d9d8ed3203ee [id=c3bda2bcc66f4f4ea55f4a7066905c87]). Expected version 3 got 0
I20260925 01:49:54.308619 11498 tablet_service.cc:1511] Processing CreateTablet for tablet d07df8063b2e4971a12af229585cfe44 (DEFAULT_TABLE table=default.Table_9f6df51cac0f4c3b9111cab561c1ecc5 [id=a3f1002dfc3c4ba38bdec9e7b2bc25b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.309692 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 5d37a05d2bcd4c94ba51fef8096f889d (DEFAULT_TABLE table=default.Table_9d7e379c843d492d9c3c54d5d9925e95 [id=f410d9cb1dc743fa9d98fa3f04a60a5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.310259 11753 ts_tablet_manager.cc:1403] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.003s
I20260925 01:49:54.310655 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 85db5688ef064053870a39a906ad9071 (DEFAULT_TABLE table=default.Table_ddbaaa8ae6ef4cada7027949173feba5 [id=559aa97ecdd74867a638ecc2be209a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.311177 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.311538 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07df8063b2e4971a12af229585cfe44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.311525 11674 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030] alter complete (version 3)
I20260925 01:49:54.312934 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_41fed6a77be94c48a21343bad5e4a5f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.313576 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41fed6a77be94c48a21343bad5e4a5f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.310837 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ff8a661fba41bab36966b10d4202c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.314728 11485 tablet_service.cc:1511] Processing CreateTablet for tablet d3aadd649e4b4f489bfe4b0eea13ede8 (DEFAULT_TABLE table=default.Table_27cae369e3864093b7c94613cec41e94 [id=8063be59104347b1aa72aa8fe6e3fd20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.315169 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aadd649e4b4f489bfe4b0eea13ede8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.315900 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.316151 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 7900db92b35048aaa200ed3183031d6b with delete_type TABLET_DATA_DELETED (replaced by tablet bdf7f544827d4bca97aa6b63c0c48c0d) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.316334 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet bb98d5a38f43450c80d057d9eb2f92d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.318343 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07df8063b2e4971a12af229585cfe44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.318565 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 47b62644673447239feb0f8f851012ef (DEFAULT_TABLE table=default.Table_f8b12242c3e44c009dd3fd05771e971f [id=57961ea65d474c928bf94f669e0159fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.319370 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85db5688ef064053870a39a906ad9071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.320528 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d37a05d2bcd4c94ba51fef8096f889d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.321260 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 35ff8a661fba41bab36966b10d4202c4 (DEFAULT_TABLE table=default.Table_e707fcfa3d654b4ba15af22016782fb2 [id=65971cee68b14bf8aa3c11df3fa2eb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.324591 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aadd649e4b4f489bfe4b0eea13ede8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.330245 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b62644673447239feb0f8f851012ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.333050 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a8055cc9b06045449e6133298c8074e1
I20260925 01:49:54.332877 11753 raft_consensus.cc:359] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.333359 11753 raft_consensus.cc:385] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.333541 11753 raft_consensus.cc:740] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.334578 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet a8055cc9b06045449e6133298c8074e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.334290 11753 consensus_queue.cc:260] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.335793 11753 ts_tablet_manager.cc:1434] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.025s user 0.000s sys 0.003s
I20260925 01:49:54.337345 11491 tablet_service.cc:1511] Processing CreateTablet for tablet d5edd719563c4f009fc840aa6fdda04a (DEFAULT_TABLE table=default.Table_63e88824670a483ca885e3276b461039 [id=97673033a5a74213ab8a1814df2307a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.340229 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet a8055cc9b06045449e6133298c8074e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.342026 11213 tablet_service.cc:1511] Processing CreateTablet for tablet d5edd719563c4f009fc840aa6fdda04a (DEFAULT_TABLE table=default.Table_63e88824670a483ca885e3276b461039 [id=97673033a5a74213ab8a1814df2307a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.343048 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5edd719563c4f009fc840aa6fdda04a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.343015 11931 ts_tablet_manager.cc:1929] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:54.349287 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 90647937eb364a7a973d04ea69cbc9aa
I20260925 01:49:54.349859 11673 catalog_manager.cc:6934] ReplaceTablet: tablet 90647937eb364a7a973d04ea69cbc9aa deleted and replaced by tablet 3e12ffab16844f50be47dadcfbb3793f
I20260925 01:49:54.350297 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3656d1af0d574a22a269b272ff601b97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.350904 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3656d1af0d574a22a269b272ff601b97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.353267 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 90647937eb364a7a973d04ea69cbc9aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3e12ffab16844f50be47dadcfbb3793f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.353610 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5edd719563c4f009fc840aa6fdda04a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.356479 11931 log.cc:1199] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:49:54.356971 11931 ts_tablet_manager.cc:1950] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:54.361081 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ff8a661fba41bab36966b10d4202c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.361469 12462 log.cc:826] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Log is configured to *not* fsync() on all Append() calls
I20260925 01:49:54.361819 11931 tablet_replica.cc:333] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:54.362087 11931 raft_consensus.cc:2243] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:54.362370 11931 pending_rounds.cc:70] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:49:54.362317 12364 consensus_queue.cc:1048] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:54.362440 11931 pending_rounds.cc:77] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072869938233344 op_type: NO_OP noop_request { }
I20260925 01:49:54.362556 11931 raft_consensus.cc:2889] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:54.362677 11931 raft_consensus.cc:2272] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.363989 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c (table default.Table_5853dcaed91a4f87b5d7b36db7a61965 [id=1b2a20dc907c4e3ca2a5c4a41fd46378]) successfully deleted
I20260925 01:49:54.367009 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 90647937eb364a7a973d04ea69cbc9aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3e12ffab16844f50be47dadcfbb3793f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.370872 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 64ce95e571524d6ea6c98087bc08d4b9 (DEFAULT_TABLE table=default.Table_3ed6d725fb664332abe7a92a862f05f6 [id=a366ecc4f824423ea7184781cf6a0206]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.371472 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ce95e571524d6ea6c98087bc08d4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.366732 11931 ts_tablet_manager.cc:1916] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.376295 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 64ce95e571524d6ea6c98087bc08d4b9 (DEFAULT_TABLE table=default.Table_3ed6d725fb664332abe7a92a862f05f6 [id=a366ecc4f824423ea7184781cf6a0206]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.382941 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 85db5688ef064053870a39a906ad9071
I20260925 01:49:54.385782 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 85db5688ef064053870a39a906ad9071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.336378 11753 tablet_bootstrap.cc:492] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:54.386366 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.386541 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ce95e571524d6ea6c98087bc08d4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.387705 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b8778ebbb44b4938910562a360d966ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:54.395076 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 85db5688ef064053870a39a906ad9071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.395926 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b91957f62d8044ea8f6a3464c84b9e10
I20260925 01:49:54.396459 11671 catalog_manager.cc:6934] ReplaceTablet: tablet b91957f62d8044ea8f6a3464c84b9e10 deleted and replaced by tablet 6c886579e1eb4cac958514f7dc53b7b8
I20260925 01:49:54.398856 11755 ts_tablet_manager.cc:1434] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260925 01:49:54.399366 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c886579e1eb4cac958514f7dc53b7b8) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.400307 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.400537 11372 raft_consensus.cc:2468] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:54.406742 12288 raft_consensus.cc:493] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.407007 12288 raft_consensus.cc:515] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.407806 12288 leader_election.cc:290] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.408713 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:54.409236 11456 leader_election.cc:343] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:49:54.412407 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 35ff8a661fba41bab36966b10d4202c4 (DEFAULT_TABLE table=default.Table_e707fcfa3d654b4ba15af22016782fb2 [id=65971cee68b14bf8aa3c11df3fa2eb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.412855 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ff8a661fba41bab36966b10d4202c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.413546 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c886579e1eb4cac958514f7dc53b7b8) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.415336 11378 raft_consensus.cc:2393] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:54.419442 11753 tablet_bootstrap.cc:654] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:54.421816 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4e5d28d466741a0a085a4f9938fffd1 consensus state has no leader
I20260925 01:49:54.422320 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_83cb911831d14ec1a87189952a773203"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.422940 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83cb911831d14ec1a87189952a773203 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.424177 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 80fe96946b294785b8d76564e0f5fa12
I20260925 01:49:54.424644 11676 catalog_manager.cc:6934] ReplaceTablet: tablet 80fe96946b294785b8d76564e0f5fa12 deleted and replaced by tablet 246aafd66334407895ce235e4b2ca7f4
I20260925 01:49:54.424985 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_27834b4925234e2caedcd3329149f937"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.425631 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27834b4925234e2caedcd3329149f937 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:54.426252 11314 leader_election.cc:343] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 3da92b7f256647f19faeed66b4012438
I20260925 01:49:54.426761 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet a8055cc9b06045449e6133298c8074e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.429159 11457 leader_election.cc:304] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.429596 11314 leader_election.cc:304] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.429713 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c9e51d80a442486b78be32c74a94f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:54.429899 11457 leader_election.cc:304] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.429978 11519 raft_consensus.cc:3060] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.430433 12288 raft_consensus.cc:2804] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:54.430586 12288 raft_consensus.cc:493] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
W20260925 01:49:54.430691 11314 leader_election.cc:343] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c28c9e51d80a442486b78be32c74a94f
I20260925 01:49:54.430856 12288 raft_consensus.cc:3060] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:54.430928 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c886579e1eb4cac958514f7dc53b7b8) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.431677 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 80fe96946b294785b8d76564e0f5fa12 with delete_type TABLET_DATA_DELETED (replaced by tablet 246aafd66334407895ce235e4b2ca7f4) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.432106 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 80fe96946b294785b8d76564e0f5fa12 with delete_type TABLET_DATA_DELETED (replaced by tablet 246aafd66334407895ce235e4b2ca7f4) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.432556 12364 raft_consensus.cc:3060] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.433712 11946 ts_tablet_manager.cc:1929] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:54.434376 11946 log.cc:1199] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/4195e3f8e93e40fe9dfd72710d319dca
I20260925 01:49:54.435452 11946 ts_tablet_manager.cc:1950] T 4195e3f8e93e40fe9dfd72710d319dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:54.436049 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 90647937eb364a7a973d04ea69cbc9aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3e12ffab16844f50be47dadcfbb3793f) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.436322 11356 tablet_service.cc:1511] Processing CreateTablet for tablet d5edd719563c4f009fc840aa6fdda04a (DEFAULT_TABLE table=default.Table_63e88824670a483ca885e3276b461039 [id=97673033a5a74213ab8a1814df2307a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.436844 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5edd719563c4f009fc840aa6fdda04a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.438251 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 80fe96946b294785b8d76564e0f5fa12 with delete_type TABLET_DATA_DELETED (replaced by tablet 246aafd66334407895ce235e4b2ca7f4) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.438746 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.439024 11372 raft_consensus.cc:2393] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:54.439152 11519 raft_consensus.cc:2468] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:54.440048 12288 raft_consensus.cc:515] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:54.442381 12364 raft_consensus.cc:2749] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.442471 12288 leader_election.cc:290] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.443481 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 117) took 5665 ms. Trace:
W20260925 01:49:54.444554 11456 leader_election.cc:343] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: fa619556e5af473998080f4bbc9e5d1e
I20260925 01:49:54.444698 11946 rpcz_store.cc:276] 0925 01:49:48.778050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.778144 (+ 94us) service_pool.cc:224] Handling call
0925 01:49:54.236354 (+5458210us) ts_tablet_manager.cc:1151] Deleting tablet 4195e3f8e93e40fe9dfd72710d319dca
0925 01:49:54.242154 (+ 5800us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.377548 (+135394us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.414116 (+ 36568us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.443439 (+ 29323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5374227}
I20260925 01:49:54.445257 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 119) took 5660 ms. Trace:
I20260925 01:49:54.445408 11946 rpcz_store.cc:276] 0925 01:49:48.784983 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.785058 (+ 75us) service_pool.cc:224] Handling call
0925 01:49:54.445051 (+5659993us) ts_tablet_manager.cc:1151] Deleting tablet 9884d7af60324a24ad06d6fa5db358b2
0925 01:49:54.445063 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.445153 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5581866}
I20260925 01:49:54.445556 11314 leader_election.cc:304] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.445713 11946 tablet_replica.cc:333] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:54.445966 11946 raft_consensus.cc:2243] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.447083 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]) successfully deleted
W20260925 01:49:54.447500 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9884d7af60324a24ad06d6fa5db358b2 because the tablet was not found. No further retry: Not found: Tablet not found: 9884d7af60324a24ad06d6fa5db358b2
W20260925 01:49:54.453996 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8778ebbb44b4938910562a360d966ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.396837 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2c03f5553b874ed2b3b044920af7cf4e" } new_table_name: "default.Table_91355e6a2a11467f8375581add0caae9" modify_external_catalogs: true
I20260925 01:49:54.458868 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 9a82e0251ebb4500b628924c89bfe1b2 (DEFAULT_TABLE table=default.Table_366edf53ad054347ab1fdcaccf94d77e [id=d991f187447f4aedb17ee797607351f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.459182 11203 tablet_service.cc:1511] Processing CreateTablet for tablet e2ba874cb6a34ccd9e59cc9146280c17 (DEFAULT_TABLE table=default.Table_a4b81d45884b4b448624e0ce194da08b [id=2cdf410d9ffc49b2b86ef10deb041799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.459419 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a82e0251ebb4500b628924c89bfe1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.459774 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9364671fcc42dba51569d14979f030 (DEFAULT_TABLE table=default.Table_4271efd546954005b792c8c40c4b6c88 [id=8fcc310b81cc4e4fad99fd9a7df66be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.459856 11359 tablet_service.cc:1511] Processing CreateTablet for tablet e2ba874cb6a34ccd9e59cc9146280c17 (DEFAULT_TABLE table=default.Table_a4b81d45884b4b448624e0ce194da08b [id=2cdf410d9ffc49b2b86ef10deb041799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.460253 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9364671fcc42dba51569d14979f030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.460623 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9364671fcc42dba51569d14979f030 (DEFAULT_TABLE table=default.Table_4271efd546954005b792c8c40c4b6c88 [id=8fcc310b81cc4e4fad99fd9a7df66be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.446499 11457 leader_election.cc:304] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.461283 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa619556e5af473998080f4bbc9e5d1e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:54.461549 11372 raft_consensus.cc:3060] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:54.446473 12288 consensus_queue.cc:1048] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:54.462306 12288 raft_consensus.cc:3060] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.463073 11485 tablet_service.cc:1511] Processing CreateTablet for tablet e2ba874cb6a34ccd9e59cc9146280c17 (DEFAULT_TABLE table=default.Table_a4b81d45884b4b448624e0ce194da08b [id=2cdf410d9ffc49b2b86ef10deb041799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.463631 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ba874cb6a34ccd9e59cc9146280c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.465667 12288 raft_consensus.cc:2749] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.459581 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 9a82e0251ebb4500b628924c89bfe1b2 (DEFAULT_TABLE table=default.Table_366edf53ad054347ab1fdcaccf94d77e [id=d991f187447f4aedb17ee797607351f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.460080 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9364671fcc42dba51569d14979f030 (DEFAULT_TABLE table=default.Table_4271efd546954005b792c8c40c4b6c88 [id=8fcc310b81cc4e4fad99fd9a7df66be6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.470857 11931 ts_tablet_manager.cc:1929] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:54.471169 11931 log.cc:1199] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/bb98d5a38f43450c80d057d9eb2f92d1
I20260925 01:49:54.471678 11931 ts_tablet_manager.cc:1950] T bb98d5a38f43450c80d057d9eb2f92d1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:54.472872 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ba874cb6a34ccd9e59cc9146280c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.473727 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 85db5688ef064053870a39a906ad9071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.474601 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b98ad0f02eb74eba897040401a164f5c
I20260925 01:49:54.475637 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6f5f401e72484ae0ac6fb26604621774"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.476264 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f5f401e72484ae0ac6fb26604621774 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.482589 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet b98ad0f02eb74eba897040401a164f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.486879 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 64ce95e571524d6ea6c98087bc08d4b9 (DEFAULT_TABLE table=default.Table_3ed6d725fb664332abe7a92a862f05f6 [id=a366ecc4f824423ea7184781cf6a0206]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.489707 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ec82ac4f3b4d48fbbb33c21f5630d749 (table default.Table_0b0ce5f884684db28023373c46961746 [id=464edb71967c4016ae7592aaad5492d6]). Expected version 2 got 0
I20260925 01:49:54.495384 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet b98ad0f02eb74eba897040401a164f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.496614 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ba874cb6a34ccd9e59cc9146280c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.501955 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9364671fcc42dba51569d14979f030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.501997 11212 tablet_service.cc:1511] Processing CreateTablet for tablet c2fe086048c04e0db797272e50f21c91 (DEFAULT_TABLE table=default.Table_e297a48065794637b13d401d13c54906 [id=1091c7fd09f344db898a0a98d6ea8bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.502307 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 941fd8333f6d45878677e55ff6948bbf (DEFAULT_TABLE table=default.Table_cb4260d7591d4bf1b0c9e2a926970fe7 [id=35b3f2605340482a97104b0fd975275f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.502490 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fe086048c04e0db797272e50f21c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.502763 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941fd8333f6d45878677e55ff6948bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.503072 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 49b110516abb45d1880d0e0e33e20174 (DEFAULT_TABLE table=default.Table_3d10755c25e9452c8175928253480e9e [id=829de5b617c449de81f9b1c224dbf0bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.503468 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b110516abb45d1880d0e0e33e20174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.507823 11204 tablet_service.cc:1511] Processing CreateTablet for tablet a0a50af9614341d49c4c690e2ec785b0 (DEFAULT_TABLE table=default.Table_359930648bba4aa1b2c8e3b294aac1e0 [id=0921cdbf570d44939373e1054ea46415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.508536 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a50af9614341d49c4c690e2ec785b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.510766 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ce95e571524d6ea6c98087bc08d4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.519637 12445 raft_consensus.cc:2749] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:54.520140 12445 raft_consensus.cc:2804] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:54.520430 12445 raft_consensus.cc:697] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:54.520862 12445 consensus_queue.cc:237] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.530862 11372 raft_consensus.cc:2468] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 2.
I20260925 01:49:54.532932 11946 raft_consensus.cc:2272] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.534500 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a82e0251ebb4500b628924c89bfe1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.534816 11946 ts_tablet_manager.cc:1916] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.534879 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9364671fcc42dba51569d14979f030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.536194 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet b98ad0f02eb74eba897040401a164f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.541034 11953 ts_tablet_manager.cc:1929] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:54.541391 11953 log.cc:1199] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/5acd5d878aac4261a7294e87304c9dfc
I20260925 01:49:54.542387 11953 ts_tablet_manager.cc:1950] T 5acd5d878aac4261a7294e87304c9dfc P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:54.543011 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 85) took 6975 ms. Trace:
I20260925 01:49:54.543210 11953 rpcz_store.cc:276] 0925 01:49:47.567676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.567737 (+ 61us) service_pool.cc:224] Handling call
0925 01:49:54.237517 (+6669780us) ts_tablet_manager.cc:1151] Deleting tablet 5acd5d878aac4261a7294e87304c9dfc
0925 01:49:54.237529 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.422561 (+185032us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.540181 (+117620us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.542917 (+ 2736us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6669502}
I20260925 01:49:54.543934 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet ba19192502634f8599407d923114a627 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.544284 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7f7ee517df483b83d1627cdb6f9433 (DEFAULT_TABLE table=default.Table_3ee0ad1909f644498b594873c3d11c23 [id=48a879b2086842449b425f4930f1c5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.544755 11487 tablet_service.cc:1511] Processing CreateTablet for tablet c2fe086048c04e0db797272e50f21c91 (DEFAULT_TABLE table=default.Table_e297a48065794637b13d401d13c54906 [id=1091c7fd09f344db898a0a98d6ea8bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.545192 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 941fd8333f6d45878677e55ff6948bbf (DEFAULT_TABLE table=default.Table_cb4260d7591d4bf1b0c9e2a926970fe7 [id=35b3f2605340482a97104b0fd975275f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.545460 11501 tablet_service.cc:1511] Processing CreateTablet for tablet a0a50af9614341d49c4c690e2ec785b0 (DEFAULT_TABLE table=default.Table_359930648bba4aa1b2c8e3b294aac1e0 [id=0921cdbf570d44939373e1054ea46415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.545756 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 49b110516abb45d1880d0e0e33e20174 (DEFAULT_TABLE table=default.Table_3d10755c25e9452c8175928253480e9e [id=829de5b617c449de81f9b1c224dbf0bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.546412 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7f7ee517df483b83d1627cdb6f9433 (DEFAULT_TABLE table=default.Table_3ee0ad1909f644498b594873c3d11c23 [id=48a879b2086842449b425f4930f1c5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.546938 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7f7ee517df483b83d1627cdb6f9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.547328 11753 tablet_bootstrap.cc:492] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:54.547510 11753 ts_tablet_manager.cc:1403] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.211s user 0.007s sys 0.000s
I20260925 01:49:54.549770 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 681356bc659f4ca990cd2ffc0c10b533 (DEFAULT_TABLE table=default.Table_8d514818f2024dce89bf6d1480c69b09 [id=0a48dd4feb2542deaa4dacfa997da5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.551352 11753 raft_consensus.cc:359] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.551591 11753 raft_consensus.cc:385] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.551877 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e9d52e3f79408a99216250aefc45c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c29e410731842aeb64ab8eeb4ccc3ca) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.552284 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681356bc659f4ca990cd2ffc0c10b533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.552332 11753 raft_consensus.cc:740] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.553318 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 681356bc659f4ca990cd2ffc0c10b533 (DEFAULT_TABLE table=default.Table_8d514818f2024dce89bf6d1480c69b09 [id=0a48dd4feb2542deaa4dacfa997da5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.554224 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fe086048c04e0db797272e50f21c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.557452 11755 tablet_bootstrap.cc:492] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:54.557920 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet bb98d5a38f43450c80d057d9eb2f92d1 (table default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d]) successfully deleted
I20260925 01:49:54.560345 11755 tablet_bootstrap.cc:654] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.566218 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b110516abb45d1880d0e0e33e20174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.552685 11753 consensus_queue.cc:260] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.571056 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7f7ee517df483b83d1627cdb6f9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.573173 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941fd8333f6d45878677e55ff6948bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.573961 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a50af9614341d49c4c690e2ec785b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.574512 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681356bc659f4ca990cd2ffc0c10b533. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:54.580701 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ca76f6f710d841fd8999b40e5a48693f because the tablet was not found. No further retry: Not found: Tablet not found: ca76f6f710d841fd8999b40e5a48693f
I20260925 01:49:54.581260 11753 ts_tablet_manager.cc:1434] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.021s user 0.002s sys 0.001s
I20260925 01:49:54.581705 11753 tablet_bootstrap.cc:492] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:54.584089 11753 tablet_bootstrap.cc:654] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.587025 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7df458fb50104adaac9587ce837b400b" } new_table_name: "default.Table_627a87cf82bc46aaaaebd84352be4014" modify_external_catalogs: true
I20260925 01:49:54.587633 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 5acd5d878aac4261a7294e87304c9dfc (table default.Table_84048a62c4e54c64a5e7e0dc88e0291b [id=2f4b354c54fc4dec83094044ba90dded]) successfully deleted
I20260925 01:49:54.588557 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 941fd8333f6d45878677e55ff6948bbf (DEFAULT_TABLE table=default.Table_cb4260d7591d4bf1b0c9e2a926970fe7 [id=35b3f2605340482a97104b0fd975275f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.589121 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941fd8333f6d45878677e55ff6948bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.589679 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_26432ca1da60402cab9f0d15c955ee62" } new_table_name: "default.Table_f2f2d5debe444fca8402983e92b30646" modify_external_catalogs: true
I20260925 01:49:54.590788 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4dc36be8fb15447789f574e806bbb81e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.591380 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dc36be8fb15447789f574e806bbb81e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.592542 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1f98ed2304fb4bfaa17e725eca54b7ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.593080 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f98ed2304fb4bfaa17e725eca54b7ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.595927 11355 tablet_service.cc:1511] Processing CreateTablet for tablet c2fe086048c04e0db797272e50f21c91 (DEFAULT_TABLE table=default.Table_e297a48065794637b13d401d13c54906 [id=1091c7fd09f344db898a0a98d6ea8bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.596704 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fe086048c04e0db797272e50f21c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.603312 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet ca76f6f710d841fd8999b40e5a48693f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:54.605086 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 33967e5e11524b78bb86ce7a3e2e16ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33967e5e11524b78bb86ce7a3e2e16ad already in progress: creating tablet
I20260925 01:49:54.607625 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 (DEFAULT_TABLE table=default.Table_ca11a48fdf91477da5a1262664f1bb58 [id=e895a550479a4427ae79ecd31d1cc4e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.610090 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 49b110516abb45d1880d0e0e33e20174 (DEFAULT_TABLE table=default.Table_3d10755c25e9452c8175928253480e9e [id=829de5b617c449de81f9b1c224dbf0bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.611505 11344 tablet_service.cc:1511] Processing CreateTablet for tablet a0a50af9614341d49c4c690e2ec785b0 (DEFAULT_TABLE table=default.Table_359930648bba4aa1b2c8e3b294aac1e0 [id=0921cdbf570d44939373e1054ea46415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.613991 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 95) took 6678 ms. Trace:
I20260925 01:49:54.614331 11953 rpcz_store.cc:276] 0925 01:49:47.935818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:47.935887 (+ 69us) service_pool.cc:224] Handling call
0925 01:49:54.543699 (+6607812us) ts_tablet_manager.cc:1151] Deleting tablet e2b9df8d98e5414186ef23b8b7f9cb61
0925 01:49:54.543710 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.613923 (+ 70213us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6592417}
I20260925 01:49:54.615079 11953 tablet_replica.cc:333] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:54.615595 11953 raft_consensus.cc:2243] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.616137 11953 raft_consensus.cc:2272] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.617246 11953 ts_tablet_manager.cc:1916] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.618561 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.621160 12373 raft_consensus.cc:493] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.622112 12373 raft_consensus.cc:515] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.623131 12373 leader_election.cc:290] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:54.623472 11754 tablet_bootstrap.cc:492] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:54.623533 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:54.623724 11754 ts_tablet_manager.cc:1403] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.330s user 0.032s sys 0.010s
W20260925 01:49:54.625653 11176 leader_election.cc:343] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.627535 11754 raft_consensus.cc:359] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.627872 11754 raft_consensus.cc:385] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.629242 11754 raft_consensus.cc:740] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.629669 11754 consensus_queue.cc:260] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.630359 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.632366 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7f7ee517df483b83d1627cdb6f9433 (DEFAULT_TABLE table=default.Table_3ee0ad1909f644498b594873c3d11c23 [id=48a879b2086842449b425f4930f1c5a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.634980 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 681356bc659f4ca990cd2ffc0c10b533 (DEFAULT_TABLE table=default.Table_8d514818f2024dce89bf6d1480c69b09 [id=0a48dd4feb2542deaa4dacfa997da5e3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:54.635197 11177 leader_election.cc:343] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.636978 11177 leader_election.cc:304] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:49:54.638525 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e2b9df8d98e5414186ef23b8b7f9cb61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2b9df8d98e5414186ef23b8b7f9cb61 already in progress: creating tablet
I20260925 01:49:54.646668 11754 ts_tablet_manager.cc:1434] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260925 01:49:54.647038 11754 tablet_bootstrap.cc:492] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:54.648401 12373 raft_consensus.cc:2749] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.649461 11931 tablet_replica.cc:333] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:54.649677 11931 raft_consensus.cc:2243] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.650708 11931 raft_consensus.cc:2272] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.651481 11931 ts_tablet_manager.cc:1916] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.652796 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 9a82e0251ebb4500b628924c89bfe1b2 (DEFAULT_TABLE table=default.Table_366edf53ad054347ab1fdcaccf94d77e [id=d991f187447f4aedb17ee797607351f5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:54.654052 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a8055cc9b06045449e6133298c8074e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8055cc9b06045449e6133298c8074e1 already in progress: creating tablet
I20260925 01:49:54.654369 12488 raft_consensus.cc:493] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:49:54.654608 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 90647937eb364a7a973d04ea69cbc9aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90647937eb364a7a973d04ea69cbc9aa already in progress: creating tablet
I20260925 01:49:54.654677 12488 raft_consensus.cc:515] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:54.655021 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 85db5688ef064053870a39a906ad9071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85db5688ef064053870a39a906ad9071 already in progress: creating tablet
W20260925 01:49:54.655433 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b91957f62d8044ea8f6a3464c84b9e10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91957f62d8044ea8f6a3464c84b9e10 already in progress: creating tablet
I20260925 01:49:54.655802 12488 leader_election.cc:290] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:54.655980 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 80fe96946b294785b8d76564e0f5fa12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80fe96946b294785b8d76564e0f5fa12 already in progress: creating tablet
W20260925 01:49:54.656354 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b98ad0f02eb74eba897040401a164f5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b98ad0f02eb74eba897040401a164f5c already in progress: creating tablet
W20260925 01:49:54.657727 11176 consensus_peers.cc:597] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:54.658993 11755 tablet_bootstrap.cc:492] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:54.659296 11755 ts_tablet_manager.cc:1403] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.102s user 0.007s sys 0.003s
I20260925 01:49:54.660661 11755 raft_consensus.cc:359] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.660964 11755 raft_consensus.cc:385] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.661092 11755 raft_consensus.cc:740] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.661666 11755 consensus_queue.cc:260] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:54.662320 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 216792us
I20260925 01:49:54.663069 12488 consensus_queue.cc:1048] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:49:54.668431 11456 leader_election.cc:343] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 67921f86c4f6422e97d7f306262569f8
I20260925 01:49:54.670732 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:54.671000 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_296491c83e6f4329a2fd902336673a8a [id=8dcfe1cef923411faea69f4f694a51e6]). Expected version 2 got 0
I20260925 01:49:54.674453 11457 leader_election.cc:304] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.675083 12488 raft_consensus.cc:2804] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 01:49:54.675262 12488 raft_consensus.cc:697] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:54.675602 12488 consensus_queue.cc:237] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:54.679137 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3ee0ad1909f644498b594873c3d11c23" } modify_external_catalogs: true
I20260925 01:49:54.679343 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3ee0ad1909f644498b594873c3d11c23" } modify_external_catalogs: true
I20260925 01:49:54.679526 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cb4260d7591d4bf1b0c9e2a926970fe7" } new_table_name: "default.Table_92e40bc7440c40d58a6c8cb48e115457" modify_external_catalogs: true
I20260925 01:49:54.681075 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0a5bd932fcc142468b4c60bc7084337e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.681685 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a5bd932fcc142468b4c60bc7084337e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:54.684909 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b61b1bf5a8d446918edc6d166b7712ef consensus state has no leader
I20260925 01:49:54.685361 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_62d80cb30e374cc1ad9618b1df6adc21" } modify_external_catalogs: true
I20260925 01:49:54.685526 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_62d80cb30e374cc1ad9618b1df6adc21" } modify_external_catalogs: true
I20260925 01:49:54.687098 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e6ae26fb382848328c1929063046a7b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.687717 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6ae26fb382848328c1929063046a7b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:54.689028 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6b97d37704f4a0d88457d124bb4f259 consensus state has no leader
I20260925 01:49:54.689415 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_74c3e602a0454e0e8b4e734dc8dea4c6" } modify_external_catalogs: true
I20260925 01:49:54.689674 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_74c3e602a0454e0e8b4e734dc8dea4c6" } modify_external_catalogs: true
I20260925 01:49:54.692427 12373 raft_consensus.cc:493] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.693131 12373 raft_consensus.cc:515] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.694092 12373 leader_election.cc:290] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:54.695281 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ee80a2822417898c1d1d779f52867" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:54.695870 11237 raft_consensus.cc:1275] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Refusing update from remote peer aac4ec033f794d7a90b52aa4e0b6155d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260925 01:49:54.699378 11176 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:54.699544 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be89c0911dfa4b9d83d6bd88755be2b2 consensus state has no leader
I20260925 01:49:54.711758 11674 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_96bc6986d6f54927954333032937dd6e [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 1 got 0
I20260925 01:49:54.712847 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d143a5ee928e48efae3ed675e65f4871" } modify_external_catalogs: true
I20260925 01:49:54.713436 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d143a5ee928e48efae3ed675e65f4871" } modify_external_catalogs: true
I20260925 01:49:54.714305 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]). Expected version 1 got 0
I20260925 01:49:54.719782 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 (DEFAULT_TABLE table=default.Table_ca11a48fdf91477da5a1262664f1bb58 [id=e895a550479a4427ae79ecd31d1cc4e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.720508 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.720816 11754 tablet_bootstrap.cc:654] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.727329 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8551fb43d7e448a785a0c245e233db74" } new_table_name: "default.Table_0a4622121fdc4b45881e03cba7c04e0a" modify_external_catalogs: true
I20260925 01:49:54.729051 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b110516abb45d1880d0e0e33e20174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.729701 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681356bc659f4ca990cd2ffc0c10b533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.730361 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7f7ee517df483b83d1627cdb6f9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.730993 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a50af9614341d49c4c690e2ec785b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.732362 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_232e67b3ae3d4a90837f84f8df8b7482" } modify_external_catalogs: true
I20260925 01:49:54.732710 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_232e67b3ae3d4a90837f84f8df8b7482" } modify_external_catalogs: true
I20260925 01:49:54.734280 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a82e0251ebb4500b628924c89bfe1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.735453 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 039ee80a2822417898c1d1d779f52867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.743949 11212 tablet_service.cc:1511] Processing CreateTablet for tablet b9c41bc8a5de4cf1922e12f4d52ac0f6 (DEFAULT_TABLE table=default.Table_da5dec93ea784a6682a3364edb6c93af [id=0e01b647d3614cdc81e5db7b32c47510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.744828 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c41bc8a5de4cf1922e12f4d52ac0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.746788 11501 tablet_service.cc:1511] Processing CreateTablet for tablet b9c41bc8a5de4cf1922e12f4d52ac0f6 (DEFAULT_TABLE table=default.Table_da5dec93ea784a6682a3364edb6c93af [id=0e01b647d3614cdc81e5db7b32c47510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.747430 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c41bc8a5de4cf1922e12f4d52ac0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.756269 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 007ee8e3087c4a70b9c5d8436a31659f (DEFAULT_TABLE table=default.Table_67ce33e86d8543478a5454db8199d1ef [id=7fccae87a777448ea12742e2375ca799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.756870 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007ee8e3087c4a70b9c5d8436a31659f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.760735 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 236db241476a4a609869aad539fee426 (DEFAULT_TABLE table=default.Table_8d20c9d9083d44d1a86ba727ee87b628 [id=65132a4f011d4ca587b173124a9688ff]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:54.761049 11665 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_296491c83e6f4329a2fd902336673a8a [id=8dcfe1cef923411faea69f4f694a51e6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f892954cd22c48aaad2f0e20b1277844 consensus state has no leader
I20260925 01:49:54.761435 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236db241476a4a609869aad539fee426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.770812 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c348106a82d5453083795cc37f76375b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.771565 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c348106a82d5453083795cc37f76375b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.760747 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 007ee8e3087c4a70b9c5d8436a31659f (DEFAULT_TABLE table=default.Table_67ce33e86d8543478a5454db8199d1ef [id=7fccae87a777448ea12742e2375ca799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.773077 11965 raft_consensus.cc:493] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.773275 11965 raft_consensus.cc:515] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.774019 11965 leader_election.cc:290] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:54.775408 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:54.776151 11176 leader_election.cc:343] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.777107 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007ee8e3087c4a70b9c5d8436a31659f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.785923 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9f7f7ee517df483b83d1627cdb6f9433
I20260925 01:49:54.787453 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7f7ee517df483b83d1627cdb6f9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.790969 12486 raft_consensus.cc:493] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:54.791246 12486 raft_consensus.cc:515] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.792415 12486 leader_election.cc:290] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.793470 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 007ee8e3087c4a70b9c5d8436a31659f (DEFAULT_TABLE table=default.Table_67ce33e86d8543478a5454db8199d1ef [id=7fccae87a777448ea12742e2375ca799]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.794099 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007ee8e3087c4a70b9c5d8436a31659f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.803185 11931 ts_tablet_manager.cc:1929] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:54.803390 11931 log.cc:1199] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/55e9d52e3f79408a99216250aefc45c8
I20260925 01:49:54.803339 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.803879 11931 ts_tablet_manager.cc:1950] T 55e9d52e3f79408a99216250aefc45c8 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:49:54.804246 11177 leader_election.cc:343] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.804419 11177 leader_election.cc:304] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:54.804924 12373 raft_consensus.cc:2749] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.804914 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ee80a2822417898c1d1d779f52867" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:54.805483 11177 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:54.805648 11177 leader_election.cc:304] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:54.806145 12373 raft_consensus.cc:2749] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:54.806720 11754 tablet_bootstrap.cc:492] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:54.807082 11754 ts_tablet_manager.cc:1403] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.160s user 0.002s sys 0.007s
I20260925 01:49:54.807255 11345 tablet_service.cc:1511] Processing CreateTablet for tablet b9c41bc8a5de4cf1922e12f4d52ac0f6 (DEFAULT_TABLE table=default.Table_da5dec93ea784a6682a3364edb6c93af [id=0e01b647d3614cdc81e5db7b32c47510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.807893 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c41bc8a5de4cf1922e12f4d52ac0f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:54.807832 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 109037us
I20260925 01:49:54.809036 12439 consensus_queue.cc:1048] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:54.808969 11754 raft_consensus.cc:359] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.809585 12500 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:54.810871 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67921f86c4f6422e97d7f306262569f8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:54.811663 11372 raft_consensus.cc:2468] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:54.819658 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 (DEFAULT_TABLE table=default.Table_ca11a48fdf91477da5a1262664f1bb58 [id=e895a550479a4427ae79ecd31d1cc4e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.824602 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a7a1ef6d5f1e47f384b06ba12847cf6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.825441 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7a1ef6d5f1e47f384b06ba12847cf6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:54.832546 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 941fd8333f6d45878677e55ff6948bbf consensus state has no leader
I20260925 01:49:54.838816 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.840586 12489 raft_consensus.cc:493] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.840837 12489 raft_consensus.cc:515] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.841897 12489 leader_election.cc:290] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.843135 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 55e9d52e3f79408a99216250aefc45c8 (table default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]) successfully deleted
I20260925 01:49:54.843526 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet abcb285ebc1a4bfd8317546823e01b09
I20260925 01:49:54.845446 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7f7ee517df483b83d1627cdb6f9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:54.848729 11314 consensus_peers.cc:597] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:54.809806 11754 raft_consensus.cc:385] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:54.849002 11754 raft_consensus.cc:740] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:54.818559 11931 tablet_replica.cc:333] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:54.823880 11204 tablet_service.cc:1511] Processing CreateTablet for tablet c28a226deca04da6a7a3f7a2b60598bd (DEFAULT_TABLE table=default.Table_5e7e88dc65b94eeeb4237ab59d5977e5 [id=1fbb7357f1f14c38bcaef36bfed118e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.844890 11203 tablet_service.cc:1511] Processing CreateTablet for tablet d12d2cf8c4744858bf0967eeec72f381 (DEFAULT_TABLE table=default.Table_55f4b9d844104a95a649ebdd7d7def2b [id=c67ff8cea6124dd787124b925d489d7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.850760 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet abcb285ebc1a4bfd8317546823e01b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.851065 11354 tablet_service.cc:1511] Processing CreateTablet for tablet d12d2cf8c4744858bf0967eeec72f381 (DEFAULT_TABLE table=default.Table_55f4b9d844104a95a649ebdd7d7def2b [id=c67ff8cea6124dd787124b925d489d7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.851348 11359 tablet_service.cc:1511] Processing CreateTablet for tablet cdd615a0405742fcb472d92829a8d7c7 (DEFAULT_TABLE table=default.Table_f110a2374d274614a54c59ddd37553d7 [id=5dc5a14f4ab54258a830c761642e174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.851540 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12d2cf8c4744858bf0967eeec72f381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.851913 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd615a0405742fcb472d92829a8d7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.857635 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12d2cf8c4744858bf0967eeec72f381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.857482 11754 consensus_queue.cc:260] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:54.823837 12502 tablet.cc:1751] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260925 01:49:54.870177 11314 leader_election.cc:343] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 357963616763428fa69c7670e760f84e
I20260925 01:49:54.870690 12487 raft_consensus.cc:493] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:54.870872 12487 raft_consensus.cc:515] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.871740 12487 leader_election.cc:290] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.871789 11755 ts_tablet_manager.cc:1434] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.212s user 0.001s sys 0.001s
I20260925 01:49:54.877126 11350 tablet_service.cc:1511] Processing CreateTablet for tablet c28a226deca04da6a7a3f7a2b60598bd (DEFAULT_TABLE table=default.Table_5e7e88dc65b94eeeb4237ab59d5977e5 [id=1fbb7357f1f14c38bcaef36bfed118e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.878113 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 236db241476a4a609869aad539fee426 (DEFAULT_TABLE table=default.Table_8d20c9d9083d44d1a86ba727ee87b628 [id=65132a4f011d4ca587b173124a9688ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.881062 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 1cac299e4f8e4c9d90f244cd8719005a (DEFAULT_TABLE table=default.Table_4735603a234e494e8530cb2f9745858c [id=9f3c01bf46474e3cba73aed29d40d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.882001 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cac299e4f8e4c9d90f244cd8719005a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.882050 11671 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030]). Expected version 3 got 0
I20260925 01:49:54.883293 11946 ts_tablet_manager.cc:1929] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:54.884611 11931 raft_consensus.cc:2243] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.884853 11931 raft_consensus.cc:2272] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.887161 11931 ts_tablet_manager.cc:1916] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.887635 11678 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 87532a05a3cf4eccb5c27916d706adf9
I20260925 01:49:54.888054 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0e3ba459a81845699435c2e44f5c9f19
I20260925 01:49:54.890758 11754 ts_tablet_manager.cc:1434] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.079s user 0.000s sys 0.003s
I20260925 01:49:54.890754 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cc4c3ad2d7fd41d7b40fe7b8fe8b5a96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:54.891417 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet abcb285ebc1a4bfd8317546823e01b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:54.891520 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc4c3ad2d7fd41d7b40fe7b8fe8b5a96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.890196 11755 tablet_bootstrap.cc:492] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:54.892309 11754 tablet_bootstrap.cc:492] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:54.894207 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c8099602485b40e2af198824f853c448"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.894953 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8099602485b40e2af198824f853c448 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.895852 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 1cac299e4f8e4c9d90f244cd8719005a (DEFAULT_TABLE table=default.Table_4735603a234e494e8530cb2f9745858c [id=9f3c01bf46474e3cba73aed29d40d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.896268 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cac299e4f8e4c9d90f244cd8719005a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.895327 11212 tablet_service.cc:1511] Processing CreateTablet for tablet cdd615a0405742fcb472d92829a8d7c7 (DEFAULT_TABLE table=default.Table_f110a2374d274614a54c59ddd37553d7 [id=5dc5a14f4ab54258a830c761642e174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.898732 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet 113d7ccee4e349e19d3948e09d2c533d from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:54.900532 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f2f552e0658044e3b5909c7910548ce0" } new_table_name: "default.Table_6ec641e1915b414b80f52f871e36af6f" modify_external_catalogs: true
I20260925 01:49:54.900807 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c239ceffba664dce9924f9e9a62a2fc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.901399 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c239ceffba664dce9924f9e9a62a2fc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:54.902251 11314 leader_election.cc:343] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:49:54.903956 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_780efdb9ac8e46519a54518ad282d2e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:54.904601 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_780efdb9ac8e46519a54518ad282d2e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:54.907693 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7f7ee517df483b83d1627cdb6f9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.907693 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:54.911083 11946 log.cc:1199] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/357963616763428fa69c7670e760f84e
I20260925 01:49:54.911404 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 236db241476a4a609869aad539fee426 (DEFAULT_TABLE table=default.Table_8d20c9d9083d44d1a86ba727ee87b628 [id=65132a4f011d4ca587b173124a9688ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.911692 11946 ts_tablet_manager.cc:1950] T 357963616763428fa69c7670e760f84e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:54.913676 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.914915 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:54.915186 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28a226deca04da6a7a3f7a2b60598bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.916798 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236db241476a4a609869aad539fee426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.918705 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 5695f3af46974cb6a662f8788f9543e0 (DEFAULT_TABLE table=default.Table_ee607bb78c5e460d97313b3352e1e93f [id=8e08c5d291b14de4bfa817fd20ddbfd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.920113 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5695f3af46974cb6a662f8788f9543e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.920655 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 236db241476a4a609869aad539fee426. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:54.923866 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f7639fd1f1149a7973eba0c77bd7065 has no consensus state
I20260925 01:49:54.926746 11485 tablet_service.cc:1511] Processing CreateTablet for tablet c28a226deca04da6a7a3f7a2b60598bd (DEFAULT_TABLE table=default.Table_5e7e88dc65b94eeeb4237ab59d5977e5 [id=1fbb7357f1f14c38bcaef36bfed118e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.927249 11755 tablet_bootstrap.cc:654] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:54.927652 11491 tablet_service.cc:1511] Processing CreateTablet for tablet d12d2cf8c4744858bf0967eeec72f381 (DEFAULT_TABLE table=default.Table_55f4b9d844104a95a649ebdd7d7def2b [id=c67ff8cea6124dd787124b925d489d7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.928622 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28a226deca04da6a7a3f7a2b60598bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.931080 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]). Expected version 1 got 0
I20260925 01:49:54.932545 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:54.932807 11517 raft_consensus.cc:2468] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:54.933049 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_96bc6986d6f54927954333032937dd6e" } new_table_name: "default.Table_b21f64a8504443f7890c7eb3a6105499" modify_external_catalogs: true
I20260925 01:49:54.933893 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12d2cf8c4744858bf0967eeec72f381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.934013 11502 tablet_service.cc:1511] Processing CreateTablet for tablet cdd615a0405742fcb472d92829a8d7c7 (DEFAULT_TABLE table=default.Table_f110a2374d274614a54c59ddd37553d7 [id=5dc5a14f4ab54258a830c761642e174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.934674 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd615a0405742fcb472d92829a8d7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.936468 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet abcb285ebc1a4bfd8317546823e01b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.936725 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 116) took 6143 ms. Trace:
I20260925 01:49:54.937338 11457 leader_election.cc:304] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:54.937681 11946 rpcz_store.cc:276] 0925 01:49:48.768558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.769067 (+ 509us) service_pool.cc:224] Handling call
0925 01:49:54.445646 (+5676579us) ts_tablet_manager.cc:1151] Deleting tablet 357963616763428fa69c7670e760f84e
0925 01:49:54.445657 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.610774 (+165117us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.883166 (+272392us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:54.912015 (+ 28849us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5519832}
I20260925 01:49:54.938423 11946 tablet_replica.cc:333] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:54.938675 11946 raft_consensus.cc:2243] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:54.938848 12364 raft_consensus.cc:2804] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:54.938992 12364 raft_consensus.cc:493] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:54.939132 12364 raft_consensus.cc:3060] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:54.938983 11946 raft_consensus.cc:2272] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:54.943470 11946 ts_tablet_manager.cc:1916] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:54.949622 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd615a0405742fcb472d92829a8d7c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.951838 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 357963616763428fa69c7670e760f84e (table default.Table_dec5804091454eb1a0d870700050c904 [id=4ea66d3270f54caaa02e4084c6696342]) successfully deleted
I20260925 01:49:54.953576 12364 raft_consensus.cc:515] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:54.956341 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 5695f3af46974cb6a662f8788f9543e0 (DEFAULT_TABLE table=default.Table_ee607bb78c5e460d97313b3352e1e93f [id=8e08c5d291b14de4bfa817fd20ddbfd3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:54.957132 11456 leader_election.cc:343] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ca76f6f710d841fd8999b40e5a48693f
I20260925 01:49:54.957558 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 5695f3af46974cb6a662f8788f9543e0 (DEFAULT_TABLE table=default.Table_ee607bb78c5e460d97313b3352e1e93f [id=8e08c5d291b14de4bfa817fd20ddbfd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:54.957948 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5695f3af46974cb6a662f8788f9543e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:54.953234 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:54.985692 12364 leader_election.cc:290] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:54.990593 12501 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:54.999666 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28a226deca04da6a7a3f7a2b60598bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.012619 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5695f3af46974cb6a662f8788f9543e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.049544 12263 consensus_queue.cc:1048] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:55.050624 11931 ts_tablet_manager.cc:1929] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:55.050786 11931 log.cc:1199] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/039ee80a2822417898c1d1d779f52867
I20260925 01:49:55.059952 11953 ts_tablet_manager.cc:1929] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:55.060199 11953 log.cc:1199] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/3da92b7f256647f19faeed66b4012438
I20260925 01:49:55.067477 11953 ts_tablet_manager.cc:1950] T 3da92b7f256647f19faeed66b4012438 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:55.072760 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 97) took 6835 ms. Trace:
I20260925 01:49:55.073083 11754 tablet_bootstrap.cc:654] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.072983 11953 rpcz_store.cc:276] 0925 01:49:48.237070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.237133 (+ 63us) service_pool.cc:224] Handling call
0925 01:49:54.614882 (+6377749us) ts_tablet_manager.cc:1151] Deleting tablet 3da92b7f256647f19faeed66b4012438
0925 01:49:54.614898 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.913677 (+298779us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.059124 (+145447us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.072695 (+ 13571us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6364300}
I20260925 01:49:55.073700 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 3da92b7f256647f19faeed66b4012438 (table default.Table_579fc3540ec141c1a58dac6f0cce07e1 [id=287ecf4eaf3c4f95ae8feaeebf4a3c76]) successfully deleted
I20260925 01:49:55.074314 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 96) took 6875 ms. Trace:
I20260925 01:49:55.074529 11953 rpcz_store.cc:276] 0925 01:49:48.198864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.198926 (+ 62us) service_pool.cc:224] Handling call
0925 01:49:55.074030 (+6875104us) ts_tablet_manager.cc:1151] Deleting tablet ca17585cd523440ca1e9b754f3aedf8a
0925 01:49:55.074040 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.074227 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6822817}
I20260925 01:49:55.076957 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 98) took 6834 ms. Trace:
I20260925 01:49:55.077365 11953 rpcz_store.cc:276] 0925 01:49:48.242338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.242450 (+ 112us) service_pool.cc:224] Handling call
0925 01:49:55.076566 (+6834116us) ts_tablet_manager.cc:1151] Deleting tablet 105fd502b74d442eb5d5031f56e5cb62
0925 01:49:55.076578 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.076782 (+ 204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6825149}
I20260925 01:49:55.078039 12263 raft_consensus.cc:493] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.078320 12263 raft_consensus.cc:515] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.078655 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 99) took 6835 ms. Trace:
I20260925 01:49:55.078931 11953 rpcz_store.cc:276] 0925 01:49:48.243223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.243297 (+ 74us) service_pool.cc:224] Handling call
0925 01:49:55.078350 (+6835053us) ts_tablet_manager.cc:1151] Deleting tablet 491d790067644090aa4d25f4060cc2ec
0925 01:49:55.078360 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.078572 (+ 212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6821637}
W20260925 01:49:55.079654 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 491d790067644090aa4d25f4060cc2ec because the tablet was not found. No further retry: Not found: Tablet not found: 491d790067644090aa4d25f4060cc2ec
I20260925 01:49:55.080204 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:55.081957 12263 leader_election.cc:290] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:49:55.082176 11177 leader_election.cc:343] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:55.082465 11314 leader_election.cc:343] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 357963616763428fa69c7670e760f84e
I20260925 01:49:55.082830 11314 leader_election.cc:304] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.084141 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 106) took 6665 ms. Trace:
I20260925 01:49:55.087530 12439 raft_consensus.cc:2749] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:55.088235 11953 rpcz_store.cc:276] 0925 01:49:48.415386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.415452 (+ 66us) service_pool.cc:224] Handling call
0925 01:49:55.080064 (+6664612us) ts_tablet_manager.cc:1151] Deleting tablet 17352fd6ea4e4ed9a178f1510edf4f6d
0925 01:49:55.080106 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.080348 (+ 242us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6660012}
W20260925 01:49:55.093233 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 62745.6us
W20260925 01:49:55.096731 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 17352fd6ea4e4ed9a178f1510edf4f6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17352fd6ea4e4ed9a178f1510edf4f6d already in progress: creating tablet
I20260925 01:49:55.103276 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 110) took 6580 ms. Trace:
I20260925 01:49:55.110756 11931 ts_tablet_manager.cc:1950] T 039ee80a2822417898c1d1d779f52867 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:55.105139 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:55.111564 11376 raft_consensus.cc:2393] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:49:55.112243 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 039ee80a2822417898c1d1d779f52867 (table default.Table_de50999ba7d245feb33ce6cd4a90bc03 [id=b011ff7009fc4e419f245e75f8fec10d]) successfully deleted
W20260925 01:49:55.113070 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9f7f7ee517df483b83d1627cdb6f9433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7f7ee517df483b83d1627cdb6f9433 already in progress: creating tablet
W20260925 01:49:55.113895 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet abcb285ebc1a4bfd8317546823e01b09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abcb285ebc1a4bfd8317546823e01b09 already in progress: creating tablet
W20260925 01:49:55.114722 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 0e3ba459a81845699435c2e44f5c9f19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e3ba459a81845699435c2e44f5c9f19 already in progress: creating tablet
I20260925 01:49:55.124387 11754 tablet_bootstrap.cc:492] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:55.124595 11754 ts_tablet_manager.cc:1403] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.234s user 0.000s sys 0.008s
I20260925 01:49:55.125587 11754 raft_consensus.cc:359] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.125805 11754 raft_consensus.cc:385] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.125900 11754 raft_consensus.cc:740] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.126262 11754 consensus_queue.cc:260] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.126921 11754 ts_tablet_manager.cc:1434] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:49:55.127256 11754 tablet_bootstrap.cc:492] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:55.123750 11953 rpcz_store.cc:276] 0925 01:49:48.522446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.522507 (+ 61us) service_pool.cc:224] Handling call
0925 01:49:55.102976 (+6580469us) ts_tablet_manager.cc:1151] Deleting tablet 331380a2be9a4893927c9b94a2c3e08b
0925 01:49:55.102987 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.103173 (+ 186us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6559430}
W20260925 01:49:55.133046 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 331380a2be9a4893927c9b94a2c3e08b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 331380a2be9a4893927c9b94a2c3e08b already in progress: creating tablet
I20260925 01:49:55.133841 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 112) took 6578 ms. Trace:
I20260925 01:49:55.134318 11953 rpcz_store.cc:276] 0925 01:49:48.555797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.556292 (+ 495us) service_pool.cc:224] Handling call
0925 01:49:55.133517 (+6577225us) ts_tablet_manager.cc:1151] Deleting tablet 75a8e09b8838443c9bfff440ff1f877d
0925 01:49:55.133564 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.133769 (+ 205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6564454}
W20260925 01:49:55.135489 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 75a8e09b8838443c9bfff440ff1f877d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75a8e09b8838443c9bfff440ff1f877d already in progress: creating tablet
I20260925 01:49:55.136284 11953 tablet_replica.cc:333] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:55.137003 11953 raft_consensus.cc:2243] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:55.148450 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 1cac299e4f8e4c9d90f244cd8719005a (DEFAULT_TABLE table=default.Table_4735603a234e494e8530cb2f9745858c [id=9f3c01bf46474e3cba73aed29d40d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.156919 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:55.159608 11753 tablet_bootstrap.cc:492] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:55.160995 11755 tablet_bootstrap.cc:492] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:55.161229 11755 ts_tablet_manager.cc:1403] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.279s user 0.028s sys 0.048s
I20260925 01:49:55.162480 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cac299e4f8e4c9d90f244cd8719005a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.168134 11946 ts_tablet_manager.cc:1929] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:55.168355 11946 log.cc:1199] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/00906edfa6b648229bcba8e59d68b969
I20260925 01:49:55.169066 11753 ts_tablet_manager.cc:1403] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.579s user 0.008s sys 0.013s
I20260925 01:49:55.170074 11946 ts_tablet_manager.cc:1950] T 00906edfa6b648229bcba8e59d68b969 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:55.170069 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0749a0ae58df4ff8b74a86f072332fad
I20260925 01:49:55.170866 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 143) took 5998 ms. Trace:
I20260925 01:49:55.171190 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 0749a0ae58df4ff8b74a86f072332fad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.173887 11946 rpcz_store.cc:276] 0925 01:49:49.172892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.172968 (+ 76us) service_pool.cc:224] Handling call
0925 01:49:54.937970 (+5765002us) ts_tablet_manager.cc:1151] Deleting tablet 00906edfa6b648229bcba8e59d68b969
0925 01:49:54.937983 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:54.969243 (+ 31260us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.167912 (+198669us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.170826 (+ 2914us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5719837}
I20260925 01:49:55.175082 11755 raft_consensus.cc:359] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.175359 11755 raft_consensus.cc:385] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.175396 12502 tablet.cc:1751] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:55.175495 11755 raft_consensus.cc:740] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.175789 11755 consensus_queue.cc:260] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.176363 11755 ts_tablet_manager.cc:1434] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
W20260925 01:49:55.176615 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 211524us
I20260925 01:49:55.176707 11755 tablet_bootstrap.cc:492] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:55.179275 11425 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:55.184269 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b6efeae552494a8a9e6f6970c7b0dce0" } new_table_name: "default.Table_1cdf240ece4148e88d0b728903d255df" modify_external_catalogs: true
I20260925 01:49:55.188522 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]). Expected version 2 got 0
I20260925 01:49:55.189024 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_17cf387aca9e4b949195e91a5101157e [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 2 got 0
I20260925 01:49:55.189599 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
W20260925 01:49:55.179172 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 235687us
I20260925 01:49:55.195251 11753 raft_consensus.cc:359] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.195658 11753 raft_consensus.cc:385] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.195799 11753 raft_consensus.cc:740] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.196102 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 144) took 5956 ms. Trace:
I20260925 01:49:55.196343 11753 consensus_queue.cc:260] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.197033 11753 ts_tablet_manager.cc:1434] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260925 01:49:55.197201 11946 rpcz_store.cc:276] 0925 01:49:49.223022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.223077 (+ 55us) service_pool.cc:224] Handling call
0925 01:49:55.175603 (+5952526us) ts_tablet_manager.cc:1151] Deleting tablet 1f778b87d307483b9edb17dce7355a65
0925 01:49:55.175613 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.179060 (+ 3447us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5946818}
I20260925 01:49:55.201921 11457 leader_election.cc:304] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.206200 12508 raft_consensus.cc:3060] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.206483 12462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Bootstrap replayed 1/1 log segments. Stats: ops{read=167 overwritten=0 applied=166 ignored=0} inserts{seen=162 ignored=0} mutations{seen=181 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260925 01:49:55.203370 11753 tablet_bootstrap.cc:492] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:55.207684 12462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: Bootstrap complete.
I20260925 01:49:55.203842 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 145) took 5972 ms. Trace:
I20260925 01:49:55.208367 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 00906edfa6b648229bcba8e59d68b969 (table default.Table_6ae7ffbe7b334c87a1be9c5c18761c65 [id=1c424cf98429473f9896b9c4028e11f6]) successfully deleted
I20260925 01:49:55.208714 11946 rpcz_store.cc:276] 0925 01:49:49.231510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.254010 (+ 22500us) service_pool.cc:224] Handling call
0925 01:49:55.203674 (+5949664us) ts_tablet_manager.cc:1151] Deleting tablet 9cd2e1bf7d3e4459a84235b9c3f5383c
0925 01:49:55.203686 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.203808 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5924073}
I20260925 01:49:55.209272 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 148) took 5750 ms. Trace:
I20260925 01:49:55.210886 11946 rpcz_store.cc:276] 0925 01:49:49.459079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.459145 (+ 66us) service_pool.cc:224] Handling call
0925 01:49:55.209101 (+5749956us) ts_tablet_manager.cc:1151] Deleting tablet 644b28192e3b45e7b5370d55804cb043
0925 01:49:55.209113 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.209237 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5749625}
I20260925 01:49:55.213660 11946 tablet_replica.cc:333] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:55.214326 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67921f86c4f6422e97d7f306262569f8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:55.214592 11376 raft_consensus.cc:3060] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.215456 11953 raft_consensus.cc:2272] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:55.220091 12462 raft_consensus.cc:359] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:55.222821 12486 raft_consensus.cc:493] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.225363 11755 tablet_bootstrap.cc:654] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.226759 12486 raft_consensus.cc:515] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.225610 11953 ts_tablet_manager.cc:1916] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:55.228859 12486 leader_election.cc:290] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.226715 11376 raft_consensus.cc:2468] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:55.230808 11755 tablet_bootstrap.cc:492] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:55.231060 11755 ts_tablet_manager.cc:1403] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.002s
I20260925 01:49:55.231175 11376 raft_consensus.cc:3060] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.232331 11755 raft_consensus.cc:359] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:55.232666 11755 raft_consensus.cc:385] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.232784 11755 raft_consensus.cc:740] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.233146 11755 consensus_queue.cc:260] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:55.236943 11755 ts_tablet_manager.cc:1434] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260925 01:49:55.238186 11755 tablet_bootstrap.cc:492] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:55.239630 12500 tablet.cc:1751] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:55.241173 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:55.241873 11755 tablet_bootstrap.cc:654] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.254165 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 347a144e18ab4f6e834551044a2ac4ae from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:55.259187 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fc194d4f46f0472fafaeeaa06e43f1dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.259829 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc194d4f46f0472fafaeeaa06e43f1dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.263404 12425 raft_consensus.cc:493] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.263851 11288 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:55.263803 12425 raft_consensus.cc:515] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.264637 12425 leader_election.cc:290] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.265832 11314 leader_election.cc:304] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.266948 12486 raft_consensus.cc:2804] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:55.267081 12486 raft_consensus.cc:493] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:55.267213 12486 raft_consensus.cc:3060] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:55.271524 12486 raft_consensus.cc:515] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.271633 12502 tablet.cc:1751] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:55.214316 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 0749a0ae58df4ff8b74a86f072332fad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:55.272609 12486 leader_election.cc:290] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.272961 12500 tablet.cc:1751] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:55.273943 12462 raft_consensus.cc:740] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca2cee7752c249f68a372ef5c6a18bff, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.274936 12462 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 166, Last appended: 3.167, Last appended by leader: 167, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:55.282079 12523 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:55.285115 12523 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:55.284948 12462 sys_catalog.cc:565] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: configured and running, proceeding with master startup.
I20260925 01:49:55.291311 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 113d7ccee4e349e19d3948e09d2c533d
I20260925 01:49:55.292098 11674 catalog_manager.cc:6934] ReplaceTablet: tablet 113d7ccee4e349e19d3948e09d2c533d deleted and replaced by tablet daf6b1408d094086a79488d64dc62c75
I20260925 01:49:55.293752 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 113d7ccee4e349e19d3948e09d2c533d with delete_type TABLET_DATA_DELETED (replaced by tablet daf6b1408d094086a79488d64dc62c75) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:55.299721 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 154753us
I20260925 01:49:55.300217 11379 raft_consensus.cc:3060] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.303781 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 0749a0ae58df4ff8b74a86f072332fad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.309676 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_99e2eca2291a4b8796db4daec4dd1433"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.272033 11456 leader_election.cc:343] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 67921f86c4f6422e97d7f306262569f8
W20260925 01:49:55.310436 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99e2eca2291a4b8796db4daec4dd1433 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:55.312820 11176 leader_election.cc:343] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:55.313832 11755 tablet_bootstrap.cc:492] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:55.314121 11755 ts_tablet_manager.cc:1403] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.076s user 0.006s sys 0.021s
I20260925 01:49:55.315929 11755 raft_consensus.cc:359] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.316325 11755 raft_consensus.cc:385] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.316653 11755 raft_consensus.cc:740] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.317272 11755 consensus_queue.cc:260] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.318199 11755 ts_tablet_manager.cc:1434] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:49:55.318668 11755 tablet_bootstrap.cc:492] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:55.321046 11755 tablet_bootstrap.cc:654] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:55.322175 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b2eed649c6f447d8f9af98637061af1 has no consensus state
I20260925 01:49:55.322850 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8d20c9d9083d44d1a86ba727ee87b628" } modify_external_catalogs: true
I20260925 01:49:55.323191 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8d20c9d9083d44d1a86ba727ee87b628" } modify_external_catalogs: true
I20260925 01:49:55.323328 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2e9bde6692d24d64b1d48ccbd294a8ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.324220 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e9bde6692d24d64b1d48ccbd294a8ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:55.333595 11314 consensus_peers.cc:597] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba19192502634f8599407d923114a627. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:55.336616 11753 tablet_bootstrap.cc:654] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.313160 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 113d7ccee4e349e19d3948e09d2c533d with delete_type TABLET_DATA_DELETED (replaced by tablet daf6b1408d094086a79488d64dc62c75) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.337778 11176 leader_election.cc:304] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:55.338254 12373 raft_consensus.cc:2749] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:55.338668 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 0749a0ae58df4ff8b74a86f072332fad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0749a0ae58df4ff8b74a86f072332fad already in progress: creating tablet
W20260925 01:49:55.335834 11314 consensus_peers.cc:597] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00906edfa6b648229bcba8e59d68b969. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:55.339459 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 113d7ccee4e349e19d3948e09d2c533d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113d7ccee4e349e19d3948e09d2c533d already in progress: creating tablet
I20260925 01:49:55.342537 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_947208be83344047aac510e1bce1ee26" } new_table_name: "default.Table_834ad22033664a878040029e15dab53b" modify_external_catalogs: true
W20260925 01:49:55.342001 11314 leader_election.cc:343] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ccffbe61eea34333abdc6da94612c0f6
W20260925 01:49:55.344880 11314 leader_election.cc:343] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ea0fa393abfe4c5cb5a7f821ffdfaea7
W20260925 01:49:55.352603 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba378e9d37c64a8ebd56894b2101ed8f consensus state has no leader
I20260925 01:49:55.353044 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d7b8d87cdc614126a5b456bfaef70491" } modify_external_catalogs: true
I20260925 01:49:55.353238 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d7b8d87cdc614126a5b456bfaef70491" } modify_external_catalogs: true
I20260925 01:49:55.357074 11953 ts_tablet_manager.cc:1929] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:55.357280 11953 log.cc:1199] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/7900db92b35048aaa200ed3183031d6b
I20260925 01:49:55.357816 11953 ts_tablet_manager.cc:1950] T 7900db92b35048aaa200ed3183031d6b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:49:55.362715 11314 consensus_peers.cc:597] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c28c9e51d80a442486b78be32c74a94f. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:55.369707 12502 tablet.cc:1746] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Skipping requested alter to schema version 2, tablet already version 2
I20260925 01:49:55.370203 12500 tablet.cc:1746] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Skipping requested alter to schema version 2, tablet already version 2
I20260925 01:49:55.370738 12502 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260925 01:49:55.374123 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ff85bac0d22416987e8e3b379154b09 consensus state has no leader
I20260925 01:49:55.329926 12517 raft_consensus.cc:493] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.330039 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eb584e929c46f891d28ad01e6d78ae" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:55.336447 11754 tablet_bootstrap.cc:654] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.384258 11237 raft_consensus.cc:2468] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:55.385492 11314 leader_election.cc:304] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:55.385958 12486 raft_consensus.cc:2804] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:55.386132 12486 raft_consensus.cc:493] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:55.386276 12486 raft_consensus.cc:3060] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.391621 12486 raft_consensus.cc:515] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.392844 11680 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_0b0ce5f884684db28023373c46961746 [id=464edb71967c4016ae7592aaad5492d6] alter complete (version 2)
I20260925 01:49:55.394111 12486 leader_election.cc:290] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.394378 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 331380a2be9a4893927c9b94a2c3e08b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.394649 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet d3150980bb72435886486156aa98d342 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:55.394717 11931 tablet_replica.cc:333] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:55.394941 11931 raft_consensus.cc:2243] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:55.395221 11931 raft_consensus.cc:2272] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:55.395947 11931 ts_tablet_manager.cc:1916] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:55.396270 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1ff7d1bdc46449e9adbec517b976a6bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.397114 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ff7d1bdc46449e9adbec517b976a6bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.398891 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_acb7d558d3a9463e9cef61036b44d1c1" } modify_external_catalogs: true
I20260925 01:49:55.399181 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_acb7d558d3a9463e9cef61036b44d1c1" } modify_external_catalogs: true
I20260925 01:49:55.400214 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 116) took 6814 ms. Trace:
I20260925 01:49:55.400344 11953 rpcz_store.cc:276] 0925 01:49:48.586038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.586290 (+ 252us) service_pool.cc:224] Handling call
0925 01:49:55.136010 (+6549720us) ts_tablet_manager.cc:1151] Deleting tablet 7900db92b35048aaa200ed3183031d6b
0925 01:49:55.136070 (+ 60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.329875 (+193805us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.356964 (+ 27089us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.400140 (+ 43176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77854,"tablet-delete.queue_time_us":6539703}
I20260925 01:49:55.400890 11953 tablet_replica.cc:333] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:55.400905 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f2f2d5debe444fca8402983e92b30646" } new_table_name: "default.Table_3ce60e2486054c3081ecab5a46f58e16" modify_external_catalogs: true
I20260925 01:49:55.401175 11953 raft_consensus.cc:2243] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:55.401388 11953 pending_rounds.cc:70] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:55.401465 11953 pending_rounds.cc:77] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072857773277184 op_type: NO_OP noop_request { }
I20260925 01:49:55.401652 11953 raft_consensus.cc:2889] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:55.401793 11953 raft_consensus.cc:2272] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:55.402689 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 7900db92b35048aaa200ed3183031d6b (table default.Table_385efc7a6717414e9ba0e1ec7e7382b7 [id=4784699637264596b3ce20f15515fd38]) successfully deleted
I20260925 01:49:55.403529 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_91355e6a2a11467f8375581add0caae9" } modify_external_catalogs: true
I20260925 01:49:55.403829 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_91355e6a2a11467f8375581add0caae9" } modify_external_catalogs: true
I20260925 01:49:55.405341 11931 ts_tablet_manager.cc:1929] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:55.405512 11931 log.cc:1199] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/331380a2be9a4893927c9b94a2c3e08b
I20260925 01:49:55.405516 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eb584e929c46f891d28ad01e6d78ae" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:55.405747 11237 raft_consensus.cc:3060] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.406134 11931 ts_tablet_manager.cc:1950] T 331380a2be9a4893927c9b94a2c3e08b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:55.406714 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 331380a2be9a4893927c9b94a2c3e08b (table default.Table_695a3148371f44738e7ed17a0f5d2ba1 [id=e59a426273844acdbd1ce81acc4132b5]) successfully deleted
I20260925 01:49:55.409008 11237 raft_consensus.cc:2468] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:55.410866 11314 leader_election.cc:304] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:55.410929 12406 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 3 FOLLOWER]: Advancing to term 4
I20260925 01:49:55.411437 12486 raft_consensus.cc:2804] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:55.411721 12486 raft_consensus.cc:697] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:55.412271 12486 consensus_queue.cc:237] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.414577 12517 raft_consensus.cc:515] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.415813 12517 leader_election.cc:290] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:55.416468 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98ad0f02eb74eba897040401a164f5c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:55.417146 11177 leader_election.cc:343] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:55.418165 11679 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_17cf387aca9e4b949195e91a5101157e [id=2b2ff147f85b437fb7bc6a9f3ddd70d6] alter complete (version 2)
I20260925 01:49:55.425115 12425 raft_consensus.cc:493] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.425346 12425 raft_consensus.cc:515] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.426028 12425 leader_election.cc:290] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.427340 11755 tablet_bootstrap.cc:492] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:55.427578 11755 ts_tablet_manager.cc:1403] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.109s user 0.006s sys 0.002s
I20260925 01:49:55.427831 11946 raft_consensus.cc:2243] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 LEADER]: Raft consensus shutting down.
I20260925 01:49:55.428579 11755 raft_consensus.cc:359] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.428748 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98ad0f02eb74eba897040401a164f5c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:55.428851 11755 raft_consensus.cc:385] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.429126 11755 raft_consensus.cc:740] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.429428 11755 consensus_queue.cc:260] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.430176 11755 ts_tablet_manager.cc:1434] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
W20260925 01:49:55.430544 11456 consensus_peers.cc:597] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3358b78a1da48388d1f72536b1ed0a2. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:55.430706 11755 tablet_bootstrap.cc:492] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:55.431452 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 92320.6us
W20260925 01:49:55.434051 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1f778b87d307483b9edb17dce7355a65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f778b87d307483b9edb17dce7355a65 already in progress: creating tablet
W20260925 01:49:55.434549 11176 leader_election.cc:343] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:55.434661 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cd2e1bf7d3e4459a84235b9c3f5383c already in progress: creating tablet
I20260925 01:49:55.434684 11176 leader_election.cc:304] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:49:55.434894 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 644b28192e3b45e7b5370d55804cb043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 644b28192e3b45e7b5370d55804cb043 already in progress: creating tablet
W20260925 01:49:55.435386 11314 leader_election.cc:343] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:55.435446 11946 pending_rounds.cc:70] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:55.436233 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 with delete_type TABLET_DATA_DELETED (replaced by tablet b60706e2087b4ec7b63f6747534a4b0f) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.436905 11946 pending_rounds.cc:77] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7333072874194251776 op_type: NO_OP noop_request { }
I20260925 01:49:55.437062 11946 raft_consensus.cc:2889] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:55.438120 11946 raft_consensus.cc:2272] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:55.438571 11953 ts_tablet_manager.cc:1916] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:55.441457 11314 consensus_peers.cc:597] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 00906edfa6b648229bcba8e59d68b969. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:55.442525 12487 consensus_queue.cc:1048] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:49:55.443558 11314 consensus_peers.cc:597] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4195e3f8e93e40fe9dfd72710d319dca. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:55.445772 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eb584e929c46f891d28ad01e6d78ae" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:55.445982 11518 raft_consensus.cc:2468] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:55.447461 12517 raft_consensus.cc:2749] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:55.448300 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4eb584e929c46f891d28ad01e6d78ae" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:55.448951 11946 ts_tablet_manager.cc:1916] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:55.449101 11754 tablet_bootstrap.cc:492] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:55.449354 11754 ts_tablet_manager.cc:1403] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.322s user 0.007s sys 0.002s
I20260925 01:49:55.449587 11457 leader_election.cc:304] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.450227 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 113d7ccee4e349e19d3948e09d2c533d with delete_type TABLET_DATA_DELETED (replaced by tablet daf6b1408d094086a79488d64dc62c75) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:55.433113 11755 tablet_bootstrap.cc:654] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.450529 12288 raft_consensus.cc:493] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:55.450716 12288 raft_consensus.cc:515] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.451505 12288 leader_election.cc:290] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.451772 11522 raft_consensus.cc:3060] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.450773 11754 raft_consensus.cc:359] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.452344 11754 raft_consensus.cc:385] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.452430 11754 raft_consensus.cc:740] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.452718 11754 consensus_queue.cc:260] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.453284 11754 ts_tablet_manager.cc:1434] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260925 01:49:55.453620 11754 tablet_bootstrap.cc:492] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:55.455816 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0fa393abfe4c5cb5a7f821ffdfaea7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:55.456110 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccffbe61eea34333abdc6da94612c0f6" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:55.458231 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet d3150980bb72435886486156aa98d342 from {username='slave'} at 127.0.0.1:60372
W20260925 01:49:55.458885 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60411b0feafe4fef9c4fdc364163f1df consensus state has no leader
I20260925 01:49:55.459944 11754 tablet_bootstrap.cc:654] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.471458 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_17cf387aca9e4b949195e91a5101157e [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]). Expected version 2 got 0
I20260925 01:49:55.471690 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet c7944aa1ac8f4c5d8ea3aa2acae41257 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:55.472349 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7cb9be806d964f64b907aa0a93b3f943"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:55.472827 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_092ac523caf349c98af50bb4a26b2978"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.473528 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_092ac523caf349c98af50bb4a26b2978 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.473730 11519 raft_consensus.cc:3060] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Advancing to term 2
W20260925 01:49:55.473002 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cb9be806d964f64b907aa0a93b3f943 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.477288 12489 raft_consensus.cc:2804] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:55.478206 11517 raft_consensus.cc:2468] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
W20260925 01:49:55.478688 11456 leader_election.cc:343] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8b16a38a30ff44fb8d7eb01498f9b9c7
I20260925 01:49:55.478787 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 86079f22abb74d438c61ecc2a7379cbd
I20260925 01:49:55.479969 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_55f4b9d844104a95a649ebdd7d7def2b" } modify_external_catalogs: true
I20260925 01:49:55.480243 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_55f4b9d844104a95a649ebdd7d7def2b" } modify_external_catalogs: true
I20260925 01:49:55.480849 12510 consensus_queue.cc:1048] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260925 01:49:55.481045 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be89c0911dfa4b9d83d6bd88755be2b2 consensus state has no leader
I20260925 01:49:55.481541 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:55.481628 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ebffdaf09f574cc4ace973f9ab55d5c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:55.481767 12489 raft_consensus.cc:697] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:55.482153 12489 consensus_queue.cc:237] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:55.482352 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebffdaf09f574cc4ace973f9ab55d5c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.484566 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 86079f22abb74d438c61ecc2a7379cbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.485687 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 86079f22abb74d438c61ecc2a7379cbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.486333 11522 raft_consensus.cc:2468] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:55.486656 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:55.487258 11314 leader_election.cc:343] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:55.487447 11314 leader_election.cc:304] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.487771 12487 raft_consensus.cc:2749] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:55.489017 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 86079f22abb74d438c61ecc2a7379cbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:55.489373 11314 leader_election.cc:304] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.489734 12487 raft_consensus.cc:2804] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:55.489857 12487 raft_consensus.cc:493] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:55.489951 12487 raft_consensus.cc:3060] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.493939 12487 raft_consensus.cc:515] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.495353 12487 leader_election.cc:290] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.501552 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ee61931da86747969f807bf18964c511"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.502869 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee61931da86747969f807bf18964c511 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.505775 11519 raft_consensus.cc:2468] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 2.
I20260925 01:49:55.510236 11457 leader_election.cc:304] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.511288 12510 raft_consensus.cc:2749] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:55.518162 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccffbe61eea34333abdc6da94612c0f6" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:55.518512 11519 raft_consensus.cc:3060] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.521838 11679 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4] alter complete (version 2)
I20260925 01:49:55.522431 11314 leader_election.cc:304] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.525960 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_799924aa3f2542a7ac6dbdd10143019b" } new_table_name: "default.Table_b51b36266e424f8fa78dbf4ac8180c71" modify_external_catalogs: true
I20260925 01:49:55.527295 12487 raft_consensus.cc:2804] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 01:49:55.527539 12487 raft_consensus.cc:697] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:55.527828 12487 consensus_queue.cc:237] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.528604 11946 ts_tablet_manager.cc:1929] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260925 01:49:55.529049 11946 log.cc:1199] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/fa619556e5af473998080f4bbc9e5d1e
I20260925 01:49:55.529418 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9ee1a8c4418c472aa59402101cba1228"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.530084 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ee1a8c4418c472aa59402101cba1228 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:55.534556 11314 leader_election.cc:343] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ccffbe61eea34333abdc6da94612c0f6
I20260925 01:49:55.538622 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet b98ad0f02eb74eba897040401a164f5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.546003 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d21e6c10f3a34da9aa36f6f3201df482"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.546808 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d21e6c10f3a34da9aa36f6f3201df482 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.549186 11931 tablet_replica.cc:333] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:55.549520 11931 raft_consensus.cc:2243] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:55.549970 11931 raft_consensus.cc:2272] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:55.551071 11931 ts_tablet_manager.cc:1916] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:55.563210 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 728157ec17ed4df5a4a8559df6c1ac78 consensus state has no leader
I20260925 01:49:55.565167 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4271efd546954005b792c8c40c4b6c88" } new_table_name: "default.Table_9def776d49c345a6b0a348773a6c5128" modify_external_catalogs: true
I20260925 01:49:55.568938 11953 ts_tablet_manager.cc:1929] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:55.569558 11754 tablet_bootstrap.cc:492] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:55.570827 11754 ts_tablet_manager.cc:1403] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.002s
I20260925 01:49:55.572172 11754 raft_consensus.cc:359] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.572456 11754 raft_consensus.cc:385] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.572660 11754 raft_consensus.cc:740] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.572696 11953 log.cc:1199] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/357963616763428fa69c7670e760f84e
I20260925 01:49:55.573386 11953 ts_tablet_manager.cc:1950] T 357963616763428fa69c7670e760f84e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:55.573853 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 117) took 6853 ms. Trace:
I20260925 01:49:55.573971 11953 rpcz_store.cc:276] 0925 01:49:48.720366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.720959 (+ 593us) service_pool.cc:224] Handling call
0925 01:49:55.400778 (+6679819us) ts_tablet_manager.cc:1151] Deleting tablet 357963616763428fa69c7670e760f84e
0925 01:49:55.400793 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.494561 (+ 93768us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.568834 (+ 74273us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.573782 (+ 4948us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6679492}
I20260925 01:49:55.574646 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 357963616763428fa69c7670e760f84e (table default.Table_dec5804091454eb1a0d870700050c904 [id=4ea66d3270f54caaa02e4084c6696342]) successfully deleted
I20260925 01:49:55.583153 11754 consensus_queue.cc:260] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.586311 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aafe9afea11140cb990569950b3f112b" } new_table_name: "default.Table_bcb7951d232d405aa37610b2feac232d" modify_external_catalogs: true
I20260925 01:49:55.587309 11946 ts_tablet_manager.cc:1950] T fa619556e5af473998080f4bbc9e5d1e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:55.587705 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 149) took 6102 ms. Trace:
I20260925 01:49:55.587819 11946 rpcz_store.cc:276] 0925 01:49:49.485265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.485319 (+ 54us) service_pool.cc:224] Handling call
0925 01:49:55.213583 (+5728264us) ts_tablet_manager.cc:1151] Deleting tablet fa619556e5af473998080f4bbc9e5d1e
0925 01:49:55.213593 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.509534 (+295941us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.528501 (+ 18967us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:55.587668 (+ 59167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5723965}
I20260925 01:49:55.588351 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]) successfully deleted
I20260925 01:49:55.589828 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_26d49129e60a4e918addf990ff9ecace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:55.555069 12508 raft_consensus.cc:2749] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:55.555886 12501 tablet.cc:1751] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:55.560433 11519 raft_consensus.cc:2468] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
W20260925 01:49:55.591323 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26d49129e60a4e918addf990ff9ecace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.595356 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 6a773feeb51349a084efedfd338eafe0 (DEFAULT_TABLE table=default.Table_e6ae26fb382848328c1929063046a7b7 [id=7f537c3bad194458839dd31897b10910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.595803 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a773feeb51349a084efedfd338eafe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.595731 11314 leader_election.cc:304] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.595816 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 6a773feeb51349a084efedfd338eafe0 (DEFAULT_TABLE table=default.Table_e6ae26fb382848328c1929063046a7b7 [id=7f537c3bad194458839dd31897b10910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.596168 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a773feeb51349a084efedfd338eafe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.596308 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 6a773feeb51349a084efedfd338eafe0 (DEFAULT_TABLE table=default.Table_e6ae26fb382848328c1929063046a7b7 [id=7f537c3bad194458839dd31897b10910]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.596701 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a773feeb51349a084efedfd338eafe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.598361 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7e203f023745f0b9b44085b0943c6d (DEFAULT_TABLE table=default.Table_0a5bd932fcc142468b4c60bc7084337e [id=5f56ea42234d47e5b8c03859194a9f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.598743 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7e203f023745f0b9b44085b0943c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.600383 12401 raft_consensus.cc:2804] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:55.600631 12401 raft_consensus.cc:697] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:55.599825 11953 tablet_replica.cc:333] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:55.602412 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 915b1621cea64c03bd486ef32e815f5f (DEFAULT_TABLE table=default.Table_83cb911831d14ec1a87189952a773203 [id=6d2a03b0b54f40aebaac877c5a1b7ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.602831 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915b1621cea64c03bd486ef32e815f5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:55.606415 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c9364671fcc42dba51569d14979f030 consensus state has no leader
I20260925 01:49:55.606503 12501 tablet.cc:1746] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Skipping requested alter to schema version 2, tablet already version 2
I20260925 01:49:55.606879 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a4cf2abec50042869b042af574e134b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.607463 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4cf2abec50042869b042af574e134b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.601022 11953 raft_consensus.cc:2243] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:55.601128 12401 consensus_queue.cc:237] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.601656 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7e203f023745f0b9b44085b0943c6d (DEFAULT_TABLE table=default.Table_0a5bd932fcc142468b4c60bc7084337e [id=5f56ea42234d47e5b8c03859194a9f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.610175 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7e203f023745f0b9b44085b0943c6d (DEFAULT_TABLE table=default.Table_0a5bd932fcc142468b4c60bc7084337e [id=5f56ea42234d47e5b8c03859194a9f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.610353 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7e203f023745f0b9b44085b0943c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.610584 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7e203f023745f0b9b44085b0943c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.613270 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 915b1621cea64c03bd486ef32e815f5f (DEFAULT_TABLE table=default.Table_83cb911831d14ec1a87189952a773203 [id=6d2a03b0b54f40aebaac877c5a1b7ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.613669 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915b1621cea64c03bd486ef32e815f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.636735 11953 raft_consensus.cc:2272] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:55.638670 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 915b1621cea64c03bd486ef32e815f5f (DEFAULT_TABLE table=default.Table_83cb911831d14ec1a87189952a773203 [id=6d2a03b0b54f40aebaac877c5a1b7ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.639243 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915b1621cea64c03bd486ef32e815f5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.639803 11953 ts_tablet_manager.cc:1916] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:55.641628 11754 ts_tablet_manager.cc:1434] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.071s user 0.001s sys 0.001s
W20260925 01:49:55.650550 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4e5d28d466741a0a085a4f9938fffd1 consensus state has no leader
I20260925 01:49:55.655478 11754 tablet_bootstrap.cc:492] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:55.657940 11754 tablet_bootstrap.cc:654] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.658653 11677 catalog_manager.cc:5838] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } }
I20260925 01:49:55.664601 11677 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]). Expected version 1 got 0
I20260925 01:49:55.669044 11353 tablet_service.cc:1511] Processing CreateTablet for tablet a86ac7e553854304ba7b3b1d38c86c53 (DEFAULT_TABLE table=default.Table_3656d1af0d574a22a269b272ff601b97 [id=d9a25d66d3c54ed5bde8bf8875ece64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.669605 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86ac7e553854304ba7b3b1d38c86c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.666443 11212 tablet_service.cc:1511] Processing CreateTablet for tablet a86ac7e553854304ba7b3b1d38c86c53 (DEFAULT_TABLE table=default.Table_3656d1af0d574a22a269b272ff601b97 [id=d9a25d66d3c54ed5bde8bf8875ece64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.674125 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86ac7e553854304ba7b3b1d38c86c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.686868 11501 tablet_service.cc:1511] Processing CreateTablet for tablet e457c4ab4e814fc4be11ced6ca69284f (DEFAULT_TABLE table=default.Table_c8971e1e09594fddab21222ee8b73730 [id=92235f8276db4fcbbede78ce463904d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.687631 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e457c4ab4e814fc4be11ced6ca69284f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.690758 11204 tablet_service.cc:1511] Processing CreateTablet for tablet e457c4ab4e814fc4be11ced6ca69284f (DEFAULT_TABLE table=default.Table_c8971e1e09594fddab21222ee8b73730 [id=92235f8276db4fcbbede78ce463904d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.691666 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e457c4ab4e814fc4be11ced6ca69284f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.694898 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e479a88d2f84453899d98049b7fbbbe4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.695860 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e479a88d2f84453899d98049b7fbbbe4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.698506 11491 tablet_service.cc:1511] Processing CreateTablet for tablet a86ac7e553854304ba7b3b1d38c86c53 (DEFAULT_TABLE table=default.Table_3656d1af0d574a22a269b272ff601b97 [id=d9a25d66d3c54ed5bde8bf8875ece64e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.699194 12401 consensus_queue.cc:1048] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:55.699364 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86ac7e553854304ba7b3b1d38c86c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.715051 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:49:55.717682 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 150) took 6228 ms. Trace:
I20260925 01:49:55.718463 11354 tablet_service.cc:1511] Processing CreateTablet for tablet e457c4ab4e814fc4be11ced6ca69284f (DEFAULT_TABLE table=default.Table_c8971e1e09594fddab21222ee8b73730 [id=92235f8276db4fcbbede78ce463904d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.719020 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e457c4ab4e814fc4be11ced6ca69284f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.719300 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 5c44007cb7eb4263a9209cb3989d4a25 (DEFAULT_TABLE table=default.Table_c13ddf2cd0284738a0d781b7a2ccf761 [id=6495ac23936e4b829bbcd9d3218358d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.719729 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c44007cb7eb4263a9209cb3989d4a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.722005 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 5c44007cb7eb4263a9209cb3989d4a25 (DEFAULT_TABLE table=default.Table_c13ddf2cd0284738a0d781b7a2ccf761 [id=6495ac23936e4b829bbcd9d3218358d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.722566 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c44007cb7eb4263a9209cb3989d4a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.727679 11755 tablet_bootstrap.cc:492] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:55.727999 11755 ts_tablet_manager.cc:1403] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.297s user 0.004s sys 0.021s
I20260925 01:49:55.730768 11755 raft_consensus.cc:359] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.732230 11755 raft_consensus.cc:385] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.732522 11755 raft_consensus.cc:740] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.732957 11755 consensus_queue.cc:260] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.739418 11755 ts_tablet_manager.cc:1434] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:49:55.739848 11755 tablet_bootstrap.cc:492] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:55.744019 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 31ffb404d93a4436ba9e624b45650fe1
I20260925 01:49:55.744020 12487 raft_consensus.cc:493] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.745205 12487 raft_consensus.cc:515] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.745885 12487 leader_election.cc:290] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.746634 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:55.746798 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:55.747033 11237 raft_consensus.cc:2468] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:55.749312 11314 leader_election.cc:304] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:55.749632 12487 raft_consensus.cc:2804] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:55.749717 12487 raft_consensus.cc:493] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:55.749807 12487 raft_consensus.cc:3060] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.751251 11753 tablet_bootstrap.cc:492] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:55.751405 11753 ts_tablet_manager.cc:1403] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.548s user 0.004s sys 0.008s
I20260925 01:49:55.751575 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.752482 11753 raft_consensus.cc:359] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.752733 11753 raft_consensus.cc:385] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.753028 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:55.753083 12487 raft_consensus.cc:515] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.753634 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.754034 12487 leader_election.cc:290] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:55.754611 11314 leader_election.cc:343] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:55.756671 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:55.757048 11237 raft_consensus.cc:3060] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.718003 11946 rpcz_store.cc:276] 0925 01:49:49.489257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.489308 (+ 51us) service_pool.cc:224] Handling call
0925 01:49:55.717455 (+6228147us) ts_tablet_manager.cc:1151] Deleting tablet 93329036763146beb8e6a9b039cc1ec1
0925 01:49:55.717466 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.717600 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6227673}
W20260925 01:49:55.761405 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 93329036763146beb8e6a9b039cc1ec1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93329036763146beb8e6a9b039cc1ec1 already in progress: creating tablet
I20260925 01:49:55.761945 11755 tablet_bootstrap.cc:654] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.764313 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
W20260925 01:49:55.765365 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 67921f86c4f6422e97d7f306262569f8 (table default.Table_c33c7eb6481e4876aed3d7038afa9f93 [id=107d0cda55154f5e84ce4dd14d36364a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 67921f86c4f6422e97d7f306262569f8 consensus state has no leader
I20260925 01:49:55.769842 11237 raft_consensus.cc:2468] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:55.771095 11314 leader_election.cc:304] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:55.771668 12487 raft_consensus.cc:2804] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:55.771889 12487 raft_consensus.cc:697] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:55.772358 12487 consensus_queue.cc:237] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.779458 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_92e40bc7440c40d58a6c8cb48e115457" } new_table_name: "default.Table_e2f7a1b5f1b94e3b87dcaa2cab95bc6a" modify_external_catalogs: true
I20260925 01:49:55.780737 11946 tablet_replica.cc:333] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:55.781633 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d12d2cf8c4744858bf0967eeec72f381
I20260925 01:49:55.794116 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet d12d2cf8c4744858bf0967eeec72f381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.798501 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet d12d2cf8c4744858bf0967eeec72f381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.804407 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 5c44007cb7eb4263a9209cb3989d4a25 (DEFAULT_TABLE table=default.Table_c13ddf2cd0284738a0d781b7a2ccf761 [id=6495ac23936e4b829bbcd9d3218358d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.805207 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c44007cb7eb4263a9209cb3989d4a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.821674 11753 raft_consensus.cc:740] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.823441 12486 raft_consensus.cc:493] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:55.823832 12486 raft_consensus.cc:515] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.824862 12486 leader_election.cc:290] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.821964 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:55.822325 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet d12d2cf8c4744858bf0967eeec72f381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:55.822489 11946 raft_consensus.cc:2243] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:55.826000 11946 raft_consensus.cc:2272] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:55.827417 11314 leader_election.cc:343] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:55.830430 11314 leader_election.cc:343] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8b16a38a30ff44fb8d7eb01498f9b9c7
I20260925 01:49:55.831046 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:55.831569 11517 raft_consensus.cc:2468] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:55.827049 11946 ts_tablet_manager.cc:1916] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:55.832273 11314 leader_election.cc:304] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.833626 12486 raft_consensus.cc:2804] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:55.833949 12486 raft_consensus.cc:493] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:55.833828 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_71cd6d56414a44a4b1b51b2eda682e0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:55.834275 12486 raft_consensus.cc:3060] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
W20260925 01:49:55.834950 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71cd6d56414a44a4b1b51b2eda682e0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.840801 12486 raft_consensus.cc:515] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.845096 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b61b1bf5a8d446918edc6d166b7712ef
I20260925 01:49:55.848543 11931 ts_tablet_manager.cc:1929] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:55.849316 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet b61b1bf5a8d446918edc6d166b7712ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:55.851094 11569 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:55.853191 11753 consensus_queue.cc:260] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.854133 11753 ts_tablet_manager.cc:1434] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.103s user 0.001s sys 0.002s
I20260925 01:49:55.854588 11753 tablet_bootstrap.cc:492] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:55.876567 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dfa39c6eba50463f9580070cbfd7f2c9" } modify_external_catalogs: true
I20260925 01:49:55.876879 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dfa39c6eba50463f9580070cbfd7f2c9" } modify_external_catalogs: true
I20260925 01:49:55.885012 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d3150980bb72435886486156aa98d342
I20260925 01:49:55.885699 11680 catalog_manager.cc:6934] ReplaceTablet: tablet d3150980bb72435886486156aa98d342 deleted and replaced by tablet 49692d2824a34f48a4dcefad8c89618b
I20260925 01:49:55.887051 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet d3150980bb72435886486156aa98d342 with delete_type TABLET_DATA_DELETED (replaced by tablet 49692d2824a34f48a4dcefad8c89618b) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:55.869956 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2eed649c6f447d8f9af98637061af1 (DEFAULT_TABLE table=default.Table_6ec641e1915b414b80f52f871e36af6f [id=053ed5044aeb435797c6e74e3eb77336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.902897 11517 raft_consensus.cc:3060] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:55.923597 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 27a0aab75efb4d6e803ae6e335fe592a (DEFAULT_TABLE table=default.Table_45d17895ee264b84af096afd02e99ad0 [id=c3d929c6f4f0433f8de373341a924a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.930668 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 9e112a4ce48f40a196f655379c758c9c (DEFAULT_TABLE table=default.Table_8e5d86dc0f4d4b34b354608684b3b584 [id=749d99fadae243929e14d85b1505b225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.936555 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:55.937610 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:55.939558 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f110a2374d274614a54c59ddd37553d7" } new_table_name: "default.Table_68b05a96deb14f4eaddad7c1cf98a651" modify_external_catalogs: true
I20260925 01:49:55.847831 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet b61b1bf5a8d446918edc6d166b7712ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.950618 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 236db241476a4a609869aad539fee426
I20260925 01:49:55.853660 12487 raft_consensus.cc:493] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.952898 12487 raft_consensus.cc:515] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.954159 12487 leader_election.cc:290] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.875181 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2eed649c6f447d8f9af98637061af1 (DEFAULT_TABLE table=default.Table_6ec641e1915b414b80f52f871e36af6f [id=053ed5044aeb435797c6e74e3eb77336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.956508 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2eed649c6f447d8f9af98637061af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:55.888470 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet d3150980bb72435886486156aa98d342 with delete_type TABLET_DATA_DELETED (replaced by tablet 49692d2824a34f48a4dcefad8c89618b) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.918890 11755 tablet_bootstrap.cc:492] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:55.959267 11755 ts_tablet_manager.cc:1403] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.219s user 0.030s sys 0.026s
I20260925 01:49:55.960227 11755 raft_consensus.cc:359] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.960431 11755 raft_consensus.cc:385] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.960572 11755 raft_consensus.cc:740] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.960817 11755 consensus_queue.cc:260] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.961339 11755 ts_tablet_manager.cc:1434] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:55.961694 11755 tablet_bootstrap.cc:492] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:55.963871 11755 tablet_bootstrap.cc:654] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.964135 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 236db241476a4a609869aad539fee426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:55.965910 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b16a38a30ff44fb8d7eb01498f9b9c7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:55.966130 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa2e2d4bfe14b5db5b1dfd67e19f11c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:55.966293 11523 raft_consensus.cc:3060] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Advancing to term 2
W20260925 01:49:55.969689 11314 leader_election.cc:343] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8b16a38a30ff44fb8d7eb01498f9b9c7
I20260925 01:49:55.969825 11753 tablet_bootstrap.cc:654] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.969981 11523 raft_consensus.cc:2468] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 2.
I20260925 01:49:55.972525 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 236db241476a4a609869aad539fee426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:55.973088 11314 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:55.973462 11314 leader_election.cc:304] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.974027 12425 raft_consensus.cc:2804] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 01:49:55.954891 12486 leader_election.cc:290] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.974289 12425 raft_consensus.cc:697] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:55.974610 12425 consensus_queue.cc:237] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:55.976234 11314 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:49:55.976464 11314 leader_election.cc:304] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:55.977066 12445 raft_consensus.cc:2749] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:55.983132 11755 tablet_bootstrap.cc:492] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:55.983410 11755 ts_tablet_manager.cc:1403] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.002s
I20260925 01:49:55.984402 11755 raft_consensus.cc:359] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.984715 11755 raft_consensus.cc:385] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:55.984855 11755 raft_consensus.cc:740] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:55.985215 11755 consensus_queue.cc:260] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:55.987751 12516 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:55.987919 12516 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:55.988484 11755 ts_tablet_manager.cc:1434] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:49:55.988866 11755 tablet_bootstrap.cc:492] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:55.988910 12516 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:55.991430 11755 tablet_bootstrap.cc:654] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:55.992174 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:56.004313 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2eed649c6f447d8f9af98637061af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.006368 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a0aab75efb4d6e803ae6e335fe592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.008766 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e112a4ce48f40a196f655379c758c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.014281 12425 raft_consensus.cc:493] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.014474 12425 raft_consensus.cc:515] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.015754 12425 leader_election.cc:290] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.018548 11931 log.cc:1199] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/86079f22abb74d438c61ecc2a7379cbd
I20260925 01:49:56.018548 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cedc909f3c864a7cbbd12dbdfb3315ec" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:56.019155 11931 ts_tablet_manager.cc:1950] T 86079f22abb74d438c61ecc2a7379cbd P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:49:56.020912 11314 leader_election.cc:343] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: cedc909f3c864a7cbbd12dbdfb3315ec
W20260925 01:49:56.021360 11314 leader_election.cc:343] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:49:56.021552 11314 leader_election.cc:304] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:56.021989 12425 raft_consensus.cc:2749] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:56.022037 12547 tablet.cc:1751] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:55.855103 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet b61b1bf5a8d446918edc6d166b7712ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.867810 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2eed649c6f447d8f9af98637061af1 (DEFAULT_TABLE table=default.Table_6ec641e1915b414b80f52f871e36af6f [id=053ed5044aeb435797c6e74e3eb77336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.886718 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet d3150980bb72435886486156aa98d342 with delete_type TABLET_DATA_DELETED (replaced by tablet 49692d2824a34f48a4dcefad8c89618b) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.889437 11754 tablet_bootstrap.cc:492] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:56.022858 11754 ts_tablet_manager.cc:1403] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.367s user 0.022s sys 0.037s
I20260925 01:49:56.023669 12516 raft_consensus.cc:493] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac4ec033f794d7a90b52aa4e0b6155d)
I20260925 01:49:56.023834 12516 raft_consensus.cc:515] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.024408 11754 raft_consensus.cc:359] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.024658 12516 leader_election.cc:290] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.024814 11754 raft_consensus.cc:385] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.024963 11754 raft_consensus.cc:740] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.025367 11754 consensus_queue.cc:260] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:49:56.026687 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 94521.6us
I20260925 01:49:56.027016 11754 ts_tablet_manager.cc:1434] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260925 01:49:55.921300 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 27a0aab75efb4d6e803ae6e335fe592a (DEFAULT_TABLE table=default.Table_45d17895ee264b84af096afd02e99ad0 [id=c3d929c6f4f0433f8de373341a924a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.927580 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 9e112a4ce48f40a196f655379c758c9c (DEFAULT_TABLE table=default.Table_8e5d86dc0f4d4b34b354608684b3b584 [id=749d99fadae243929e14d85b1505b225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:55.971956 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 236db241476a4a609869aad539fee426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:55.990774 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:56.028620 12517 raft_consensus.cc:493] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.028820 12517 raft_consensus.cc:515] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.029903 12517 leader_election.cc:290] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:56.032337 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:56.037250 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2eed649c6f447d8f9af98637061af1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.040212 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a0aab75efb4d6e803ae6e335fe592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.040635 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e112a4ce48f40a196f655379c758c9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:56.040863 11177 leader_election.cc:343] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.043607 11456 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:56.044243 12516 raft_consensus.cc:2749] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:56.047552 12425 raft_consensus.cc:493] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.047780 12425 raft_consensus.cc:515] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.048985 12425 leader_election.cc:290] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.049799 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5021ab79dc4eaf9ed612f7125a6dca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:56.051859 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:56.064226 11314 leader_election.cc:343] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.066361 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:56.071949 11754 tablet_bootstrap.cc:492] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:56.072691 11946 ts_tablet_manager.cc:1929] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:56.072904 11946 log.cc:1199] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/cedc909f3c864a7cbbd12dbdfb3315ec
I20260925 01:49:56.073402 11946 ts_tablet_manager.cc:1950] T cedc909f3c864a7cbbd12dbdfb3315ec P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:49:56.073815 11176 leader_election.cc:343] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.074018 11176 leader_election.cc:304] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:56.074856 12517 raft_consensus.cc:2749] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:56.075628 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c5021ab79dc4eaf9ed612f7125a6dca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:56.077785 11456 leader_election.cc:304] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:56.078393 12516 raft_consensus.cc:2749] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:56.080209 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:56.087822 11755 tablet_bootstrap.cc:492] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:56.088073 11755 ts_tablet_manager.cc:1403] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.017s
I20260925 01:49:56.089061 11755 raft_consensus.cc:359] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.089335 11755 raft_consensus.cc:385] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.089432 11755 raft_consensus.cc:740] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.089721 11755 consensus_queue.cc:260] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.090332 11755 ts_tablet_manager.cc:1434] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
I20260925 01:49:56.090850 11755 tablet_bootstrap.cc:492] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:56.092495 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 152) took 6578 ms. Trace:
I20260925 01:49:56.092610 11946 rpcz_store.cc:276] 0925 01:49:49.514491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.514851 (+ 360us) service_pool.cc:224] Handling call
0925 01:49:55.780651 (+6265800us) ts_tablet_manager.cc:1151] Deleting tablet cedc909f3c864a7cbbd12dbdfb3315ec
0925 01:49:55.780668 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.883811 (+103143us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.072586 (+188775us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.092404 (+ 19818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6242199}
I20260925 01:49:56.093175 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet cedc909f3c864a7cbbd12dbdfb3315ec (table default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7]) successfully deleted
I20260925 01:49:56.097270 11931 tablet_replica.cc:333] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:56.102754 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 159) took 6308 ms. Trace:
I20260925 01:49:56.102973 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3e8965af19874c039d884161e1c6efc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.103892 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e8965af19874c039d884161e1c6efc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.102891 11946 rpcz_store.cc:276] 0925 01:49:49.794104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.794162 (+ 58us) service_pool.cc:224] Handling call
0925 01:49:56.102517 (+6308355us) ts_tablet_manager.cc:1151] Deleting tablet a9068770de0b473488bd8ea4752fb15d
0925 01:49:56.102530 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.102677 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6308085}
W20260925 01:49:56.106848 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a9068770de0b473488bd8ea4752fb15d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9068770de0b473488bd8ea4752fb15d already in progress: creating tablet
I20260925 01:49:56.107895 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 165) took 6276 ms. Trace:
I20260925 01:49:56.108063 11946 rpcz_store.cc:276] 0925 01:49:49.831659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.837389 (+ 5730us) service_pool.cc:224] Handling call
0925 01:49:56.107349 (+6269960us) ts_tablet_manager.cc:1151] Deleting tablet c7944aa1ac8f4c5d8ea3aa2acae41257
0925 01:49:56.107364 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.107822 (+ 458us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6265476}
W20260925 01:49:56.108724 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7944aa1ac8f4c5d8ea3aa2acae41257 already in progress: creating tablet
I20260925 01:49:56.110296 11755 tablet_bootstrap.cc:654] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.115451 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 167) took 6005 ms. Trace:
I20260925 01:49:56.115610 11946 rpcz_store.cc:276] 0925 01:49:50.109735 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.110378 (+ 643us) service_pool.cc:224] Handling call
0925 01:49:56.115236 (+6004858us) ts_tablet_manager.cc:1151] Deleting tablet 85d859207bbc4aefb26c726dce404c44
0925 01:49:56.115253 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.115393 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6004312}
W20260925 01:49:56.116217 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 85d859207bbc4aefb26c726dce404c44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85d859207bbc4aefb26c726dce404c44 already in progress: creating tablet
I20260925 01:49:56.119313 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 27a0aab75efb4d6e803ae6e335fe592a (DEFAULT_TABLE table=default.Table_45d17895ee264b84af096afd02e99ad0 [id=c3d929c6f4f0433f8de373341a924a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.120062 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27a0aab75efb4d6e803ae6e335fe592a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.123155 11755 tablet_bootstrap.cc:492] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:56.123345 11755 ts_tablet_manager.cc:1403] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.004s
I20260925 01:49:56.124239 11755 raft_consensus.cc:359] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.124452 11755 raft_consensus.cc:385] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.124564 11755 raft_consensus.cc:740] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.124804 11755 consensus_queue.cc:260] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.125428 11755 ts_tablet_manager.cc:1434] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:56.127009 12487 raft_consensus.cc:493] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.127249 12487 raft_consensus.cc:515] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.128170 12487 leader_election.cc:290] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:56.131255 11314 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 039ee80a2822417898c1d1d779f52867
I20260925 01:49:56.140005 12425 raft_consensus.cc:493] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.140313 12425 raft_consensus.cc:515] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.141208 12425 leader_election.cc:290] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.142199 11755 tablet_bootstrap.cc:492] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:56.143030 11314 leader_election.cc:343] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 55e9d52e3f79408a99216250aefc45c8
I20260925 01:49:56.144387 11755 tablet_bootstrap.cc:654] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.149828 11237 raft_consensus.cc:2468] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:56.160357 11754 tablet_bootstrap.cc:654] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.184127 11314 leader_election.cc:304] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:56.184759 12425 raft_consensus.cc:2804] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:56.184913 12425 raft_consensus.cc:493] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:56.185046 12425 raft_consensus.cc:3060] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:56.186533 11755 tablet_bootstrap.cc:492] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:56.186734 11755 ts_tablet_manager.cc:1403] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.034s
I20260925 01:49:56.187610 11755 raft_consensus.cc:359] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.187811 11755 raft_consensus.cc:385] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.187887 11755 raft_consensus.cc:740] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.188176 11755 consensus_queue.cc:260] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.188740 11755 ts_tablet_manager.cc:1434] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:56.189067 11755 tablet_bootstrap.cc:492] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:56.190946 11755 tablet_bootstrap.cc:654] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.193491 12425 raft_consensus.cc:515] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.197613 12425 leader_election.cc:290] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.198391 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ee80a2822417898c1d1d779f52867" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:56.198977 11931 raft_consensus.cc:2243] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:56.199812 11931 raft_consensus.cc:2272] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:56.200704 11931 ts_tablet_manager.cc:1916] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:56.202812 12517 raft_consensus.cc:493] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.207074 12517 raft_consensus.cc:515] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.208000 12517 leader_election.cc:290] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:56.208884 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e572f77e242d799c334820579268d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:56.209807 11177 leader_election.cc:343] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.214150 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:56.214761 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 166) took 6090 ms. Trace:
I20260925 01:49:56.214984 11946 rpcz_store.cc:276] 0925 01:49:50.107896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.112338 (+ 4442us) service_pool.cc:224] Handling call
0925 01:49:56.154640 (+6042302us) ts_tablet_manager.cc:1151] Deleting tablet 2e96576354fe46bf9bfcde18f0a53390
0925 01:49:56.154660 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.198090 (+ 43430us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6041963}
I20260925 01:49:56.215169 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e572f77e242d799c334820579268d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:56.215698 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 169) took 5838 ms. Trace:
W20260925 01:49:56.216213 11176 leader_election.cc:343] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.216218 11946 rpcz_store.cc:276] 0925 01:49:50.376801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.377005 (+ 204us) service_pool.cc:224] Handling call
0925 01:49:56.215529 (+5838524us) ts_tablet_manager.cc:1151] Deleting tablet 73d9a26bbfd74a30a2ae0a61aacca4d1
0925 01:49:56.215541 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.215639 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5838223}
I20260925 01:49:56.216454 11176 leader_election.cc:304] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:56.216727 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 170) took 5839 ms. Trace:
I20260925 01:49:56.216804 11946 rpcz_store.cc:276] 0925 01:49:50.376943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.377353 (+ 410us) service_pool.cc:224] Handling call
0925 01:49:56.216590 (+5839237us) ts_tablet_manager.cc:1151] Deleting tablet 5b11c6526dbc4177b3a54b3c952bbd31
0925 01:49:56.216599 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.216680 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5839012}
I20260925 01:49:56.203305 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:56.217795 11237 raft_consensus.cc:3060] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:56.219746 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 171) took 5811 ms. Trace:
I20260925 01:49:56.219864 11946 rpcz_store.cc:276] 0925 01:49:50.408211 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.408590 (+ 379us) service_pool.cc:224] Handling call
0925 01:49:56.219463 (+5810873us) ts_tablet_manager.cc:1151] Deleting tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56
0925 01:49:56.219473 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.219570 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5810587}
I20260925 01:49:56.220319 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e9d52e3f79408a99216250aefc45c8" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:56.220818 11946 tablet_replica.cc:333] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:56.221022 11946 raft_consensus.cc:2243] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:56.221405 11946 raft_consensus.cc:2272] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:56.222496 12517 raft_consensus.cc:2749] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:56.229408 11946 ts_tablet_manager.cc:1916] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:56.235391 11237 raft_consensus.cc:2468] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:56.236550 11753 tablet_bootstrap.cc:492] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:56.236737 11753 ts_tablet_manager.cc:1403] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.382s user 0.003s sys 0.015s
I20260925 01:49:56.237568 11753 raft_consensus.cc:359] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.237771 11753 raft_consensus.cc:385] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.237838 11753 raft_consensus.cc:740] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.238152 11753 consensus_queue.cc:260] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.240757 11753 ts_tablet_manager.cc:1434] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:49:56.241163 11753 tablet_bootstrap.cc:492] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:56.245756 11755 tablet_bootstrap.cc:492] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:56.246004 11755 ts_tablet_manager.cc:1403] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.000s
I20260925 01:49:56.249454 11953 ts_tablet_manager.cc:1929] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:56.250208 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1238c41b271747fe9d9f419001ea61cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.251178 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1238c41b271747fe9d9f419001ea61cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.253568 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 86079f22abb74d438c61ecc2a7379cbd (table default.Table_acb7d558d3a9463e9cef61036b44d1c1 [id=0d689fa6870547f3a57c6b6149b94754]) successfully deleted
W20260925 01:49:56.253890 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 99840us
W20260925 01:49:56.255167 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2e96576354fe46bf9bfcde18f0a53390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e96576354fe46bf9bfcde18f0a53390 already in progress: creating tablet
W20260925 01:49:56.255463 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 already in progress: creating tablet
W20260925 01:49:56.255721 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5b11c6526dbc4177b3a54b3c952bbd31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b11c6526dbc4177b3a54b3c952bbd31 already in progress: creating tablet
W20260925 01:49:56.255959 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 already in progress: creating tablet
I20260925 01:49:56.256834 11753 tablet_bootstrap.cc:654] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:56.260608 11456 consensus_peers.cc:597] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67921f86c4f6422e97d7f306262569f8. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:56.260749 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 38082c23d99148bb916b0ae74fd474b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.263510 11946 ts_tablet_manager.cc:1929] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:56.263734 11946 log.cc:1199] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a3358b78a1da48388d1f72536b1ed0a2
I20260925 01:49:56.263898 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 11a0a886d73442bd9753df870acf63f7 (DEFAULT_TABLE table=default.Table_1f9796971bef489fbaf53b6c189ec489 [id=689b9d8195ed4803b7b206fb83fced6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.264315 11946 ts_tablet_manager.cc:1950] T a3358b78a1da48388d1f72536b1ed0a2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:56.265277 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 172) took 5842 ms. Trace:
I20260925 01:49:56.265419 11946 rpcz_store.cc:276] 0925 01:49:50.422678 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.422892 (+ 214us) service_pool.cc:224] Handling call
0925 01:49:56.220743 (+5797851us) ts_tablet_manager.cc:1151] Deleting tablet a3358b78a1da48388d1f72536b1ed0a2
0925 01:49:56.220752 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.254420 (+ 33668us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.263273 (+ 8853us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.265236 (+ 1963us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5797382}
I20260925 01:49:56.265987 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a3358b78a1da48388d1f72536b1ed0a2 (table default.Table_341c53c72e0c4d22bf6650740401b19c [id=ffb823f8ca1948faaf21d345a1643605]) successfully deleted
I20260925 01:49:56.270831 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a0a886d73442bd9753df870acf63f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:56.273526 12462 thread.cc:641] auto-leader-rebalancer (catalog manager) Time spent creating pthread: real 0.542s user 0.164s sys 0.347s
W20260925 01:49:56.273674 12462 thread.cc:608] auto-leader-rebalancer (catalog manager) Time spent starting thread: real 0.542s user 0.164s sys 0.347s
I20260925 01:49:56.281255 11753 tablet_bootstrap.cc:492] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:56.281435 11753 ts_tablet_manager.cc:1403] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.003s
I20260925 01:49:56.281967 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 11a0a886d73442bd9753df870acf63f7 (DEFAULT_TABLE table=default.Table_1f9796971bef489fbaf53b6c189ec489 [id=689b9d8195ed4803b7b206fb83fced6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.282491 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a0a886d73442bd9753df870acf63f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.282341 11753 raft_consensus.cc:359] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.282639 11753 raft_consensus.cc:385] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.282728 11753 raft_consensus.cc:740] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.283072 11753 consensus_queue.cc:260] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.283865 11753 ts_tablet_manager.cc:1434] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260925 01:49:56.290711 11501 tablet_service.cc:1511] Processing CreateTablet for tablet b8e57874af21422ba2364603c6df04d1 (DEFAULT_TABLE table=default.Table_1f98ed2304fb4bfaa17e725eca54b7ce [id=e0da2945f8eb4b67bb72c89936ef62c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.291262 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e57874af21422ba2364603c6df04d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.291291 11753 tablet_bootstrap.cc:492] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:56.294164 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 (DEFAULT_TABLE table=default.Table_a9106d4e06b248f9ae0595a67271be8a [id=818ef8f0b2ca46c8b49358df930297c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.294620 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.305868 11753 tablet_bootstrap.cc:654] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.306336 11953 log.cc:1199] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/4195e3f8e93e40fe9dfd72710d319dca
I20260925 01:49:56.258639 11755 raft_consensus.cc:359] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.306921 11755 raft_consensus.cc:385] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.307148 11755 raft_consensus.cc:740] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.307476 11755 consensus_queue.cc:260] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.308243 11755 ts_tablet_manager.cc:1434] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.062s user 0.000s sys 0.001s
I20260925 01:49:56.308636 11755 tablet_bootstrap.cc:492] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:56.311656 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 793722fd5d3f4d108d85276c0925e627 (DEFAULT_TABLE table=default.Table_6f5f401e72484ae0ac6fb26604621774 [id=9f4ac222bd294ce4a0f05d9c373d9724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.312198 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793722fd5d3f4d108d85276c0925e627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.314863 11755 tablet_bootstrap.cc:654] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.269309 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 9e112a4ce48f40a196f655379c758c9c (DEFAULT_TABLE table=default.Table_8e5d86dc0f4d4b34b354608684b3b584 [id=749d99fadae243929e14d85b1505b225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.317065 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 (DEFAULT_TABLE table=default.Table_a9106d4e06b248f9ae0595a67271be8a [id=818ef8f0b2ca46c8b49358df930297c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.283257 11344 tablet_service.cc:1511] Processing CreateTablet for tablet b8e57874af21422ba2364603c6df04d1 (DEFAULT_TABLE table=default.Table_1f98ed2304fb4bfaa17e725eca54b7ce [id=e0da2945f8eb4b67bb72c89936ef62c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.317589 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.317771 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e57874af21422ba2364603c6df04d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.283968 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 793722fd5d3f4d108d85276c0925e627 (DEFAULT_TABLE table=default.Table_6f5f401e72484ae0ac6fb26604621774 [id=9f4ac222bd294ce4a0f05d9c373d9724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.322942 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793722fd5d3f4d108d85276c0925e627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.323190 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 082ec0b4620044b2843b45279b7716d9 (DEFAULT_TABLE table=default.Table_41fed6a77be94c48a21343bad5e4a5f7 [id=0e15f232d7764a0d85fb679167128363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.323699 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082ec0b4620044b2843b45279b7716d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.286669 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 (DEFAULT_TABLE table=default.Table_a9106d4e06b248f9ae0595a67271be8a [id=818ef8f0b2ca46c8b49358df930297c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.326537 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 793722fd5d3f4d108d85276c0925e627 (DEFAULT_TABLE table=default.Table_6f5f401e72484ae0ac6fb26604621774 [id=9f4ac222bd294ce4a0f05d9c373d9724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.326643 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.327225 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793722fd5d3f4d108d85276c0925e627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.328959 11485 tablet_service.cc:1511] Processing CreateTablet for tablet bf8bd1bfa4db4706b545829d6d26b660 (DEFAULT_TABLE table=default.Table_4795a346170948d996e3f9d6abec0c9d [id=90af291faed84d1b82125a6724d58bd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.329608 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1c0285c79b4e1280f3aa732e297c57 (DEFAULT_TABLE table=default.Table_7d5f8540137149d6ac35dd7be073315f [id=8c320f9189d249d2831a3faa49cc9d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.329787 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8bd1bfa4db4706b545829d6d26b660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.330154 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1c0285c79b4e1280f3aa732e297c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.332381 11212 tablet_service.cc:1511] Processing CreateTablet for tablet b8e57874af21422ba2364603c6df04d1 (DEFAULT_TABLE table=default.Table_1f98ed2304fb4bfaa17e725eca54b7ce [id=e0da2945f8eb4b67bb72c89936ef62c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.333033 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e57874af21422ba2364603c6df04d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.334467 11210 tablet_service.cc:1511] Processing CreateTablet for tablet bf8bd1bfa4db4706b545829d6d26b660 (DEFAULT_TABLE table=default.Table_4795a346170948d996e3f9d6abec0c9d [id=90af291faed84d1b82125a6724d58bd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.280550 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 173) took 5857 ms. Trace:
I20260925 01:49:56.338521 11204 tablet_service.cc:1511] Processing CreateTablet for tablet b948d000f8314491b02244bdce37ba33 (DEFAULT_TABLE table=default.Table_d12ae3dd5f37487295db3494777287c3 [id=c507bd8e7910476782a4b5e21f56d40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.340468 11946 rpcz_store.cc:276] 0925 01:49:50.422956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.423024 (+ 68us) service_pool.cc:224] Handling call
0925 01:49:56.280341 (+5857317us) ts_tablet_manager.cc:1151] Deleting tablet 784de8c6e6e1434a91106dd19cd9262a
0925 01:49:56.280364 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.280497 (+ 133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5856663}
I20260925 01:49:56.342321 11496 tablet_service.cc:1511] Processing CreateTablet for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23 (DEFAULT_TABLE table=default.Table_1cc809b190d34ac18fca6162fb4f25b4 [id=a2c6f33156564ca9bade24ce9a650e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.300968 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 11a0a886d73442bd9753df870acf63f7 (DEFAULT_TABLE table=default.Table_1f9796971bef489fbaf53b6c189ec489 [id=689b9d8195ed4803b7b206fb83fced6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.355394 11946 tablet_replica.cc:333] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:56.361296 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 774d14d5c7884f4e96662779b3100056 (DEFAULT_TABLE table=default.Table_b8778ebbb44b4938910562a360d966ee [id=34f36265a4914e14a2ec3d326b2c4be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.362004 11491 tablet_service.cc:1511] Processing CreateTablet for tablet b948d000f8314491b02244bdce37ba33 (DEFAULT_TABLE table=default.Table_d12ae3dd5f37487295db3494777287c3 [id=c507bd8e7910476782a4b5e21f56d40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.362417 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.363314 11489 tablet_service.cc:1511] Processing CreateTablet for tablet c4a069c2d1ee4475817dc26becc3ebb6 (DEFAULT_TABLE table=default.Table_de391fb6f42d400bacfbad86f1b7198e [id=bf059f47d27842bb9b375e7e38df29c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.363780 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a069c2d1ee4475817dc26becc3ebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.365554 11946 raft_consensus.cc:2243] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:56.365998 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1c0285c79b4e1280f3aa732e297c57 (DEFAULT_TABLE table=default.Table_7d5f8540137149d6ac35dd7be073315f [id=8c320f9189d249d2831a3faa49cc9d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.366621 11946 raft_consensus.cc:2272] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:56.368513 11946 ts_tablet_manager.cc:1916] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:56.368981 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8bd1bfa4db4706b545829d6d26b660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.370302 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 774d14d5c7884f4e96662779b3100056 (DEFAULT_TABLE table=default.Table_b8778ebbb44b4938910562a360d966ee [id=34f36265a4914e14a2ec3d326b2c4be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.372570 11206 tablet_service.cc:1511] Processing CreateTablet for tablet c4a069c2d1ee4475817dc26becc3ebb6 (DEFAULT_TABLE table=default.Table_de391fb6f42d400bacfbad86f1b7198e [id=bf059f47d27842bb9b375e7e38df29c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.375202 11222 tablet_service.cc:1511] Processing CreateTablet for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23 (DEFAULT_TABLE table=default.Table_1cc809b190d34ac18fca6162fb4f25b4 [id=a2c6f33156564ca9bade24ce9a650e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.376386 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 082ec0b4620044b2843b45279b7716d9 (DEFAULT_TABLE table=default.Table_41fed6a77be94c48a21343bad5e4a5f7 [id=0e15f232d7764a0d85fb679167128363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.377066 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b948d000f8314491b02244bdce37ba33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.377471 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.378286 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774d14d5c7884f4e96662779b3100056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.380671 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a069c2d1ee4475817dc26becc3ebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.385912 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7639fd1f1149a7973eba0c77bd7065 (DEFAULT_TABLE table=default.Table_0a4622121fdc4b45881e03cba7c04e0a [id=84f07f46e27249ffbbfe65bae8e07c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.386643 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082ec0b4620044b2843b45279b7716d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.387001 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7639fd1f1149a7973eba0c77bd7065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.389783 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b948d000f8314491b02244bdce37ba33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.391659 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774d14d5c7884f4e96662779b3100056. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:56.393841 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 941fd8333f6d45878677e55ff6948bbf consensus state has no leader
I20260925 01:49:56.393975 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7639fd1f1149a7973eba0c77bd7065 (DEFAULT_TABLE table=default.Table_0a4622121fdc4b45881e03cba7c04e0a [id=84f07f46e27249ffbbfe65bae8e07c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.394376 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet 4f117df272c342b6b4ea5e5a4d7fd137 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:56.394531 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1c0285c79b4e1280f3aa732e297c57 (DEFAULT_TABLE table=default.Table_7d5f8540137149d6ac35dd7be073315f [id=8c320f9189d249d2831a3faa49cc9d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.395490 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a (DEFAULT_TABLE table=default.Table_4dc36be8fb15447789f574e806bbb81e [id=e67d9889ab8b4a0aaba249b2af705cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.395499 11341 tablet_service.cc:1511] Processing CreateTablet for tablet bf8bd1bfa4db4706b545829d6d26b660 (DEFAULT_TABLE table=default.Table_4795a346170948d996e3f9d6abec0c9d [id=90af291faed84d1b82125a6724d58bd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.395911 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.396850 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 082ec0b4620044b2843b45279b7716d9 (DEFAULT_TABLE table=default.Table_41fed6a77be94c48a21343bad5e4a5f7 [id=0e15f232d7764a0d85fb679167128363]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.397221 11356 tablet_service.cc:1511] Processing CreateTablet for tablet b948d000f8314491b02244bdce37ba33 (DEFAULT_TABLE table=default.Table_d12ae3dd5f37487295db3494777287c3 [id=c507bd8e7910476782a4b5e21f56d40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.397681 11754 tablet_bootstrap.cc:492] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:56.397778 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 774d14d5c7884f4e96662779b3100056 (DEFAULT_TABLE table=default.Table_b8778ebbb44b4938910562a360d966ee [id=34f36265a4914e14a2ec3d326b2c4be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.397884 11754 ts_tablet_manager.cc:1403] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.352s user 0.007s sys 0.001s
I20260925 01:49:56.401764 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7639fd1f1149a7973eba0c77bd7065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.405845 12516 raft_consensus.cc:493] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.406081 12516 raft_consensus.cc:515] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.406698 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 92fec7ce0a494d47ba27dd61c2a87608 (DEFAULT_TABLE table=default.Table_84db866c4d6145caa30bfc8b43b0c182 [id=d842b240e7ff478e85ea733618cc41a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.407266 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fec7ce0a494d47ba27dd61c2a87608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.410233 11355 tablet_service.cc:1511] Processing CreateTablet for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23 (DEFAULT_TABLE table=default.Table_1cc809b190d34ac18fca6162fb4f25b4 [id=a2c6f33156564ca9bade24ce9a650e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.399029 11754 raft_consensus.cc:359] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.411056 11754 raft_consensus.cc:385] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.411177 11754 raft_consensus.cc:740] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.411437 11754 consensus_queue.cc:260] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.412461 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1c0285c79b4e1280f3aa732e297c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.414666 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a (DEFAULT_TABLE table=default.Table_4dc36be8fb15447789f574e806bbb81e [id=e67d9889ab8b4a0aaba249b2af705cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.415210 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.415329 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 246aafd66334407895ce235e4b2ca7f4 (DEFAULT_TABLE table=default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.415861 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7639fd1f1149a7973eba0c77bd7065 (DEFAULT_TABLE table=default.Table_0a4622121fdc4b45881e03cba7c04e0a [id=84f07f46e27249ffbbfe65bae8e07c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.404225 11314 leader_election.cc:304] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:56.417434 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 92fec7ce0a494d47ba27dd61c2a87608 (DEFAULT_TABLE table=default.Table_84db866c4d6145caa30bfc8b43b0c182 [id=d842b240e7ff478e85ea733618cc41a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.417443 12425 raft_consensus.cc:2804] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:49:56.417917 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 60976.7us
I20260925 01:49:56.418648 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a (DEFAULT_TABLE table=default.Table_4dc36be8fb15447789f574e806bbb81e [id=e67d9889ab8b4a0aaba249b2af705cba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.419924 11344 tablet_service.cc:1511] Processing CreateTablet for tablet c4a069c2d1ee4475817dc26becc3ebb6 (DEFAULT_TABLE table=default.Table_de391fb6f42d400bacfbad86f1b7198e [id=bf059f47d27842bb9b375e7e38df29c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.424568 11754 ts_tablet_manager.cc:1434] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260925 01:49:56.430436 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 246aafd66334407895ce235e4b2ca7f4 (DEFAULT_TABLE table=default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.430933 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246aafd66334407895ce235e4b2ca7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.436452 12517 raft_consensus.cc:493] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.436729 12517 raft_consensus.cc:515] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.438302 12517 leader_election.cc:290] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:56.438609 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca17585cd523440ca1e9b754f3aedf8a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:56.439430 11754 tablet_bootstrap.cc:492] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:49:56.440024 11177 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.447811 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_97ff6eaefb4e4d21ac5b13962dbd2809"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.448589 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97ff6eaefb4e4d21ac5b13962dbd2809 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.473817 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 246aafd66334407895ce235e4b2ca7f4 (DEFAULT_TABLE table=default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.472242 12516 leader_election.cc:290] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.473600 12425 raft_consensus.cc:697] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
W20260925 01:49:56.474998 11314 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.474143 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 92fec7ce0a494d47ba27dd61c2a87608 (DEFAULT_TABLE table=default.Table_84db866c4d6145caa30bfc8b43b0c182 [id=d842b240e7ff478e85ea733618cc41a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.475673 11314 leader_election.cc:304] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:56.474807 11456 leader_election.cc:343] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 55e9d52e3f79408a99216250aefc45c8
I20260925 01:49:56.476536 12487 raft_consensus.cc:2749] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:56.476178 12425 consensus_queue.cc:237] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:49:56.477247 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 57787.5us
W20260925 01:49:56.479389 11314 leader_election.cc:343] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.479498 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b880ff4c65f9490d82a5543163a16ef5" } new_table_name: "default.Table_0e29902f6a844cb5b9bc1d8e99da120e" modify_external_catalogs: true
W20260925 01:49:56.481108 11314 leader_election.cc:343] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.481783 11314 leader_election.cc:304] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:56.483224 12487 raft_consensus.cc:2749] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:56.484074 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246aafd66334407895ce235e4b2ca7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.485800 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca17585cd523440ca1e9b754f3aedf8a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:56.486634 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 59066.8us
I20260925 01:49:56.488281 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 3e12ffab16844f50be47dadcfbb3793f (DEFAULT_TABLE table=default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:56.490931 11176 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.493299 11176 leader_election.cc:304] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:56.496177 12517 raft_consensus.cc:2749] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:56.497895 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fec7ce0a494d47ba27dd61c2a87608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.498623 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 3e12ffab16844f50be47dadcfbb3793f (DEFAULT_TABLE table=default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.501538 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e12ffab16844f50be47dadcfbb3793f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.501551 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 3e12ffab16844f50be47dadcfbb3793f (DEFAULT_TABLE table=default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.501986 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e12ffab16844f50be47dadcfbb3793f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:56.506763 11667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.253:42889, user_credentials={real_user=slave}} blocked reactor thread for 43881.4us
I20260925 01:49:56.507398 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 914763e1d863493e866e29323e0fb01c (DEFAULT_TABLE table=default.Table_27834b4925234e2caedcd3329149f937 [id=335ea453e88348fc9b1ae1298a0e0b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.508136 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 914763e1d863493e866e29323e0fb01c (DEFAULT_TABLE table=default.Table_27834b4925234e2caedcd3329149f937 [id=335ea453e88348fc9b1ae1298a0e0b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.508598 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914763e1d863493e866e29323e0fb01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.510139 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet ca17585cd523440ca1e9b754f3aedf8a with delete_type TABLET_DATA_DELETED (replaced by tablet 01d50e428bfc46caa130f96ccc7e8f40) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.511489 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 6c886579e1eb4cac958514f7dc53b7b8 (DEFAULT_TABLE table=default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:56.528075 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdd615a0405742fcb472d92829a8d7c7 consensus state has no leader
I20260925 01:49:56.533638 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4089f8c8017247ab96430424fa118dd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.534507 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4089f8c8017247ab96430424fa118dd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.536590 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_73c8de7884964f1e9a3da5929fe9f64e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.537284 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73c8de7884964f1e9a3da5929fe9f64e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.538764 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3ed6d725fb664332abe7a92a862f05f6" } new_table_name: "default.Table_b234dbd8701a48f9ac1db6517557eb62" modify_external_catalogs: true
I20260925 01:49:56.540261 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bfb00ac43aff4ba89b0dc0e6f9298bbb" } new_table_name: "default.Table_c0c2a440fcfd4cdc8f97e52a83a31318" modify_external_catalogs: true
I20260925 01:49:56.555720 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 6c886579e1eb4cac958514f7dc53b7b8 (DEFAULT_TABLE table=default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.556324 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c886579e1eb4cac958514f7dc53b7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.559628 11754 tablet_bootstrap.cc:654] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.571729 12487 raft_consensus.cc:493] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.571923 12487 raft_consensus.cc:515] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.572733 12487 leader_election.cc:290] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.575374 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 914763e1d863493e866e29323e0fb01c (DEFAULT_TABLE table=default.Table_27834b4925234e2caedcd3329149f937 [id=335ea453e88348fc9b1ae1298a0e0b85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.576035 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 6c886579e1eb4cac958514f7dc53b7b8 (DEFAULT_TABLE table=default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.589808 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4f117df272c342b6b4ea5e5a4d7fd137
W20260925 01:49:56.589897 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9663d7f4008e4ee0a3ba4373258242eb consensus state has no leader
I20260925 01:49:56.591854 11679 catalog_manager.cc:6934] ReplaceTablet: tablet 4f117df272c342b6b4ea5e5a4d7fd137 deleted and replaced by tablet 137e34ae88eb453e819d82b1814bf895
I20260925 01:49:56.592291 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:56.592432 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 with delete_type TABLET_DATA_DELETED (replaced by tablet 137e34ae88eb453e819d82b1814bf895) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:56.593042 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0fa7a3941254478c800f9e366e3f7b06
I20260925 01:49:56.593725 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet 039ee80a2822417898c1d1d779f52867 from {username='slave'} at 127.0.0.1:60372
W20260925 01:49:56.595005 11677 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.194:58253 (request call id 89) took 978 ms (client timeout 1000 ms). Trace:
W20260925 01:49:56.595140 11677 rpcz_store.cc:269] 0925 01:49:55.616073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.651562 (+ 35489us) service_pool.cc:224] Handling call
0925 01:49:55.653948 (+ 2386us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00007f46ca49765d 00007f46ca497753 00007f46c7014db1 00007f46cee03acd 00007f46cef8d738 00007f46c59611f6 00007f46c5960f25 00007f46c206763e 00007f46c206651e 00007f46c206c758 00007f46c206d0bf
0925 01:49:56.594963 (+941015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:56.146924 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:49:56.147080 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:49:56.147087 (+ 7us) write_op.cc:435] Acquired schema lock
0925 01:49:56.147091 (+ 4us) tablet.cc:662] Decoding operations
0925 01:49:56.147243 (+ 152us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:49:56.147263 (+ 20us) write_op.cc:641] Partition lock acquired for write op
0925 01:49:56.147271 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0925 01:49:56.147372 (+ 101us) tablet.cc:701] Row locks acquired
0925 01:49:56.147377 (+ 5us) write_op.cc:260] PREPARE: finished
0925 01:49:56.147424 (+ 47us) write_op.cc:270] Start()
0925 01:49:56.147484 (+ 60us) write_op.cc:276] Timestamp: P: 1790300996147369 usec, L: 0
0925 01:49:56.147491 (+ 7us) op_driver.cc:348] REPLICATION: starting
0925 01:49:56.266485 (+118994us) log.cc:844] Serialized 536 byte log entry
0925 01:49:56.273129 (+ 6644us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f46c6fe71b2 00007f46c8404f55 00007f46c8403a79 00007f46c840bea0 00007f46c840bcad 0000000000aaef9c 00007f46baf63aef 00007f46baf66deb 00007f46baf66c68 0000000000aaef9c
0925 01:49:56.357873 (+ 84744us) op_driver.cc:464] REPLICATION: finished
0925 01:49:56.358135 (+ 262us) write_op.cc:301] APPLY: starting
0925 01:49:56.358155 (+ 20us) tablet.cc:1394] starting BulkCheckPresence
0925 01:49:56.358199 (+ 44us) tablet.cc:1397] finished BulkCheckPresence
0925 01:49:56.358201 (+ 2us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:49:56.358273 (+ 72us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:49:56.358308 (+ 35us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 01:49:56.358316 (+ 8us) write_op.cc:312] APPLY: finished
0925 01:49:56.358413 (+ 97us) log.cc:844] Serialized 23 byte log entry
0925 01:49:56.358496 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:56.358539 (+ 43us) write_op.cc:454] Released schema lock
0925 01:49:56.358547 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0925 01:49:56.358632 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:56.358636 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"spinlock_wait_cycles":2374016,"child_traces":[["op",{"apply.queue_time_us":201,"apply.run_cpu_time_us":487,"apply.run_wall_time_us":488,"num_ops":1,"prepare.queue_time_us":466404,"prepare.run_cpu_time_us":1553,"prepare.run_wall_time_us":155012,"raft.queue_time_us":28002,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":444,"replication_time_us":210336,"spinlock_wait_cycles":270996864}]]}
I20260925 01:49:56.596757 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fa7a3941254478c800f9e366e3f7b06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.597143 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 with delete_type TABLET_DATA_DELETED (replaced by tablet 137e34ae88eb453e819d82b1814bf895) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.598532 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:56.598795 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e9d52e3f79408a99216250aefc45c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c29e410731842aeb64ab8eeb4ccc3ca) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:56.599025 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fa7a3941254478c800f9e366e3f7b06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:56.600420 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet c4eb584e929c46f891d28ad01e6d78ae from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:56.605203 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e9d52e3f79408a99216250aefc45c8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:56.605429 11379 raft_consensus.cc:2468] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:56.607606 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_17cf387aca9e4b949195e91a5101157e" } modify_external_catalogs: true
I20260925 01:49:56.607815 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_17cf387aca9e4b949195e91a5101157e" } modify_external_catalogs: true
I20260925 01:49:56.609457 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f0078624576649ef939ea7242932cca4" } modify_external_catalogs: true
I20260925 01:49:56.609691 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f0078624576649ef939ea7242932cca4" } modify_external_catalogs: true
I20260925 01:49:56.612052 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 75a8e09b8838443c9bfff440ff1f877d from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:56.615741 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3656d1af0d574a22a269b272ff601b97" } modify_external_catalogs: true
I20260925 01:49:56.615974 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3656d1af0d574a22a269b272ff601b97" } modify_external_catalogs: true
I20260925 01:49:56.617565 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6fd1a490f7b14d32891655ef19ec0616"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.618201 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fd1a490f7b14d32891655ef19ec0616 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.619719 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 75a8e09b8838443c9bfff440ff1f877d from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:56.620405 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_999ce0c90de544958ffaff0670501f96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.621093 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_999ce0c90de544958ffaff0670501f96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.621948 11931 ts_tablet_manager.cc:1929] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:56.622658 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bcb7951d232d405aa37610b2feac232d" } modify_external_catalogs: true
I20260925 01:49:56.622927 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bcb7951d232d405aa37610b2feac232d" } modify_external_catalogs: true
W20260925 01:49:56.629890 11314 leader_election.cc:343] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 331380a2be9a4893927c9b94a2c3e08b
I20260925 01:49:56.639014 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_528651c000214450855f6b0e0a816d7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.639742 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_528651c000214450855f6b0e0a816d7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.636165 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e112a4ce48f40a196f655379c758c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.650839 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a0a886d73442bd9753df870acf63f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:56.650890 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64ce95e571524d6ea6c98087bc08d4b9 consensus state has no leader
I20260925 01:49:56.651612 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 082ec0b4620044b2843b45279b7716d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.653875 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c886579e1eb4cac958514f7dc53b7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.658222 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914763e1d863493e866e29323e0fb01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.659497 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774d14d5c7884f4e96662779b3100056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.662268 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fec7ce0a494d47ba27dd61c2a87608. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.662302 12517 raft_consensus.cc:493] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.662495 12517 raft_consensus.cc:515] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.663373 12517 leader_election.cc:290] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:56.664695 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38082c23d99148bb916b0ae74fd474b8" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:56.665555 11177 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.666636 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.666919 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fdb22e002b0644ecb997d9d8ed3203ee" } new_table_name: "default.Table_0d0d9ed21e9a4d94a35dffea244c87a8" modify_external_catalogs: true
I20260925 01:49:56.670316 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 246aafd66334407895ce235e4b2ca7f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.674330 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8bd1bfa4db4706b545829d6d26b660. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:56.675653 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e7b6bde824d74acfaaffc23a0b05db8b consensus state has no leader
I20260925 01:49:56.676525 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b948d000f8314491b02244bdce37ba33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.678244 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.680781 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7639fd1f1149a7973eba0c77bd7065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.681183 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a069c2d1ee4475817dc26becc3ebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.683844 11931 log.cc:1199] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b98ad0f02eb74eba897040401a164f5c
I20260925 01:49:56.650279 11755 tablet_bootstrap.cc:492] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:56.639674 11953 ts_tablet_manager.cc:1950] T 4195e3f8e93e40fe9dfd72710d319dca P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:56.685879 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
I20260925 01:49:56.686592 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:49:56.687455 11931 ts_tablet_manager.cc:1950] T b98ad0f02eb74eba897040401a164f5c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:56.686990 11678 catalog_manager.cc:5838] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:56.687808 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f0157a45817246cfaa0b016afdbd59cb (table default.Table_fdb22e002b0644ecb997d9d8ed3203ee [id=c3bda2bcc66f4f4ea55f4a7066905c87]). Expected version 3 got 0
I20260925 01:49:56.687948 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1c0285c79b4e1280f3aa732e297c57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.688292 11678 catalog_manager.cc:5838] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:56.688769 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_296491c83e6f4329a2fd902336673a8a [id=8dcfe1cef923411faea69f4f694a51e6]). Expected version 2 got 0
I20260925 01:49:56.689103 12425 consensus_queue.cc:1048] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 01:49:56.684398 11754 tablet_bootstrap.cc:492] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:56.689900 11754 ts_tablet_manager.cc:1403] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.251s user 0.005s sys 0.002s
I20260925 01:49:56.691394 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 370) took 1152 ms. Trace:
I20260925 01:49:56.691788 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c886579e1eb4cac958514f7dc53b7b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.692466 11931 rpcz_store.cc:276] 0925 01:49:55.538466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.538534 (+ 68us) service_pool.cc:224] Handling call
0925 01:49:56.097126 (+558592us) ts_tablet_manager.cc:1151] Deleting tablet b98ad0f02eb74eba897040401a164f5c
0925 01:49:56.097143 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.199601 (+102458us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x616000142654. stack: 00007fc2a418e5c6 00007fc2a418e380 00007fc2a319634d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fc2b0282a70 00007fc2b160b583 00007fc2b41d88b7 00007fc2b420ba64 00007fc2b41ec3a0 00007fc2b41ec12d 0000000000aaef9c 00007fc2a41d4aef 00007fc2a41d7deb 00007fc2a41d7c68
0925 01:49:56.489049 (+289448us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.621826 (+132777us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.691347 (+ 69521us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232782592,"tablet-delete.queue_time_us":558344}
I20260925 01:49:56.693193 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b98ad0f02eb74eba897040401a164f5c (table default.Table_f12eeda830be434fbc7fa9b8827978d4 [id=ded734199b0246ab9f10a405170b0091]) successfully deleted
I20260925 01:49:56.691908 11754 raft_consensus.cc:359] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.693538 11754 raft_consensus.cc:385] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.693619 11754 raft_consensus.cc:740] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.694410 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e12ffab16844f50be47dadcfbb3793f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:56.694705 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 31ffb404d93a4436ba9e624b45650fe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ffb404d93a4436ba9e624b45650fe1 already in progress: creating tablet
I20260925 01:49:56.695403 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 118) took 7958 ms. Trace:
I20260925 01:49:56.698698 11288 heartbeater.cc:344] Connected to a master server at 127.10.159.252:44823
I20260925 01:49:56.700719 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fa7a3941254478c800f9e366e3f7b06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:56.700905 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 with delete_type TABLET_DATA_DELETED (replaced by tablet 137e34ae88eb453e819d82b1814bf895) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:56.705147 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3c5021ab79dc4eaf9ed612f7125a6dca
I20260925 01:49:56.706030 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a44ffb8d5f914021ab1145c6010efd54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:56.707115 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331380a2be9a4893927c9b94a2c3e08b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:56.707429 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a44ffb8d5f914021ab1145c6010efd54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.707453 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 914763e1d863493e866e29323e0fb01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.716686 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a86ac7e553854304ba7b3b1d38c86c53
I20260925 01:49:56.718761 11679 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 137e34ae88eb453e819d82b1814bf895
I20260925 01:49:56.707011 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c5021ab79dc4eaf9ed612f7125a6dca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.720608 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c4eb584e929c46f891d28ad01e6d78ae
I20260925 01:49:56.721204 11673 catalog_manager.cc:6934] ReplaceTablet: tablet c4eb584e929c46f891d28ad01e6d78ae deleted and replaced by tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9
I20260925 01:49:56.737031 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet c4eb584e929c46f891d28ad01e6d78ae with delete_type TABLET_DATA_DELETED (replaced by tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.739598 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet a86ac7e553854304ba7b3b1d38c86c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.742676 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ee61931da86747969f807bf18964c511" } new_table_name: "default.Table_b1db4b0f469d42dab727679dc96ceef7" modify_external_catalogs: true
I20260925 01:49:56.743350 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38082c23d99148bb916b0ae74fd474b8" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:56.743718 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_54f5638c946a48a9be39bfb1d5904aed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:56.743818 11522 raft_consensus.cc:3060] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:56.744298 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54f5638c946a48a9be39bfb1d5904aed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:56.746692 11176 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:56.746980 11176 leader_election.cc:304] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:56.747423 12517 raft_consensus.cc:2749] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:56.747577 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_280affebcd9b4f96ab322b25e3b854f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.748252 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_280affebcd9b4f96ab322b25e3b854f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.748428 11457 leader_election.cc:304] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:56.694036 11754 consensus_queue.cc:260] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.748905 12558 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:49:56.749184 12558 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:49:56.751304 12561 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1694989f748dfa9cdb2c10f3f1de5. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:56.751638 12561 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:56.752297 12587 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:56.752625 12587 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:49:56.758129 11755 ts_tablet_manager.cc:1403] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.378s user 0.014s sys 0.025s
I20260925 01:49:56.758399 12558 leader_election.cc:290] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889)
I20260925 01:49:56.759131 11755 raft_consensus.cc:359] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.759397 11755 raft_consensus.cc:385] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.759485 11755 raft_consensus.cc:740] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:56.759758 11755 consensus_queue.cc:260] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.760481 11755 ts_tablet_manager.cc:1434] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:56.760860 11755 tablet_bootstrap.cc:492] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:56.761284 12406 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38062 (request call id 0) took 2203 ms. Trace:
W20260925 01:49:56.770373 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet a9944a1422d14ae2b22451e67c477d5b (table default.Table_4b87558f2a98419f96b453a44aae814b [id=a1a3b3d0054a4bff8de55b5c5e71880f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9944a1422d14ae2b22451e67c477d5b consensus state has no leader
I20260925 01:49:56.777493 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b4e5d28d466741a0a085a4f9938fffd1
I20260925 01:49:56.778491 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_26feb002759949f0881ffb854d49bbf6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.779122 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26feb002759949f0881ffb854d49bbf6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.792384 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:56.798035 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_341c53c72e0c4d22bf6650740401b19c" } new_table_name: "default.Table_5f4b4ce122da40e4b0960e58bf811412" modify_external_catalogs: true
W20260925 01:49:56.806941 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0157a45817246cfaa0b016afdbd59cb consensus state has no leader
I20260925 01:49:56.807480 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9fe01830d8654ba98bf36de7f9bf2ee3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.808084 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fe01830d8654ba98bf36de7f9bf2ee3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.812047 11520 raft_consensus.cc:1275] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Refusing update from remote peer aac4ec033f794d7a90b52aa4e0b6155d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260925 01:49:56.813851 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 46830.5us
I20260925 01:49:56.818953 12510 consensus_queue.cc:1048] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260925 01:49:56.819379 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e9d52e3f79408a99216250aefc45c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c29e410731842aeb64ab8eeb4ccc3ca) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:56.824645 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c5021ab79dc4eaf9ed612f7125a6dca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:56.825567 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet c4eb584e929c46f891d28ad01e6d78ae with delete_type TABLET_DATA_DELETED (replaced by tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:56.825793 12508 raft_consensus.cc:2804] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:56.827060 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:56.831919 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c5021ab79dc4eaf9ed612f7125a6dca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:56.831982 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet c4eb584e929c46f891d28ad01e6d78ae with delete_type TABLET_DATA_DELETED (replaced by tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:56.832791 11953 rpcz_store.cc:276] 0925 01:49:48.730801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.730860 (+ 59us) service_pool.cc:224] Handling call
0925 01:49:55.599723 (+6868863us) ts_tablet_manager.cc:1151] Deleting tablet 4195e3f8e93e40fe9dfd72710d319dca
0925 01:49:55.599735 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:55.858394 (+258659us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.249323 (+390929us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.688799 (+439476us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6868499}
I20260925 01:49:56.833832 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet a86ac7e553854304ba7b3b1d38c86c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:56.834713 11753 tablet_bootstrap.cc:492] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:56.836078 12508 raft_consensus.cc:493] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:56.841508 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 378) took 1046 ms. Trace:
I20260925 01:49:56.841743 11931 rpcz_store.cc:276] 0925 01:49:55.795390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.798309 (+ 2919us) service_pool.cc:224] Handling call
0925 01:49:56.838149 (+1039840us) ts_tablet_manager.cc:1151] Deleting tablet d12d2cf8c4744858bf0967eeec72f381
0925 01:49:56.838164 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.841438 (+ 3274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1038955}
W20260925 01:49:56.842428 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d12d2cf8c4744858bf0967eeec72f381 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d12d2cf8c4744858bf0967eeec72f381 already in progress: creating tablet
I20260925 01:49:56.847011 11754 ts_tablet_manager.cc:1434] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.157s user 0.002s sys 0.000s
I20260925 01:49:56.851712 12508 raft_consensus.cc:3060] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:56.851754 12487 raft_consensus.cc:493] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.852748 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 120) took 8072 ms. Trace:
I20260925 01:49:56.857221 11753 ts_tablet_manager.cc:1403] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.544s user 0.018s sys 0.019s
W20260925 01:49:56.857889 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8944feb988d4509b8601689ac02b11b has no consensus state
I20260925 01:49:56.858749 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3f4553f93acd4bc68761ffa95f3a0f6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:56.858856 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2e9bde6692d24d64b1d48ccbd294a8ee" } new_table_name: "default.Table_7e40b99aed8a4375bea1481553c776f2" modify_external_catalogs: true
W20260925 01:49:56.859357 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f4553f93acd4bc68761ffa95f3a0f6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.859989 12508 raft_consensus.cc:515] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:56.857897 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 406d31139e1e441aa6fe204168486e28 consensus state has no leader
I20260925 01:49:56.861616 12508 leader_election.cc:290] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.866259 11753 raft_consensus.cc:359] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:56.866304 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a162b1569eab48759aac0ea37c2056e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:56.866885 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a162b1569eab48759aac0ea37c2056e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.868261 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_97ff6eaefb4e4d21ac5b13962dbd2809" } modify_external_catalogs: true
I20260925 01:49:56.868495 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_97ff6eaefb4e4d21ac5b13962dbd2809" } modify_external_catalogs: true
I20260925 01:49:56.869120 12599 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:49:56.869235 12599 catalog_manager.cc:1601] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: loading cluster ID for follower catalog manager: success
I20260925 01:49:56.878959 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_27834b4925234e2caedcd3329149f937" } new_table_name: "default.Table_85893e01123542caa87b171d439ef1cc" modify_external_catalogs: true
I20260925 01:49:56.884084 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:49:56.889231 11672 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:49:56.892042 11213 tablet_service.cc:1511] Processing CreateTablet for tablet c8944feb988d4509b8601689ac02b11b (DEFAULT_TABLE table=default.Table_b1db4b0f469d42dab727679dc96ceef7 [id=5cb0628becf34c7ba8119193bf0fff01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.892652 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8944feb988d4509b8601689ac02b11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.893497 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 22a335062caa48139e1cd4bca7bd4e2b (DEFAULT_TABLE table=default.Table_092ac523caf349c98af50bb4a26b2978 [id=f9a49bca286f4627b7be89057d67f78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.893900 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a335062caa48139e1cd4bca7bd4e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.898561 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 34c9661fe2914111ad322eff99c42030 (DEFAULT_TABLE table=default.Table_9ee1a8c4418c472aa59402101cba1228 [id=560863e67fe845319d7dc479443fbb37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.899231 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c9661fe2914111ad322eff99c42030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.900946 11204 tablet_service.cc:1511] Processing CreateTablet for tablet db217278aa27439587768291c4ca7e3a (DEFAULT_TABLE table=default.Table_d21e6c10f3a34da9aa36f6f3201df482 [id=f59e487e166d48368b58911e23c8600f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.901376 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db217278aa27439587768291c4ca7e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.903136 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 3541e17b47bc47f5b69add361877a2bf (DEFAULT_TABLE table=default.Table_3e8965af19874c039d884161e1c6efc2 [id=f2e6f3b413604a808c0395064f79d5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.903777 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3541e17b47bc47f5b69add361877a2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.905331 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbfbfd6d65e4ad3ae69388f85183266 (DEFAULT_TABLE table=default.Table_26d49129e60a4e918addf990ff9ecace [id=0e31385181c24fbaa534bcf8e323706b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.906207 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbfbfd6d65e4ad3ae69388f85183266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.907830 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8e5d86dc0f4d4b34b354608684b3b584" } modify_external_catalogs: true
I20260925 01:49:56.908088 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8e5d86dc0f4d4b34b354608684b3b584" } modify_external_catalogs: true
I20260925 01:49:56.911659 11755 tablet_bootstrap.cc:654] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:56.911861 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet a86ac7e553854304ba7b3b1d38c86c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:56.911638 12487 raft_consensus.cc:515] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:49:56.870671 11456 leader_election.cc:343] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 55e9d52e3f79408a99216250aefc45c8
W20260925 01:49:56.917027 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 53248.9us
I20260925 01:49:56.918467 11501 tablet_service.cc:1511] Processing CreateTablet for tablet db217278aa27439587768291c4ca7e3a (DEFAULT_TABLE table=default.Table_d21e6c10f3a34da9aa36f6f3201df482 [id=f59e487e166d48368b58911e23c8600f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.918799 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 34c9661fe2914111ad322eff99c42030 (DEFAULT_TABLE table=default.Table_9ee1a8c4418c472aa59402101cba1228 [id=560863e67fe845319d7dc479443fbb37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.918924 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db217278aa27439587768291c4ca7e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.919147 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c9661fe2914111ad322eff99c42030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.920032 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_04449fc82e9a480cbd1dfa613ef87dbd" } modify_external_catalogs: true
I20260925 01:49:56.920300 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_04449fc82e9a480cbd1dfa613ef87dbd" } modify_external_catalogs: true
I20260925 01:49:56.923223 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5c6b4a2e548d46b9a0d5685f61b90692" } modify_external_catalogs: true
I20260925 01:49:56.923532 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5c6b4a2e548d46b9a0d5685f61b90692" } modify_external_catalogs: true
I20260925 01:49:56.931875 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 22a335062caa48139e1cd4bca7bd4e2b (DEFAULT_TABLE table=default.Table_092ac523caf349c98af50bb4a26b2978 [id=f9a49bca286f4627b7be89057d67f78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.932453 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a335062caa48139e1cd4bca7bd4e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.933954 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbfbfd6d65e4ad3ae69388f85183266 (DEFAULT_TABLE table=default.Table_26d49129e60a4e918addf990ff9ecace [id=0e31385181c24fbaa534bcf8e323706b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.934414 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbfbfd6d65e4ad3ae69388f85183266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.879478 11946 ts_tablet_manager.cc:1929] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:56.939185 11946 log.cc:1199] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8dd27c6d835948ba859b4c11d8ebf783
I20260925 01:49:56.940059 11946 ts_tablet_manager.cc:1950] T 8dd27c6d835948ba859b4c11d8ebf783 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:56.940763 12585 raft_consensus.cc:493] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:56.941009 12585 raft_consensus.cc:515] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:56.942277 12585 leader_election.cc:290] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:56.947115 12487 leader_election.cc:290] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:56.950534 11953 rpcz_store.cc:276] 0925 01:49:48.763344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.763581 (+ 237us) service_pool.cc:224] Handling call
0925 01:49:56.833176 (+8069595us) ts_tablet_manager.cc:1151] Deleting tablet 4e008337914841b8a1ab4a64ecc6e181
0925 01:49:56.833187 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.835923 (+ 2736us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8069323}
W20260925 01:49:56.950809 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 81696.4us
I20260925 01:49:56.955279 11953 tablet_replica.cc:333] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:56.959086 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1e462c544f4c04a148e273f545570d (DEFAULT_TABLE table=default.Table_99e2eca2291a4b8796db4daec4dd1433 [id=f318edf82c57433098a317160c89b7db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.959412 11754 tablet_bootstrap.cc:492] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:56.959781 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1e462c544f4c04a148e273f545570d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.960919 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b07f6029133f4c1598ae22b43dc3a7cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:56.961541 11754 tablet_bootstrap.cc:654] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:56.961598 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b07f6029133f4c1598ae22b43dc3a7cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:56.962633 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 381) took 1076 ms. Trace:
I20260925 01:49:56.970644 11931 rpcz_store.cc:276] 0925 01:49:55.886050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.886528 (+ 478us) service_pool.cc:224] Handling call
0925 01:49:56.962435 (+1075907us) ts_tablet_manager.cc:1151] Deleting tablet d3150980bb72435886486156aa98d342
0925 01:49:56.962446 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.962587 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":939816}
W20260925 01:49:56.973625 11314 consensus_peers.cc:597] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea0fa393abfe4c5cb5a7f821ffdfaea7. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:56.977101 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d3150980bb72435886486156aa98d342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3150980bb72435886486156aa98d342 already in progress: creating tablet
I20260925 01:49:56.979771 12599 catalog_manager.cc:1623] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: acquiring CA information for follower catalog manager: success
I20260925 01:49:56.980103 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 384) took 1004 ms. Trace:
I20260925 01:49:56.980327 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 174) took 6498 ms. Trace:
I20260925 01:49:56.980471 11931 rpcz_store.cc:276] 0925 01:49:55.971715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.971800 (+ 85us) service_pool.cc:224] Handling call
0925 01:49:56.971911 (+1000111us) ts_tablet_manager.cc:1151] Deleting tablet 236db241476a4a609869aad539fee426
0925 01:49:56.971922 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.976594 (+ 4672us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":944268}
W20260925 01:49:56.982455 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 236db241476a4a609869aad539fee426 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 236db241476a4a609869aad539fee426 already in progress: creating tablet
I20260925 01:49:56.983228 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 379) took 1134 ms. Trace:
I20260925 01:49:56.983798 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c" } modify_external_catalogs: true
I20260925 01:49:56.983987 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c" } modify_external_catalogs: true
I20260925 01:49:56.958835 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 3541e17b47bc47f5b69add361877a2bf (DEFAULT_TABLE table=default.Table_3e8965af19874c039d884161e1c6efc2 [id=f2e6f3b413604a808c0395064f79d5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.986426 11946 rpcz_store.cc:276] 0925 01:49:50.481804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.482267 (+ 463us) service_pool.cc:224] Handling call
0925 01:49:56.341416 (+5859149us) ts_tablet_manager.cc:1151] Deleting tablet 8dd27c6d835948ba859b4c11d8ebf783
0925 01:49:56.341430 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.717239 (+375809us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.879368 (+162129us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:56.980255 (+100887us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5858792}
I20260925 01:49:56.990101 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8dd27c6d835948ba859b4c11d8ebf783 (table default.Table_7eb435d3e2ec4209bdd1f04597fcadd8 [id=e93d9881c42d4a51a90c1ffb5fe17930]) successfully deleted
I20260925 01:49:56.983469 11485 tablet_service.cc:1511] Processing CreateTablet for tablet c8944feb988d4509b8601689ac02b11b (DEFAULT_TABLE table=default.Table_b1db4b0f469d42dab727679dc96ceef7 [id=5cb0628becf34c7ba8119193bf0fff01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:56.986943 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3541e17b47bc47f5b69add361877a2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.994415 12338 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" instance_seqno: 1790300979676140) as {username='slave'} at 127.10.159.193:39399; Asking this server to re-register.
I20260925 01:49:56.998821 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8944feb988d4509b8601689ac02b11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:56.939463 11753 raft_consensus.cc:385] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:56.988263 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1e462c544f4c04a148e273f545570d (DEFAULT_TABLE table=default.Table_99e2eca2291a4b8796db4daec4dd1433 [id=f318edf82c57433098a317160c89b7db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.000131 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1e462c544f4c04a148e273f545570d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.001636 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 175) took 6517 ms. Trace:
I20260925 01:49:57.001755 11946 rpcz_store.cc:276] 0925 01:49:50.484080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.484184 (+ 104us) service_pool.cc:224] Handling call
0925 01:49:56.992744 (+6508560us) ts_tablet_manager.cc:1151] Deleting tablet 257e6f224f99427eb68fd61fa1aadae0
0925 01:49:57.001431 (+ 8687us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.001565 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6499432}
W20260925 01:49:57.002620 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 257e6f224f99427eb68fd61fa1aadae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 257e6f224f99427eb68fd61fa1aadae0 already in progress: creating tablet
I20260925 01:49:57.006202 11753 raft_consensus.cc:740] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:57.006549 11753 consensus_queue.cc:260] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:57.007592 11753 ts_tablet_manager.cc:1434] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.150s user 0.003s sys 0.000s
I20260925 01:49:57.008221 11753 tablet_bootstrap.cc:492] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:57.010047 11953 raft_consensus.cc:2243] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:57.014626 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:57.014770 11753 tablet_bootstrap.cc:654] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:57.007951 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:57.011261 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:57.015157 11237 raft_consensus.cc:2468] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:57.015506 11240 raft_consensus.cc:2468] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:57.016335 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 039ee80a2822417898c1d1d779f52867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.016342 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 331380a2be9a4893927c9b94a2c3e08b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.020833 11349 tablet_service.cc:1511] Processing CreateTablet for tablet c8944feb988d4509b8601689ac02b11b (DEFAULT_TABLE table=default.Table_b1db4b0f469d42dab727679dc96ceef7 [id=5cb0628becf34c7ba8119193bf0fff01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.021661 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.022370 11953 raft_consensus.cc:2272] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.023236 11953 ts_tablet_manager.cc:1916] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.017266 11931 rpcz_store.cc:276] 0925 01:49:55.848792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.854975 (+ 6183us) service_pool.cc:224] Handling call
0925 01:49:56.982999 (+1128024us) ts_tablet_manager.cc:1151] Deleting tablet b61b1bf5a8d446918edc6d166b7712ef
0925 01:49:56.983009 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:56.983136 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":936346}
W20260925 01:49:57.024551 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b61b1bf5a8d446918edc6d166b7712ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b61b1bf5a8d446918edc6d166b7712ef already in progress: creating tablet
I20260925 01:49:57.025082 11931 tablet_replica.cc:333] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:57.025290 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 22a335062caa48139e1cd4bca7bd4e2b (DEFAULT_TABLE table=default.Table_092ac523caf349c98af50bb4a26b2978 [id=f9a49bca286f4627b7be89057d67f78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.025457 11931 raft_consensus.cc:2243] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:57.025695 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a335062caa48139e1cd4bca7bd4e2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.025732 11931 raft_consensus.cc:2272] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.026672 11931 ts_tablet_manager.cc:1916] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.031914 12445 raft_consensus.cc:493] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.032102 12445 raft_consensus.cc:515] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.032310 11351 tablet_service.cc:1511] Processing CreateTablet for tablet db217278aa27439587768291c4ca7e3a (DEFAULT_TABLE table=default.Table_d21e6c10f3a34da9aa36f6f3201df482 [id=f59e487e166d48368b58911e23c8600f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.034803 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 3541e17b47bc47f5b69add361877a2bf (DEFAULT_TABLE table=default.Table_3e8965af19874c039d884161e1c6efc2 [id=f2e6f3b413604a808c0395064f79d5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.039908 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbfbfd6d65e4ad3ae69388f85183266 (DEFAULT_TABLE table=default.Table_26d49129e60a4e918addf990ff9ecace [id=0e31385181c24fbaa534bcf8e323706b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.042773 11754 tablet_bootstrap.cc:492] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:57.043027 11754 ts_tablet_manager.cc:1403] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.000s
I20260925 01:49:57.043926 11754 raft_consensus.cc:359] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.044217 11754 raft_consensus.cc:385] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:57.044402 11754 raft_consensus.cc:740] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:57.044682 11754 consensus_queue.cc:260] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.045300 11754 ts_tablet_manager.cc:1434] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:57.057384 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8944feb988d4509b8601689ac02b11b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.059625 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_11479f53e6d343f4a1669c57ca73bf07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.060503 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58240b1659fd46c6b2e41f77f7ed8949 consensus state has no leader
I20260925 01:49:57.060883 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_296491c83e6f4329a2fd902336673a8a" } new_table_name: "default.Table_c361990e57274e58b9e99c7086a27792" modify_external_catalogs: true
I20260925 01:49:57.062520 11754 tablet_bootstrap.cc:492] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:49:57.063690 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 914763e1d863493e866e29323e0fb01c consensus state has no leader
W20260925 01:49:57.063907 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11479f53e6d343f4a1669c57ca73bf07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.064095 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e2734747e1e44e7badcbbe01c9b4b040"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.064630 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2734747e1e44e7badcbbe01c9b4b040 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.067142 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e9d52e3f79408a99216250aefc45c8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:57.067461 12445 leader_election.cc:290] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:57.067411 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 6599a18283614e759cf3886d72c8250b (DEFAULT_TABLE table=default.Table_fc194d4f46f0472fafaeeaa06e43f1dc [id=d2adf6790a2844ec9900a82319928ed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.067791 11754 tablet_bootstrap.cc:654] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:57.067888 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6599a18283614e759cf3886d72c8250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.071305 11674 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 1ce8fb33e7ac4e9e8d12aa7e8d2c3f47
I20260925 01:49:57.072374 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5218ba01b3f44905b240a69ebbd6d9f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.072943 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5218ba01b3f44905b240a69ebbd6d9f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.073457 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_17a677951c834a40ae758b0e86f9165b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.073910 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17a677951c834a40ae758b0e86f9165b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.078405 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 644b28192e3b45e7b5370d55804cb043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.058003 12599 catalog_manager.cc:1651] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 01:49:57.080883 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9e112a4ce48f40a196f655379c758c9c
I20260925 01:49:57.081555 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1cc809b190d34ac18fca6162fb4f25b4" } new_table_name: "default.Table_421b97be134b46779be6e3914d46271c" modify_external_catalogs: true
I20260925 01:49:57.081832 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c261fd584d4b43a7bbf9557a024a5a3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.082485 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c261fd584d4b43a7bbf9557a024a5a3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.083732 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4930edeb2edd4e7494dbf1761b5d20c0
I20260925 01:49:57.084762 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db217278aa27439587768291c4ca7e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.086290 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b306496f992f45a9b64b05b73712cb5b
I20260925 01:49:57.086925 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_834ad22033664a878040029e15dab53b" } new_table_name: "default.Table_9c96e3747586472d861731441a16b7eb" modify_external_catalogs: true
I20260925 01:49:57.088577 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a1355a6457f9415093fde818d0226dd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.088979 11314 consensus_peers.cc:597] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:57.089190 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1355a6457f9415093fde818d0226dd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.089792 11288 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:57.090543 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3e3a033c9e7545479130c7a3c48ac254
I20260925 01:49:57.091356 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d830470740bc47ae97621cd325b9ef73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.092389 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d830470740bc47ae97621cd325b9ef73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.093468 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet b306496f992f45a9b64b05b73712cb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.093524 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e112a4ce48f40a196f655379c758c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.093786 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 4195e3f8e93e40fe9dfd72710d319dca (table default.Table_fea39c1d72644363a905c7285f20a052 [id=f267d33f055e4d7ab6b7a96ae212365e]) successfully deleted
I20260925 01:49:57.093921 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.095300 11372 raft_consensus.cc:3060] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:57.102106 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 4930edeb2edd4e7494dbf1761b5d20c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.103144 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e112a4ce48f40a196f655379c758c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.108541 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 4930edeb2edd4e7494dbf1761b5d20c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.109035 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 6599a18283614e759cf3886d72c8250b (DEFAULT_TABLE table=default.Table_fc194d4f46f0472fafaeeaa06e43f1dc [id=d2adf6790a2844ec9900a82319928ed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.109558 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6599a18283614e759cf3886d72c8250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.111377 10999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 5 candidate_status { last_received { term: 4 index: 589 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" is_pre_election: true
I20260925 01:49:57.113091 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet b306496f992f45a9b64b05b73712cb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.114960 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.119889 11946 tablet_replica.cc:333] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:57.125898 11946 raft_consensus.cc:2243] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:57.126219 11946 raft_consensus.cc:2272] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.126814 11946 ts_tablet_manager.cc:1916] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.140036 11946 ts_tablet_manager.cc:1929] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:57.140196 11946 log.cc:1199] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c28c9e51d80a442486b78be32c74a94f
I20260925 01:49:57.140681 11946 ts_tablet_manager.cc:1950] T c28c9e51d80a442486b78be32c74a94f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:57.141060 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 176) took 6630 ms. Trace:
I20260925 01:49:57.141194 11946 rpcz_store.cc:276] 0925 01:49:50.510995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.511067 (+ 72us) service_pool.cc:224] Handling call
0925 01:49:57.021277 (+6510210us) ts_tablet_manager.cc:1151] Deleting tablet c28c9e51d80a442486b78be32c74a94f
0925 01:49:57.021287 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.136020 (+114733us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.139924 (+ 3904us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.141020 (+ 1096us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6506529}
I20260925 01:49:57.141623 11946 tablet_replica.cc:333] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:57.141852 11946 raft_consensus.cc:2243] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:57.141868 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c28c9e51d80a442486b78be32c74a94f (table default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727]) successfully deleted
I20260925 01:49:57.141659 11754 tablet_bootstrap.cc:492] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:57.144419 11754 ts_tablet_manager.cc:1403] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.000s
I20260925 01:49:57.144338 11931 ts_tablet_manager.cc:1929] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:56.762410 12406 rpcz_store.cc:276] 0925 01:49:54.558276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.558347 (+ 71us) service_pool.cc:224] Handling call
0925 01:49:55.291086 (+732739us) raft_consensus.cc:1471] Updating replica for 422 ops
0925 01:49:55.926212 (+635126us) raft_consensus.cc:1534] Early marking committed up to index 167
0925 01:49:55.985549 (+ 59337us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:49:55.985557 (+ 8us) write_op.cc:454] Released schema lock
0925 01:49:55.985775 (+ 218us) raft_consensus.cc:1539] Triggering prepare for 422 ops
0925 01:49:55.986655 (+ 880us) write_op.cc:270] Start()
0925 01:49:55.986723 (+ 68us) write_op.cc:276] Timestamp: P: 1790300985519502 usec, L: 0
0925 01:49:56.049329 (+ 62606us) write_op.cc:270] Start()
0925 01:49:56.049388 (+ 59us) write_op.cc:276] Timestamp: P: 1790300985528450 usec, L: 0
0925 01:49:56.049618 (+ 230us) write_op.cc:270] Start()
0925 01:49:56.049659 (+ 41us) write_op.cc:276] Timestamp: P: 1790300985529085 usec, L: 0
0925 01:49:56.049817 (+ 158us) write_op.cc:270] Start()
0925 01:49:56.049836 (+ 19us) write_op.cc:276] Timestamp: P: 1790300985529627 usec, L: 0
0925 01:49:56.052840 (+ 3004us) write_op.cc:270] Start()
0925 01:49:56.052873 (+ 33us) write_op.cc:276] Timestamp: P: 1790300985530359 usec, L: 0
0925 01:49:56.053097 (+ 224us) write_op.cc:270] Start()
0925 01:49:56.053121 (+ 24us) write_op.cc:276] Timestamp: P: 1790300985530989 usec, L: 0
0925 01:49:56.055676 (+ 2555us) write_op.cc:270] Start()
0925 01:49:56.055712 (+ 36us) write_op.cc:276] Timestamp: P: 1790300985531523 usec, L: 0
0925 01:49:56.055963 (+ 251us) write_op.cc:270] Start()
0925 01:49:56.055987 (+ 24us) write_op.cc:276] Timestamp: P: 1790300985532029 usec, L: 0
0925 01:49:56.056183 (+ 196us) write_op.cc:270] Start()
0925 01:49:56.056206 (+ 23us) write_op.cc:276] Timestamp: P: 1790300985532671 usec, L: 0
0925 01:49:56.056466 (+ 260us) write_op.cc:270] Start()
0925 01:49:56.056532 (+ 66us) write_op.cc:276] Timestamp: P: 1790300985764462 usec, L: 0
0925 01:49:56.056767 (+ 235us) write_op.cc:270] Start()
0925 01:49:56.056789 (+ 22us) write_op.cc:276] Timestamp: P: 1790300985822479 usec, L: 0
0925 01:49:56.083974 (+ 27185us) write_op.cc:270] Start()
0925 01:49:56.084019 (+ 45us) write_op.cc:276] Timestamp: P: 1790300985823469 usec, L: 0
0925 01:49:56.084291 (+ 272us) write_op.cc:270] Start()
0925 01:49:56.084326 (+ 35us) write_op.cc:276] Timestamp: P: 1790300985845073 usec, L: 0
0925 01:49:56.084590 (+ 264us) write_op.cc:270] Start()
0925 01:49:56.084620 (+ 30us) write_op.cc:276] Timestamp: P: 1790300985868813 usec, L: 0
0925 01:49:56.084768 (+ 148us) write_op.cc:270] Start()
0925 01:49:56.084790 (+ 22us) write_op.cc:276] Timestamp: P: 1790300985946262 usec, L: 0
0925 01:49:56.085022 (+ 232us) write_op.cc:270] Start()
0925 01:49:56.085044 (+ 22us) write_op.cc:276] Timestamp: P: 1790300985965906 usec, L: 0
0925 01:49:56.085181 (+ 137us) write_op.cc:270] Start()
0925 01:49:56.085206 (+ 25us) write_op.cc:276] Timestamp: P: 1790300986074919 usec, L: 0
0925 01:49:56.085372 (+ 166us) write_op.cc:270] Start()
0925 01:49:56.085401 (+ 29us) write_op.cc:276] Timestamp: P: 1790300986096668 usec, L: 0
0925 01:49:56.085608 (+ 207us) write_op.cc:270] Start()
0925 01:49:56.085631 (+ 23us) write_op.cc:276] Timestamp: P: 1790300986118608 usec, L: 0
0925 01:49:56.085841 (+ 210us) write_op.cc:270] Start()
0925 01:49:56.085862 (+ 21us) write_op.cc:276] Timestamp: P: 1790300986143679 usec, L: 0
0925 01:49:56.086020 (+ 158us) write_op.cc:270] Start()
0925 01:49:56.086045 (+ 25us) write_op.cc:276] Timestamp: P: 1790300986156216 usec, L: 0
0925 01:49:56.105945 (+ 19900us) write_op.cc:270] Start()
0925 01:49:56.105992 (+ 47us) write_op.cc:276] Timestamp: P: 1790300986183715 usec, L: 0
0925 01:49:56.109260 (+ 3268us) write_op.cc:270] Start()
0925 01:49:56.109342 (+ 82us) write_op.cc:276] Timestamp: P: 1790300986198459 usec, L: 0
0925 01:49:56.109627 (+ 285us) write_op.cc:270] Start()
0925 01:49:56.109658 (+ 31us) write_op.cc:276] Timestamp: P: 1790300986213447 usec, L: 0
0925 01:49:56.109819 (+ 161us) write_op.cc:270] Start()
0925 01:49:56.109843 (+ 24us) write_op.cc:276] Timestamp: P: 1790300986224988 usec, L: 0
0925 01:49:56.123806 (+ 13963us) write_op.cc:270] Start()
0925 01:49:56.123863 (+ 57us) write_op.cc:276] Timestamp: P: 1790300986226018 usec, L: 0
0925 01:49:56.124153 (+ 290us) write_op.cc:270] Start()
0925 01:49:56.124182 (+ 29us) write_op.cc:276] Timestamp: P: 1790300986228349 usec, L: 0
0925 01:49:56.124374 (+ 192us) write_op.cc:270] Start()
0925 01:49:56.124396 (+ 22us) write_op.cc:276] Timestamp: P: 1790300986228964 usec, L: 0
0925 01:49:56.124585 (+ 189us) write_op.cc:270] Start()
0925 01:49:56.124610 (+ 25us) write_op.cc:276] Timestamp: P: 1790300986230800 usec, L: 0
0925 01:49:56.124765 (+ 155us) write_op.cc:270] Start()
0925 01:49:56.124788 (+ 23us) write_op.cc:276] Timestamp: P: 1790300986231419 usec, L: 0
0925 01:49:56.124934 (+ 146us) write_op.cc:270] Start()
0925 01:49:56.124956 (+ 22us) write_op.cc:276] Timestamp: P: 1790300986247475 usec, L: 0
0925 01:49:56.125103 (+ 147us) write_op.cc:270] Start()
0925 01:49:56.125123 (+ 20us) write_op.cc:276] Timestamp: P: 1790300986308700 usec, L: 0
0925 01:49:56.125276 (+ 153us) write_op.cc:270] Start()
0925 01:49:56.125296 (+ 20us) write_op.cc:276] Timestamp: P: 1790300986333190 usec, L: 0
0925 01:49:56.164536 (+ 39240us) write_op.cc:270] Start()
0925 01:49:56.164599 (+ 63us) write_op.cc:276] Timestamp: P: 1790300986349684 usec, L: 0
0925 01:49:56.164939 (+ 340us) write_op.cc:270] Start()
0925 01:49:56.164970 (+ 31us) write_op.cc:276] Timestamp: P: 1790300986360050 usec, L: 0
0925 01:49:56.165135 (+ 165us) write_op.cc:270] Start()
0925 01:49:56.165162 (+ 27us) write_op.cc:276] Timestamp: P: 1790300986365027 usec, L: 0
0925 01:49:56.165329 (+ 167us) write_op.cc:270] Start()
0925 01:49:56.165403 (+ 74us) write_op.cc:276] Timestamp: P: 1790300986372653 usec, L: 0
0925 01:49:56.165720 (+ 317us) write_op.cc:270] Start()
0925 01:49:56.165750 (+ 30us) write_op.cc:276] Timestamp: P: 1790300986484394 usec, L: 0
0925 01:49:56.165917 (+ 167us) write_op.cc:270] Start()
0925 01:49:56.165941 (+ 24us) write_op.cc:276] Timestamp: P: 1790300986499581 usec, L: 0
0925 01:49:56.166158 (+ 217us) write_op.cc:270] Start()
0925 01:49:56.166184 (+ 26us) write_op.cc:276] Timestamp: P: 1790300986512863 usec, L: 0
0925 01:49:56.166343 (+ 159us) write_op.cc:270] Start()
0925 01:49:56.166367 (+ 24us) write_op.cc:276] Timestamp: P: 1790300986557210 usec, L: 0
0925 01:49:56.185043 (+ 18676us) write_op.cc:270] Start()
0925 01:49:56.185103 (+ 60us) write_op.cc:276] Timestamp: P: 1790300986587797 usec, L: 0
0925 01:49:56.185435 (+ 332us) write_op.cc:270] Start()
0925 01:49:56.185467 (+ 32us) write_op.cc:276] Timestamp: P: 1790300986589006 usec, L: 0
0925 01:49:56.185663 (+ 196us) write_op.cc:270] Start()
0925 01:49:56.185687 (+ 24us) write_op.cc:276] Timestamp: P: 1790300986592122 usec, L: 0
0925 01:49:56.185819 (+ 132us) write_op.cc:270] Start()
0925 01:49:56.185844 (+ 25us) write_op.cc:276] Timestamp: P: 1790300986593055 usec, L: 0
0925 01:49:56.186030 (+ 186us) write_op.cc:270] Start()
0925 01:49:56.186051 (+ 21us) write_op.cc:276] Timestamp: P: 1790300986594115 usec, L: 0
0925 01:49:56.186295 (+ 244us) write_op.cc:270] Start()
0925 01:49:56.186318 (+ 23us) write_op.cc:276] Timestamp: P: 1790300986596955 usec, L: 0
0925 01:49:56.186480 (+ 162us) write_op.cc:270] Start()
0925 01:49:56.186505 (+ 25us) write_op.cc:276] Timestamp: P: 1790300986597993 usec, L: 0
0925 01:49:56.186686 (+ 181us) write_op.cc:270] Start()
0925 01:49:56.186714 (+ 28us) write_op.cc:276] Timestamp: P: 1790300986630605 usec, L: 0
0925 01:49:56.187503 (+ 789us) write_op.cc:270] Start()
0925 01:49:56.187529 (+ 26us) write_op.cc:276] Timestamp: P: 1790300986659480 usec, L: 0
0925 01:49:56.187694 (+ 165us) write_op.cc:270] Start()
0925 01:49:56.187715 (+ 21us) write_op.cc:276] Timestamp: P: 1790300986680801 usec, L: 0
0925 01:49:56.187860 (+ 145us) write_op.cc:270] Start()
0925 01:49:56.187901 (+ 41us) write_op.cc:276] Timestamp: P: 1790300986700637 usec, L: 0
0925 01:49:56.188055 (+ 154us) write_op.cc:270] Start()
0925 01:49:56.188076 (+ 21us) write_op.cc:276] Timestamp: P: 1790300986701451 usec, L: 0
0925 01:49:56.188218 (+ 142us) write_op.cc:270] Start()
0925 01:49:56.188238 (+ 20us) write_op.cc:276] Timestamp: P: 1790300986702245 usec, L: 0
0925 01:49:56.188385 (+ 147us) write_op.cc:270] Start()
0925 01:49:56.188405 (+ 20us) write_op.cc:276] Timestamp: P: 1790300986748688 usec, L: 0
0925 01:49:56.188542 (+ 137us) write_op.cc:270] Start()
0925 01:49:56.188563 (+ 21us) write_op.cc:276] Timestamp: P: 1790300986771898 usec, L: 0
0925 01:49:56.188702 (+ 139us) write_op.cc:270] Start()
0925 01:49:56.188723 (+ 21us) write_op.cc:276] Timestamp: P: 1790300986772602 usec, L: 0
0925 01:49:56.202361 (+ 13638us) write_op.cc:270] Start()
0925 01:49:56.202426 (+ 65us) write_op.cc:276] Timestamp: P: 1790300987047301 usec, L: 0
0925 01:49:56.203910 (+ 1484us) write_op.cc:270] Start()
0925 01:49:56.203945 (+ 35us) write_op.cc:276] Timestamp: P: 1790300987068314 usec, L: 0
0925 01:49:56.204160 (+ 215us) write_op.cc:270] Start()
0925 01:49:56.204192 (+ 32us) write_op.cc:276] Timestamp: P: 1790300987089327 usec, L: 0
0925 01:49:56.204327 (+ 135us) write_op.cc:270] Start()
0925 01:49:56.204346 (+ 19us) write_op.cc:276] Timestamp: P: 1790300987109240 usec, L: 0
0925 01:49:56.204472 (+ 126us) write_op.cc:270] Start()
0925 01:49:56.204491 (+ 19us) write_op.cc:276] Timestamp: P: 1790300987123476 usec, L: 0
0925 01:49:56.204613 (+ 122us) write_op.cc:270] Start()
0925 01:49:56.204632 (+ 19us) write_op.cc:276] Timestamp: P: 1790300987136368 usec, L: 0
0925 01:49:56.204745 (+ 113us) write_op.cc:270] Start()
0925 01:49:56.204764 (+ 19us) write_op.cc:276] Timestamp: P: 1790300987149300 usec, L: 0
0925 01:49:56.204953 (+ 189us) write_op.cc:270] Start()
0925 01:49:56.204973 (+ 20us) write_op.cc:276] Timestamp: P: 1790300987167570 usec, L: 0
0925 01:49:56.205103 (+ 130us) write_op.cc:270] Start()
0925 01:49:56.205121 (+ 18us) write_op.cc:276] Timestamp: P: 1790300987177408 usec, L: 0
0925 01:49:56.205248 (+ 127us) write_op.cc:270] Start()
0925 01:49:56.205265 (+ 17us) write_op.cc:276] Timestamp: P: 1790300987178907 usec, L: 0
0925 01:49:56.205384 (+ 119us) write_op.cc:270] Start()
0925 01:49:56.205403 (+ 19us) write_op.cc:276] Timestamp: P: 1790300987179814 usec, L: 0
0925 01:49:56.205529 (+ 126us) write_op.cc:270] Start()
0925 01:49:56.205547 (+ 18us) write_op.cc:276] Timestamp: P: 1790300987180709 usec, L: 0
0925 01:49:56.205674 (+ 127us) write_op.cc:270] Start()
0925 01:49:56.205692 (+ 18us) write_op.cc:276] Timestamp: P: 1790300987181794 usec, L: 0
0925 01:49:56.205822 (+ 130us) write_op.cc:270] Start()
0925 01:49:56.205843 (+ 21us) write_op.cc:276] Timestamp: P: 1790300987186882 usec, L: 0
0925 01:49:56.205981 (+ 138us) write_op.cc:270] Start()
0925 01:49:56.206000 (+ 19us) write_op.cc:276] Timestamp: P: 1790300987213343 usec, L: 0
0925 01:49:56.206165 (+ 165us) write_op.cc:270] Start()
0925 01:49:56.206185 (+ 20us) write_op.cc:276] Timestamp: P: 1790300987216633 usec, L: 0
0925 01:49:56.206310 (+ 125us) write_op.cc:270] Start()
0925 01:49:56.206328 (+ 18us) write_op.cc:276] Timestamp: P: 1790300987230831 usec, L: 0
0925 01:49:56.209275 (+ 2947us) write_op.cc:270] Start()
0925 01:49:56.209308 (+ 33us) write_op.cc:276] Timestamp: P: 1790300987234410 usec, L: 0
0925 01:49:56.209509 (+ 201us) write_op.cc:270] Start()
0925 01:49:56.209530 (+ 21us) write_op.cc:276] Timestamp: P: 1790300987278159 usec, L: 0
0925 01:49:56.209667 (+ 137us) write_op.cc:270] Start()
0925 01:49:56.209693 (+ 26us) write_op.cc:276] Timestamp: P: 1790300987278797 usec, L: 0
0925 01:49:56.209840 (+ 147us) write_op.cc:270] Start()
0925 01:49:56.209876 (+ 36us) write_op.cc:276] Timestamp: P: 1790300987279429 usec, L: 0
0925 01:49:56.210045 (+ 169us) write_op.cc:270] Start()
0925 01:49:56.210119 (+ 74us) write_op.cc:276] Timestamp: P: 1790300987311431 usec, L: 0
0925 01:49:56.210297 (+ 178us) write_op.cc:270] Start()
0925 01:49:56.210320 (+ 23us) write_op.cc:276] Timestamp: P: 1790300987379508 usec, L: 0
0925 01:49:56.210492 (+ 172us) write_op.cc:270] Start()
0925 01:49:56.210516 (+ 24us) write_op.cc:276] Timestamp: P: 1790300987380219 usec, L: 0
0925 01:49:56.210656 (+ 140us) write_op.cc:270] Start()
0925 01:49:56.210678 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987424721 usec, L: 0
0925 01:49:56.210820 (+ 142us) write_op.cc:270] Start()
0925 01:49:56.210869 (+ 49us) write_op.cc:276] Timestamp: P: 1790300987448165 usec, L: 0
0925 01:49:56.211072 (+ 203us) write_op.cc:270] Start()
0925 01:49:56.211096 (+ 24us) write_op.cc:276] Timestamp: P: 1790300987449579 usec, L: 0
0925 01:49:56.211259 (+ 163us) write_op.cc:270] Start()
0925 01:49:56.211281 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987451442 usec, L: 0
0925 01:49:56.211444 (+ 163us) write_op.cc:270] Start()
0925 01:49:56.211467 (+ 23us) write_op.cc:276] Timestamp: P: 1790300987501369 usec, L: 0
0925 01:49:56.211612 (+ 145us) write_op.cc:270] Start()
0925 01:49:56.211634 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987502644 usec, L: 0
0925 01:49:56.211765 (+ 131us) write_op.cc:270] Start()
0925 01:49:56.211786 (+ 21us) write_op.cc:276] Timestamp: P: 1790300987525679 usec, L: 0
0925 01:49:56.211949 (+ 163us) write_op.cc:270] Start()
0925 01:49:56.211972 (+ 23us) write_op.cc:276] Timestamp: P: 1790300987541034 usec, L: 0
0925 01:49:56.212138 (+ 166us) write_op.cc:270] Start()
0925 01:49:56.212161 (+ 23us) write_op.cc:276] Timestamp: P: 1790300987550688 usec, L: 0
0925 01:49:56.212300 (+ 139us) write_op.cc:270] Start()
0925 01:49:56.212322 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987583371 usec, L: 0
0925 01:49:56.212485 (+ 163us) write_op.cc:270] Start()
0925 01:49:56.212508 (+ 23us) write_op.cc:276] Timestamp: P: 1790300987595801 usec, L: 0
0925 01:49:56.212644 (+ 136us) write_op.cc:270] Start()
0925 01:49:56.212666 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987614583 usec, L: 0
0925 01:49:56.212830 (+ 164us) write_op.cc:270] Start()
0925 01:49:56.212902 (+ 72us) write_op.cc:276] Timestamp: P: 1790300987626228 usec, L: 0
0925 01:49:56.213073 (+ 171us) write_op.cc:270] Start()
0925 01:49:56.213104 (+ 31us) write_op.cc:276] Timestamp: P: 1790300987642606 usec, L: 0
0925 01:49:56.213252 (+ 148us) write_op.cc:270] Start()
0925 01:49:56.213275 (+ 23us) write_op.cc:276] Timestamp: P: 1790300987650230 usec, L: 0
0925 01:49:56.213445 (+ 170us) write_op.cc:270] Start()
0925 01:49:56.213469 (+ 24us) write_op.cc:276] Timestamp: P: 1790300987651520 usec, L: 0
0925 01:49:56.213618 (+ 149us) write_op.cc:270] Start()
0925 01:49:56.213640 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987653945 usec, L: 0
0925 01:49:56.220847 (+ 7207us) write_op.cc:270] Start()
0925 01:49:56.220886 (+ 39us) write_op.cc:276] Timestamp: P: 1790300987655886 usec, L: 0
0925 01:49:56.221109 (+ 223us) write_op.cc:270] Start()
0925 01:49:56.221134 (+ 25us) write_op.cc:276] Timestamp: P: 1790300987704156 usec, L: 0
0925 01:49:56.221277 (+ 143us) write_op.cc:270] Start()
0925 01:49:56.221297 (+ 20us) write_op.cc:276] Timestamp: P: 1790300987734142 usec, L: 0
0925 01:49:56.221438 (+ 141us) write_op.cc:270] Start()
0925 01:49:56.221457 (+ 19us) write_op.cc:276] Timestamp: P: 1790300987742087 usec, L: 0
0925 01:49:56.221611 (+ 154us) write_op.cc:270] Start()
0925 01:49:56.221638 (+ 27us) write_op.cc:276] Timestamp: P: 1790300987816849 usec, L: 0
0925 01:49:56.221789 (+ 151us) write_op.cc:270] Start()
0925 01:49:56.221812 (+ 23us) write_op.cc:276] Timestamp: P: 1790300987847205 usec, L: 0
0925 01:49:56.222023 (+ 211us) write_op.cc:270] Start()
0925 01:49:56.222049 (+ 26us) write_op.cc:276] Timestamp: P: 1790300987860875 usec, L: 0
0925 01:49:56.222225 (+ 176us) write_op.cc:270] Start()
0925 01:49:56.222396 (+ 171us) write_op.cc:276] Timestamp: P: 1790300987884923 usec, L: 0
0925 01:49:56.222547 (+ 151us) write_op.cc:270] Start()
0925 01:49:56.222577 (+ 30us) write_op.cc:276] Timestamp: P: 1790300987898571 usec, L: 0
0925 01:49:56.222766 (+ 189us) write_op.cc:270] Start()
0925 01:49:56.222788 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987901264 usec, L: 0
0925 01:49:56.222923 (+ 135us) write_op.cc:270] Start()
0925 01:49:56.222945 (+ 22us) write_op.cc:276] Timestamp: P: 1790300987902352 usec, L: 0
0925 01:49:56.223107 (+ 162us) write_op.cc:270] Start()
0925 01:49:56.223131 (+ 24us) write_op.cc:276] Timestamp: P: 1790300987909210 usec, L: 0
0925 01:49:56.223287 (+ 156us) write_op.cc:270] Start()
0925 01:49:56.223311 (+ 24us) write_op.cc:276] Timestamp: P: 1790300987945107 usec, L: 0
0925 01:49:56.223449 (+ 138us) write_op.cc:270] Start()
0925 01:49:56.223470 (+ 21us) write_op.cc:276] Timestamp: P: 1790300987963199 usec, L: 0
0925 01:49:56.223660 (+ 190us) write_op.cc:270] Start()
0925 01:49:56.223682 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988076987 usec, L: 0
0925 01:49:56.223864 (+ 182us) write_op.cc:270] Start()
0925 01:49:56.223888 (+ 24us) write_op.cc:276] Timestamp: P: 1790300988083804 usec, L: 0
0925 01:49:56.224056 (+ 168us) write_op.cc:270] Start()
0925 01:49:56.224080 (+ 24us) write_op.cc:276] Timestamp: P: 1790300988138170 usec, L: 0
0925 01:49:56.224231 (+ 151us) write_op.cc:270] Start()
0925 01:49:56.224254 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988164387 usec, L: 0
0925 01:49:56.224403 (+ 149us) write_op.cc:270] Start()
0925 01:49:56.224426 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988181927 usec, L: 0
0925 01:49:56.224571 (+ 145us) write_op.cc:270] Start()
0925 01:49:56.224596 (+ 25us) write_op.cc:276] Timestamp: P: 1790300988182884 usec, L: 0
0925 01:49:56.224760 (+ 164us) write_op.cc:270] Start()
0925 01:49:56.224783 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988183490 usec, L: 0
0925 01:49:56.224933 (+ 150us) write_op.cc:270] Start()
0925 01:49:56.224953 (+ 20us) write_op.cc:276] Timestamp: P: 1790300988184112 usec, L: 0
0925 01:49:56.225133 (+ 180us) write_op.cc:270] Start()
0925 01:49:56.225155 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988193705 usec, L: 0
0925 01:49:56.225343 (+ 188us) write_op.cc:270] Start()
0925 01:49:56.225366 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988268550 usec, L: 0
0925 01:49:56.225514 (+ 148us) write_op.cc:270] Start()
0925 01:49:56.225539 (+ 25us) write_op.cc:276] Timestamp: P: 1790300988303001 usec, L: 0
0925 01:49:56.225710 (+ 171us) write_op.cc:270] Start()
0925 01:49:56.225732 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988335612 usec, L: 0
0925 01:49:56.225871 (+ 139us) write_op.cc:270] Start()
0925 01:49:56.225892 (+ 21us) write_op.cc:276] Timestamp: P: 1790300988383586 usec, L: 0
0925 01:49:56.226129 (+ 237us) write_op.cc:270] Start()
0925 01:49:56.226154 (+ 25us) write_op.cc:276] Timestamp: P: 1790300988384246 usec, L: 0
0925 01:49:56.226344 (+ 190us) write_op.cc:270] Start()
0925 01:49:56.226369 (+ 25us) write_op.cc:276] Timestamp: P: 1790300988388860 usec, L: 0
0925 01:49:56.226569 (+ 200us) write_op.cc:270] Start()
0925 01:49:56.226595 (+ 26us) write_op.cc:276] Timestamp: P: 1790300988429763 usec, L: 0
0925 01:49:56.226817 (+ 222us) write_op.cc:270] Start()
0925 01:49:56.226838 (+ 21us) write_op.cc:276] Timestamp: P: 1790300988437357 usec, L: 0
0925 01:49:56.227115 (+ 277us) write_op.cc:270] Start()
0925 01:49:56.227143 (+ 28us) write_op.cc:276] Timestamp: P: 1790300988451377 usec, L: 0
0925 01:49:56.227382 (+ 239us) write_op.cc:270] Start()
0925 01:49:56.227411 (+ 29us) write_op.cc:276] Timestamp: P: 1790300988455130 usec, L: 0
0925 01:49:56.227659 (+ 248us) write_op.cc:270] Start()
0925 01:49:56.227686 (+ 27us) write_op.cc:276] Timestamp: P: 1790300988483250 usec, L: 0
0925 01:49:56.227841 (+ 155us) write_op.cc:270] Start()
0925 01:49:56.227864 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988487666 usec, L: 0
0925 01:49:56.228055 (+ 191us) write_op.cc:270] Start()
0925 01:49:56.228081 (+ 26us) write_op.cc:276] Timestamp: P: 1790300988488853 usec, L: 0
0925 01:49:56.228357 (+ 276us) write_op.cc:270] Start()
0925 01:49:56.228382 (+ 25us) write_op.cc:276] Timestamp: P: 1790300988490887 usec, L: 0
0925 01:49:56.228534 (+ 152us) write_op.cc:270] Start()
0925 01:49:56.228557 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988492171 usec, L: 0
0925 01:49:56.228805 (+ 248us) write_op.cc:270] Start()
0925 01:49:56.228830 (+ 25us) write_op.cc:276] Timestamp: P: 1790300988492966 usec, L: 0
0925 01:49:56.229036 (+ 206us) write_op.cc:270] Start()
0925 01:49:56.229063 (+ 27us) write_op.cc:276] Timestamp: P: 1790300988493913 usec, L: 0
0925 01:49:56.229272 (+ 209us) write_op.cc:270] Start()
0925 01:49:56.229292 (+ 20us) write_op.cc:276] Timestamp: P: 1790300988525202 usec, L: 0
0925 01:49:56.229453 (+ 161us) write_op.cc:270] Start()
0925 01:49:56.229475 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988526278 usec, L: 0
0925 01:49:56.229617 (+ 142us) write_op.cc:270] Start()
0925 01:49:56.229639 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988555292 usec, L: 0
0925 01:49:56.229823 (+ 184us) write_op.cc:270] Start()
0925 01:49:56.229842 (+ 19us) write_op.cc:276] Timestamp: P: 1790300988555952 usec, L: 0
0925 01:49:56.230022 (+ 180us) write_op.cc:270] Start()
0925 01:49:56.230045 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988556576 usec, L: 0
0925 01:49:56.230282 (+ 237us) write_op.cc:270] Start()
0925 01:49:56.230304 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988557157 usec, L: 0
0925 01:49:56.230466 (+ 162us) write_op.cc:270] Start()
0925 01:49:56.230484 (+ 18us) write_op.cc:276] Timestamp: P: 1790300988594573 usec, L: 0
0925 01:49:56.230608 (+ 124us) write_op.cc:270] Start()
0925 01:49:56.230630 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988625753 usec, L: 0
0925 01:49:56.230777 (+ 147us) write_op.cc:270] Start()
0925 01:49:56.230796 (+ 19us) write_op.cc:276] Timestamp: P: 1790300988650197 usec, L: 0
0925 01:49:56.231021 (+ 225us) write_op.cc:270] Start()
0925 01:49:56.231043 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988653332 usec, L: 0
0925 01:49:56.231175 (+ 132us) write_op.cc:270] Start()
0925 01:49:56.231193 (+ 18us) write_op.cc:276] Timestamp: P: 1790300988670295 usec, L: 0
0925 01:49:56.231346 (+ 153us) write_op.cc:270] Start()
0925 01:49:56.231366 (+ 20us) write_op.cc:276] Timestamp: P: 1790300988693864 usec, L: 0
0925 01:49:56.231611 (+ 245us) write_op.cc:270] Start()
0925 01:49:56.231633 (+ 22us) write_op.cc:276] Timestamp: P: 1790300988708831 usec, L: 0
0925 01:49:56.231767 (+ 134us) write_op.cc:270] Start()
0925 01:49:56.231786 (+ 19us) write_op.cc:276] Timestamp: P: 1790300988731238 usec, L: 0
0925 01:49:56.231963 (+ 177us) write_op.cc:270] Start()
0925 01:49:56.231986 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988751140 usec, L: 0
0925 01:49:56.232177 (+ 191us) write_op.cc:270] Start()
0925 01:49:56.232200 (+ 23us) write_op.cc:276] Timestamp: P: 1790300988939186 usec, L: 0
0925 01:49:56.232436 (+ 236us) write_op.cc:270] Start()
0925 01:49:56.232465 (+ 29us) write_op.cc:276] Timestamp: P: 1790300989121274 usec, L: 0
0925 01:49:56.232653 (+ 188us) write_op.cc:270] Start()
0925 01:49:56.232707 (+ 54us) write_op.cc:276] Timestamp: P: 1790300989136446 usec, L: 0
0925 01:49:56.232889 (+ 182us) write_op.cc:270] Start()
0925 01:49:56.232915 (+ 26us) write_op.cc:276] Timestamp: P: 1790300989161622 usec, L: 0
0925 01:49:56.233121 (+ 206us) write_op.cc:270] Start()
0925 01:49:56.233146 (+ 25us) write_op.cc:276] Timestamp: P: 1790300989164701 usec, L: 0
0925 01:49:56.233337 (+ 191us) write_op.cc:270] Start()
0925 01:49:56.233362 (+ 25us) write_op.cc:276] Timestamp: P: 1790300989169169 usec, L: 0
0925 01:49:56.233515 (+ 153us) write_op.cc:270] Start()
0925 01:49:56.233538 (+ 23us) write_op.cc:276] Timestamp: P: 1790300989244761 usec, L: 0
0925 01:49:56.233712 (+ 174us) write_op.cc:270] Start()
0925 01:49:56.233736 (+ 24us) write_op.cc:276] Timestamp: P: 1790300989245637 usec, L: 0
0925 01:49:56.233898 (+ 162us) write_op.cc:270] Start()
0925 01:49:56.233921 (+ 23us) write_op.cc:276] Timestamp: P: 1790300989246463 usec, L: 0
0925 01:49:56.263830 (+ 29909us) write_op.cc:270] Start()
0925 01:49:56.263891 (+ 61us) write_op.cc:276] Timestamp: P: 1790300989248368 usec, L: 0
0925 01:49:56.264339 (+ 448us) write_op.cc:270] Start()
0925 01:49:56.264374 (+ 35us) write_op.cc:276] Timestamp: P: 1790300989249530 usec, L: 0
0925 01:49:56.264590 (+ 216us) write_op.cc:270] Start()
0925 01:49:56.264684 (+ 94us) write_op.cc:276] Timestamp: P: 1790300989250599 usec, L: 0
0925 01:49:56.264942 (+ 258us) write_op.cc:270] Start()
0925 01:49:56.264967 (+ 25us) write_op.cc:276] Timestamp: P: 1790300989251626 usec, L: 0
0925 01:49:56.265153 (+ 186us) write_op.cc:270] Start()
0925 01:49:56.265217 (+ 64us) write_op.cc:276] Timestamp: P: 1790300989273192 usec, L: 0
0925 01:49:56.265438 (+ 221us) write_op.cc:270] Start()
0925 01:49:56.265526 (+ 88us) write_op.cc:276] Timestamp: P: 1790300989320116 usec, L: 0
0925 01:49:56.265729 (+ 203us) write_op.cc:270] Start()
0925 01:49:56.265758 (+ 29us) write_op.cc:276] Timestamp: P: 1790300989331178 usec, L: 0
0925 01:49:56.265970 (+ 212us) write_op.cc:270] Start()
0925 01:49:56.265997 (+ 27us) write_op.cc:276] Timestamp: P: 1790300989352153 usec, L: 0
0925 01:49:56.266295 (+ 298us) write_op.cc:270] Start()
0925 01:49:56.266324 (+ 29us) write_op.cc:276] Timestamp: P: 1790300989352851 usec, L: 0
0925 01:49:56.266526 (+ 202us) write_op.cc:270] Start()
0925 01:49:56.266552 (+ 26us) write_op.cc:276] Timestamp: P: 1790300989353507 usec, L: 0
0925 01:49:56.266705 (+ 153us) write_op.cc:270] Start()
0925 01:49:56.266728 (+ 23us) write_op.cc:276] Timestamp: P: 1790300989355663 usec, L: 0
0925 01:49:56.266933 (+ 205us) write_op.cc:270] Start()
0925 01:49:56.266959 (+ 26us) write_op.cc:276] Timestamp: P: 1790300989356287 usec, L: 0
0925 01:49:56.267137 (+ 178us) write_op.cc:270] Start()
0925 01:49:56.267160 (+ 23us) write_op.cc:276] Timestamp: P: 1790300989356876 usec, L: 0
0925 01:49:56.267330 (+ 170us) write_op.cc:270] Start()
0925 01:49:56.267349 (+ 19us) write_op.cc:276] Timestamp: P: 1790300989357373 usec, L: 0
0925 01:49:56.267663 (+ 314us) write_op.cc:270] Start()
0925 01:49:56.267691 (+ 28us) write_op.cc:276] Timestamp: P: 1790300989365751 usec, L: 0
0925 01:49:56.267875 (+ 184us) write_op.cc:270] Start()
0925 01:49:56.267899 (+ 24us) write_op.cc:276] Timestamp: P: 1790300989440584 usec, L: 0
0925 01:49:56.268040 (+ 141us) write_op.cc:270] Start()
0925 01:49:56.268061 (+ 21us) write_op.cc:276] Timestamp: P: 1790300989486342 usec, L: 0
0925 01:49:56.268250 (+ 189us) write_op.cc:270] Start()
0925 01:49:56.268301 (+ 51us) write_op.cc:276] Timestamp: P: 1790300989510892 usec, L: 0
0925 01:49:56.268503 (+ 202us) write_op.cc:270] Start()
0925 01:49:56.268528 (+ 25us) write_op.cc:276] Timestamp: P: 1790300989512568 usec, L: 0
0925 01:49:56.268674 (+ 146us) write_op.cc:270] Start()
0925 01:49:56.268697 (+ 23us) write_op.cc:276] Timestamp: P: 1790300989726261 usec, L: 0
0925 01:49:56.268906 (+ 209us) write_op.cc:270] Start()
0925 01:49:56.268931 (+ 25us) write_op.cc:276] Timestamp: P: 1790300989760820 usec, L: 0
0925 01:49:56.269070 (+ 139us) write_op.cc:270] Start()
0925 01:49:56.269089 (+ 19us) write_op.cc:276] Timestamp: P: 1790300989774401 usec, L: 0
0925 01:49:56.269281 (+ 192us) write_op.cc:270] Start()
0925 01:49:56.269306 (+ 25us) write_op.cc:276] Timestamp: P: 1790300989775132 usec, L: 0
0925 01:49:56.269507 (+ 201us) write_op.cc:270] Start()
0925 01:49:56.269529 (+ 22us) write_op.cc:276] Timestamp: P: 1790300989812661 usec, L: 0
0925 01:49:56.269707 (+ 178us) write_op.cc:270] Start()
0925 01:49:56.269733 (+ 26us) write_op.cc:276] Timestamp: P: 1790300989813810 usec, L: 0
0925 01:49:56.269992 (+ 259us) write_op.cc:270] Start()
0925 01:49:56.270018 (+ 26us) write_op.cc:276] Timestamp: P: 1790300989872995 usec, L: 0
0925 01:49:56.270266 (+ 248us) write_op.cc:270] Start()
0925 01:49:56.270293 (+ 27us) write_op.cc:276] Timestamp: P: 1790300989879511 usec, L: 0
0925 01:49:56.270446 (+ 153us) write_op.cc:270] Start()
0925 01:49:56.270472 (+ 26us) write_op.cc:276] Timestamp: P: 1790300989884767 usec, L: 0
0925 01:49:56.270647 (+ 175us) write_op.cc:270] Start()
0925 01:49:56.270671 (+ 24us) write_op.cc:276] Timestamp: P: 1790300989888351 usec, L: 0
0925 01:49:56.270816 (+ 145us) write_op.cc:270] Start()
0925 01:49:56.270837 (+ 21us) write_op.cc:276] Timestamp: P: 1790300989895482 usec, L: 0
0925 01:49:56.271050 (+ 213us) write_op.cc:270] Start()
0925 01:49:56.271074 (+ 24us) write_op.cc:276] Timestamp: P: 1790300989933332 usec, L: 0
0925 01:49:56.271295 (+ 221us) write_op.cc:270] Start()
0925 01:49:56.271317 (+ 22us) write_op.cc:276] Timestamp: P: 1790300989935909 usec, L: 0
0925 01:49:56.271496 (+ 179us) write_op.cc:270] Start()
0925 01:49:56.271516 (+ 20us) write_op.cc:276] Timestamp: P: 1790300989937919 usec, L: 0
0925 01:49:56.271649 (+ 133us) write_op.cc:270] Start()
0925 01:49:56.271672 (+ 23us) write_op.cc:276] Timesta
I20260925 01:49:57.147126 11931 log.cc:1199] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/38082c23d99148bb916b0ae74fd474b8
W20260925 01:49:57.154201 11314 leader_election.cc:343] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.154424 11314 leader_election.cc:304] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:57.154681 12445 raft_consensus.cc:493] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.154886 12445 raft_consensus.cc:515] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.155617 12445 leader_election.cc:290] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:57.155508 11931 ts_tablet_manager.cc:1950] T 38082c23d99148bb916b0ae74fd474b8 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:57.156641 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 1602d22ad10f45d592c79e0d2affb2ae (DEFAULT_TABLE table=default.Table_c8099602485b40e2af198824f853c448 [id=21cc9da2107a4e4da619e4c915fd6541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.157156 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1602d22ad10f45d592c79e0d2affb2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.157578 12211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:49:57.157817 12211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
I20260925 01:49:57.164108 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebabbda434944f5aeaf7f422de07a98 (DEFAULT_TABLE table=default.Table_a7a1ef6d5f1e47f384b06ba12847cf6c [id=7a3c54c47916458aa318706bf1273721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.164547 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebabbda434944f5aeaf7f422de07a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.163720 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebabbda434944f5aeaf7f422de07a98 (DEFAULT_TABLE table=default.Table_a7a1ef6d5f1e47f384b06ba12847cf6c [id=7a3c54c47916458aa318706bf1273721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.166685 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebabbda434944f5aeaf7f422de07a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.163234 11754 raft_consensus.cc:359] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.168799 11754 raft_consensus.cc:385] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:57.170179 11754 raft_consensus.cc:740] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:49:57.175573 11666 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 84683.9us
W20260925 01:49:57.175956 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 4e008337914841b8a1ab4a64ecc6e181 because the tablet was not found. No further retry: Not found: Tablet not found: 4e008337914841b8a1ab4a64ecc6e181
I20260925 01:49:57.175956 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 38082c23d99148bb916b0ae74fd474b8 (table default.Table_c6503d38584945e3a845e2f96ab5a4fc [id=093f5fa0a0d340b381d7794eede8d93a]) successfully deleted
I20260925 01:49:57.177489 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1e462c544f4c04a148e273f545570d (DEFAULT_TABLE table=default.Table_99e2eca2291a4b8796db4daec4dd1433 [id=f318edf82c57433098a317160c89b7db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.178900 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet b306496f992f45a9b64b05b73712cb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.179180 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.179661 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 4930edeb2edd4e7494dbf1761b5d20c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.180065 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 1602d22ad10f45d592c79e0d2affb2ae (DEFAULT_TABLE table=default.Table_c8099602485b40e2af198824f853c448 [id=21cc9da2107a4e4da619e4c915fd6541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.180229 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 6599a18283614e759cf3886d72c8250b (DEFAULT_TABLE table=default.Table_fc194d4f46f0472fafaeeaa06e43f1dc [id=d2adf6790a2844ec9900a82319928ed3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.180589 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 5 candidate_status { last_received { term: 4 index: 589 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:49:57.181368 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:57.184120 11931 tablet_replica.cc:333] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:57.177181 11754 consensus_queue.cc:260] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.185680 11212 tablet_service.cc:1511] Processing CreateTablet for tablet f4533c3500a3431ca6ef5f23b0cf6830 (DEFAULT_TABLE table=default.Table_1238c41b271747fe9d9f419001ea61cd [id=554a0a3a8a1c446db2bb5018fc5bf896]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.186167 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4533c3500a3431ca6ef5f23b0cf6830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.190960 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 58240b1659fd46c6b2e41f77f7ed8949 (DEFAULT_TABLE table=default.Table_7e40b99aed8a4375bea1481553c776f2 [id=cfc024cce5474328b8c991e001c2abc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.191429 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58240b1659fd46c6b2e41f77f7ed8949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.194381 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 8909181e04be451aa8aeb219c9da8b89 (DEFAULT_TABLE table=default.Table_c239ceffba664dce9924f9e9a62a2fc4 [id=350a1f36361548178181ef7683168652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.194818 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8909181e04be451aa8aeb219c9da8b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.198186 11203 tablet_service.cc:1511] Processing CreateTablet for tablet ea10c9a7e20b48c69eb5f24631403e93 (DEFAULT_TABLE table=default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51 [id=63171538e0ac47ce9572edcc3b1ea05b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.198549 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea10c9a7e20b48c69eb5f24631403e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.201805 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 72cfb274f13548b1ba4bd457bb31082f (DEFAULT_TABLE table=default.Table_71cd6d56414a44a4b1b51b2eda682e0b [id=9422c4fc0c8f4b1091d645b7c8894c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.202234 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72cfb274f13548b1ba4bd457bb31082f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.201220 11931 raft_consensus.cc:2243] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:57.206478 11931 raft_consensus.cc:2272] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.207289 11754 ts_tablet_manager.cc:1434] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.062s user 0.005s sys 0.000s
I20260925 01:49:57.208155 12255 leader_election.cc:304] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca2cee7752c249f68a372ef5c6a18bff; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ec2f98d6295c4f8ead68b46f01e73d37
I20260925 01:49:57.215328 11754 tablet_bootstrap.cc:492] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:57.219635 11946 pending_rounds.cc:70] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:57.220944 11946 pending_rounds.cc:77] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072862040006656 op_type: NO_OP noop_request { }
I20260925 01:49:57.221077 12516 raft_consensus.cc:493] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.221395 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 1755df2ee2ff47d99b22400e1f9dfbe6 (DEFAULT_TABLE table=default.Table_cc4c3ad2d7fd41d7b40fe7b8fe8b5a96 [id=9c683e3c14984e659635371900eab9b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.225389 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 032d44a6f2fa4c7c8db20c8d0ecd17c2 (DEFAULT_TABLE table=default.Table_7cb9be806d964f64b907aa0a93b3f943 [id=8d5c0ffe322a4f50919b900ca59be5d4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.228053 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad0a13f4c9af48aa8b2b18cbb5c00c23 consensus state has no leader
W20260925 01:49:57.228953 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60411b0feafe4fef9c4fdc364163f1df consensus state has no leader
I20260925 01:49:57.178439 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e112a4ce48f40a196f655379c758c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.232002 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbfbfd6d65e4ad3ae69388f85183266. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.237888 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 142434us
I20260925 01:49:57.245043 12516 raft_consensus.cc:515] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:57.245863 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 8909181e04be451aa8aeb219c9da8b89 (DEFAULT_TABLE table=default.Table_c239ceffba664dce9924f9e9a62a2fc4 [id=350a1f36361548178181ef7683168652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.246173 11946 raft_consensus.cc:2889] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:57.246752 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 49692d2824a34f48a4dcefad8c89618b (DEFAULT_TABLE table=default.Table_2428d63259334c4e96044516c1560465 [id=374d5a46f2b2482598aec3f5cc801aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.247359 11210 tablet_service.cc:1511] Processing CreateTablet for tablet b4792e46d001464c9aadc374c1428855 (DEFAULT_TABLE table=default.Table_e479a88d2f84453899d98049b7fbbbe4 [id=43d5d832b4354f51b9a3442dd73edfed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.248101 12425 raft_consensus.cc:2749] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:57.250217 11501 tablet_service.cc:1511] Processing CreateTablet for tablet daf6b1408d094086a79488d64dc62c75 (DEFAULT_TABLE table=default.Table_f3e4b358fe414d429eeb14421237c8ac [id=c633dead809249008fc80c9f840f4ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.250701 12516 leader_election.cc:290] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:57.250828 11492 tablet_service.cc:1511] Processing CreateTablet for tablet f4533c3500a3431ca6ef5f23b0cf6830 (DEFAULT_TABLE table=default.Table_1238c41b271747fe9d9f419001ea61cd [id=554a0a3a8a1c446db2bb5018fc5bf896]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.252107 11497 tablet_service.cc:1511] Processing CreateTablet for tablet ea10c9a7e20b48c69eb5f24631403e93 (DEFAULT_TABLE table=default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51 [id=63171538e0ac47ce9572edcc3b1ea05b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.252769 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 72cfb274f13548b1ba4bd457bb31082f (DEFAULT_TABLE table=default.Table_71cd6d56414a44a4b1b51b2eda682e0b [id=9422c4fc0c8f4b1091d645b7c8894c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.253392 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 032d44a6f2fa4c7c8db20c8d0ecd17c2 (DEFAULT_TABLE table=default.Table_7cb9be806d964f64b907aa0a93b3f943 [id=8d5c0ffe322a4f50919b900ca59be5d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.254105 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 58240b1659fd46c6b2e41f77f7ed8949 (DEFAULT_TABLE table=default.Table_7e40b99aed8a4375bea1481553c776f2 [id=cfc024cce5474328b8c991e001c2abc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.256845 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 (DEFAULT_TABLE table=default.Table_780efdb9ac8e46519a54518ad282d2e2 [id=3631e8e172534d31af0c8ac8c22cee4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.257107 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 67d5d8ea522d4682a0eb4b3a51786f16 (DEFAULT_TABLE table=default.Table_ebffdaf09f574cc4ace973f9ab55d5c3 [id=22e6cb5866ef4168a6555c8c3d95ea3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.259318 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1755df2ee2ff47d99b22400e1f9dfbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.262965 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_445d4f81dda44494b1559b9c308b5c4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.263648 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_445d4f81dda44494b1559b9c308b5c4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.266538 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_13b4489711b34220a1a3deb6528e80c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.267145 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13b4489711b34220a1a3deb6528e80c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.248919 12445 consensus_queue.cc:1048] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
W20260925 01:49:57.272636 11314 leader_election.cc:343] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.273793 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49692d2824a34f48a4dcefad8c89618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.274317 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3e8965af19874c039d884161e1c6efc2" } new_table_name: "default.Table_88643d9e310644a3a751773450f73959" modify_external_catalogs: true
I20260925 01:49:57.274981 12606 consensus_queue.cc:1048] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260925 01:49:57.275534 12487 consensus_queue.cc:1048] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260925 01:49:57.275743 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1ef54231b09343c68073a0b4a490545b" } new_table_name: "default.Table_8041861b60a24a3c974d0e20742fc1ac" modify_external_catalogs: true
I20260925 01:49:57.276134 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 58240b1659fd46c6b2e41f77f7ed8949 (DEFAULT_TABLE table=default.Table_7e40b99aed8a4375bea1481553c776f2 [id=cfc024cce5474328b8c991e001c2abc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.276772 11342 tablet_service.cc:1511] Processing CreateTablet for tablet ea10c9a7e20b48c69eb5f24631403e93 (DEFAULT_TABLE table=default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51 [id=63171538e0ac47ce9572edcc3b1ea05b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.277801 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 8909181e04be451aa8aeb219c9da8b89 (DEFAULT_TABLE table=default.Table_c239ceffba664dce9924f9e9a62a2fc4 [id=350a1f36361548178181ef7683168652]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.278429 11352 tablet_service.cc:1511] Processing CreateTablet for tablet daf6b1408d094086a79488d64dc62c75 (DEFAULT_TABLE table=default.Table_f3e4b358fe414d429eeb14421237c8ac [id=c633dead809249008fc80c9f840f4ee0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.278851 11314 leader_election.cc:343] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.278976 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d5d8ea522d4682a0eb4b3a51786f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.281936 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4792e46d001464c9aadc374c1428855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.285365 11931 ts_tablet_manager.cc:1916] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.285657 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b (DEFAULT_TABLE table=default.Table_a4cf2abec50042869b042af574e134b2 [id=0ab73bfe0e814f68b14134be8ca04343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.287035 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.287340 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.285589 11204 tablet_service.cc:1511] Processing CreateTablet for tablet daf6b1408d094086a79488d64dc62c75 (DEFAULT_TABLE table=default.Table_f3e4b358fe414d429eeb14421237c8ac [id=c633dead809249008fc80c9f840f4ee0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.290954 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 45925c3a3dca4f0c88c0a5c52f2b4d6e (DEFAULT_TABLE table=default.Table_1ff7d1bdc46449e9adbec517b976a6bb [id=5a51e70940be43a3820e9331ec85b1f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.291409 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45925c3a3dca4f0c88c0a5c52f2b4d6e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.284523 11314 consensus_peers.cc:597] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ccffbe61eea34333abdc6da94612c0f6. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:57.290746 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 34c9661fe2914111ad322eff99c42030 (DEFAULT_TABLE table=default.Table_9ee1a8c4418c472aa59402101cba1228 [id=560863e67fe845319d7dc479443fbb37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.290972 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 45c06bf5641542f5aa36b160b31d797f (DEFAULT_TABLE table=default.Table_c348106a82d5453083795cc37f76375b [id=b0a922b07ae645cbb10f22a6426ac388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.296945 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cc6c271622254896bab14472c1455e8f" } modify_external_catalogs: true
I20260925 01:49:57.297190 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cc6c271622254896bab14472c1455e8f" } modify_external_catalogs: true
I20260925 01:49:57.297937 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.298079 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f1000553782a4118a246bbda71eaf618" } modify_external_catalogs: true
I20260925 01:49:57.298133 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7fc62b7e76d64496818ec9146e884b17" } new_table_name: "default.Table_3f87fc14acdb4b89927b49c8fb09c83d" modify_external_catalogs: true
I20260925 01:49:57.298275 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f1000553782a4118a246bbda71eaf618" } modify_external_catalogs: true
I20260925 01:49:57.299074 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c239ceffba664dce9924f9e9a62a2fc4" } modify_external_catalogs: true
I20260925 01:49:57.299240 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c239ceffba664dce9924f9e9a62a2fc4" } modify_external_catalogs: true
I20260925 01:49:57.299933 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3d10755c25e9452c8175928253480e9e" } modify_external_catalogs: true
I20260925 01:49:57.300117 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3d10755c25e9452c8175928253480e9e" } modify_external_catalogs: true
I20260925 01:49:57.301080 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b65cab23b4894abc96c8bb874bf3dde2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.301626 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b65cab23b4894abc96c8bb874bf3dde2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.304013 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1602d22ad10f45d592c79e0d2affb2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.309355 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032d44a6f2fa4c7c8db20c8d0ecd17c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.310760 11372 raft_consensus.cc:2468] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:57.312592 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea10c9a7e20b48c69eb5f24631403e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.313355 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8909181e04be451aa8aeb219c9da8b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.305546 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebabbda434944f5aeaf7f422de07a98 (DEFAULT_TABLE table=default.Table_a7a1ef6d5f1e47f384b06ba12847cf6c [id=7a3c54c47916458aa318706bf1273721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.316807 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3541e17b47bc47f5b69add361877a2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.309571 11946 raft_consensus.cc:2272] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.310792 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8909181e04be451aa8aeb219c9da8b89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.318627 11344 tablet_service.cc:1511] Processing CreateTablet for tablet f4533c3500a3431ca6ef5f23b0cf6830 (DEFAULT_TABLE table=default.Table_1238c41b271747fe9d9f419001ea61cd [id=554a0a3a8a1c446db2bb5018fc5bf896]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.319295 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:57.319599 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1e462c544f4c04a148e273f545570d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.321081 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d3283efd340e4467bff4bc8b33862b02" } modify_external_catalogs: true
I20260925 01:49:57.321293 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 49692d2824a34f48a4dcefad8c89618b (DEFAULT_TABLE table=default.Table_2428d63259334c4e96044516c1560465 [id=374d5a46f2b2482598aec3f5cc801aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.322266 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d3283efd340e4467bff4bc8b33862b02" } modify_external_catalogs: true
I20260925 01:49:57.323163 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf6b1408d094086a79488d64dc62c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.327688 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf6b1408d094086a79488d64dc62c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.327725 11946 ts_tablet_manager.cc:1916] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.330601 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 1755df2ee2ff47d99b22400e1f9dfbe6 (DEFAULT_TABLE table=default.Table_cc4c3ad2d7fd41d7b40fe7b8fe8b5a96 [id=9c683e3c14984e659635371900eab9b0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.331190 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3541e17b47bc47f5b69add361877a2bf consensus state has no leader
W20260925 01:49:57.332109 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8152c9e0b0af4ab2a18c5a0080e22ffc consensus state has no leader
W20260925 01:49:57.333508 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd594870fa6a4ba190a18a48d821d72c consensus state has no leader
I20260925 01:49:57.337241 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49692d2824a34f48a4dcefad8c89618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.337517 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72cfb274f13548b1ba4bd457bb31082f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.337726 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58240b1659fd46c6b2e41f77f7ed8949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.338207 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1755df2ee2ff47d99b22400e1f9dfbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.342226 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032d44a6f2fa4c7c8db20c8d0ecd17c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.346262 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4533c3500a3431ca6ef5f23b0cf6830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.350095 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea10c9a7e20b48c69eb5f24631403e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.354190 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58240b1659fd46c6b2e41f77f7ed8949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.354838 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 72cfb274f13548b1ba4bd457bb31082f (DEFAULT_TABLE table=default.Table_71cd6d56414a44a4b1b51b2eda682e0b [id=9422c4fc0c8f4b1091d645b7c8894c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.243077 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 1602d22ad10f45d592c79e0d2affb2ae (DEFAULT_TABLE table=default.Table_c8099602485b40e2af198824f853c448 [id=21cc9da2107a4e4da619e4c915fd6541]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.360993 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 032d44a6f2fa4c7c8db20c8d0ecd17c2 (DEFAULT_TABLE table=default.Table_7cb9be806d964f64b907aa0a93b3f943 [id=8d5c0ffe322a4f50919b900ca59be5d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.369539 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c06bf5641542f5aa36b160b31d797f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.369678 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c9661fe2914111ad322eff99c42030. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.372205 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b98ad0f02eb74eba897040401a164f5c" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:57.358593 11486 tablet_service.cc:1511] Processing CreateTablet for tablet b4792e46d001464c9aadc374c1428855 (DEFAULT_TABLE table=default.Table_e479a88d2f84453899d98049b7fbbbe4 [id=43d5d832b4354f51b9a3442dd73edfed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.373517 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf6b1408d094086a79488d64dc62c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.375281 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4533c3500a3431ca6ef5f23b0cf6830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.387223 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 (DEFAULT_TABLE table=default.Table_780efdb9ac8e46519a54518ad282d2e2 [id=3631e8e172534d31af0c8ac8c22cee4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.387859 12620 raft_consensus.cc:493] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.388958 11753 tablet_bootstrap.cc:492] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:57.390795 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 45c06bf5641542f5aa36b160b31d797f (DEFAULT_TABLE table=default.Table_c348106a82d5453083795cc37f76375b [id=b0a922b07ae645cbb10f22a6426ac388]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.393004 11754 tablet_bootstrap.cc:654] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:57.400075 11314 leader_election.cc:304] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:57.406024 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebabbda434944f5aeaf7f422de07a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.406122 11753 ts_tablet_manager.cc:1403] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.381s user 0.001s sys 0.012s
I20260925 01:49:57.406706 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 67d5d8ea522d4682a0eb4b3a51786f16 (DEFAULT_TABLE table=default.Table_ebffdaf09f574cc4ace973f9ab55d5c3 [id=22e6cb5866ef4168a6555c8c3d95ea3f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.406976 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 92475.4us
I20260925 01:49:57.407112 12606 raft_consensus.cc:2804] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:57.407182 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b (DEFAULT_TABLE table=default.Table_a4cf2abec50042869b042af574e134b2 [id=0ab73bfe0e814f68b14134be8ca04343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.407234 12620 raft_consensus.cc:515] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.408813 11755 tablet_bootstrap.cc:492] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:57.403854 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a6ec9b9b5d4f60a7e5f3edf0687b56" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:57.409322 12606 raft_consensus.cc:493] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:57.409494 12606 raft_consensus.cc:3060] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:57.414917 11314 leader_election.cc:304] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
W20260925 01:49:57.416916 11456 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:49:57.421703 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 45925c3a3dca4f0c88c0a5c52f2b4d6e (DEFAULT_TABLE table=default.Table_1ff7d1bdc46449e9adbec517b976a6bb [id=5a51e70940be43a3820e9331ec85b1f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.422165 11755 ts_tablet_manager.cc:1403] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.648s user 0.016s sys 0.004s
I20260925 01:49:57.424513 12487 raft_consensus.cc:2804] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:57.432670 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:57.433717 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_77a2a3706c294f3bb05ed00c40145a6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:57.434494 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f272b10ac9224db48f3c16d93a0ea84e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:57.435276 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_eb7ce1a2a7094b9a948582c38d8958a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:57.435691 12487 raft_consensus.cc:493] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:57.435886 12487 raft_consensus.cc:3060] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:57.440346 11356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 368) took 1087 ms. Trace:
I20260925 01:49:57.441051 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72cfb274f13548b1ba4bd457bb31082f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.441851 11356 rpcz_store.cc:276] 0925 01:49:56.352668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.352761 (+ 93us) service_pool.cc:224] Handling call
0925 01:49:56.397431 (+ 44670us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:56.397456 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:56.942542 (+545086us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.370461 (+427919us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:57.440249 (+ 69788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:57.442574 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 49692d2824a34f48a4dcefad8c89618b (DEFAULT_TABLE table=default.Table_2428d63259334c4e96044516c1560465 [id=374d5a46f2b2482598aec3f5cc801aef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.444352 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49692d2824a34f48a4dcefad8c89618b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.445856 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77a2a3706c294f3bb05ed00c40145a6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:57.446190 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f272b10ac9224db48f3c16d93a0ea84e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.446051 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032d44a6f2fa4c7c8db20c8d0ecd17c2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.447592 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.448925 12620 leader_election.cc:290] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:49:57.449036 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb7ce1a2a7094b9a948582c38d8958a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.451300 11753 raft_consensus.cc:359] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.451506 11753 raft_consensus.cc:385] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:57.451602 11753 raft_consensus.cc:740] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:57.452749 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:57.453806 11176 leader_election.cc:343] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.457170 12445 raft_consensus.cc:493] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.457484 12445 raft_consensus.cc:515] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:57.458177 11350 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 360) took 1185 ms. Trace:
I20260925 01:49:57.458539 11518 raft_consensus.cc:1275] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Refusing update from remote peer aac4ec033f794d7a90b52aa4e0b6155d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 01:49:57.458760 11754 tablet_bootstrap.cc:492] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:57.459146 11754 ts_tablet_manager.cc:1403] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.246s user 0.008s sys 0.000s
I20260925 01:49:57.460700 11754 raft_consensus.cc:359] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.461041 11754 raft_consensus.cc:385] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:57.461591 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6599a18283614e759cf3886d72c8250b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.457484 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 1755df2ee2ff47d99b22400e1f9dfbe6 (DEFAULT_TABLE table=default.Table_cc4c3ad2d7fd41d7b40fe7b8fe8b5a96 [id=9c683e3c14984e659635371900eab9b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.463284 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa2e2d4bfe14b5db5b1dfd67e19f11c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:57.463618 11376 raft_consensus.cc:2468] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:57.465636 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1602d22ad10f45d592c79e0d2affb2ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.471340 11754 raft_consensus.cc:740] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:57.471709 11754 consensus_queue.cc:260] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:49:57.472735 11314 consensus_peers.cc:597] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c28c9e51d80a442486b78be32c74a94f. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:57.476920 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a6ec9b9b5d4f60a7e5f3edf0687b56" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:57.477341 11238 raft_consensus.cc:1275] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Refusing update from remote peer aac4ec033f794d7a90b52aa4e0b6155d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:49:57.468487 11350 rpcz_store.cc:276] 0925 01:49:56.261728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.261805 (+ 77us) service_pool.cc:224] Handling call
0925 01:49:56.356150 (+ 94345us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:56.356285 (+ 135us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:57.273603 (+917318us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.446872 (+173269us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:57.447032 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:57.486490 11350 tablet_service.cc:1511] Processing CreateTablet for tablet b4792e46d001464c9aadc374c1428855 (DEFAULT_TABLE table=default.Table_e479a88d2f84453899d98049b7fbbbe4 [id=43d5d832b4354f51b9a3442dd73edfed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.487639 12445 leader_election.cc:290] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:57.488829 12623 tablet.cc:1751] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260925 01:49:57.491187 11314 leader_election.cc:343] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:57.492812 11314 consensus_peers.cc:597] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:57.497795 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d5d8ea522d4682a0eb4b3a51786f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.497799 11931 ts_tablet_manager.cc:1929] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:57.498010 11931 log.cc:1199] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:49:57.498705 11931 ts_tablet_manager.cc:1950] T ca17585cd523440ca1e9b754f3aedf8a P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:57.503337 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 401) took 1018 ms. Trace:
I20260925 01:49:57.503587 11931 rpcz_store.cc:276] 0925 01:49:56.484801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.485021 (+ 220us) service_pool.cc:224] Handling call
0925 01:49:57.177552 (+692531us) ts_tablet_manager.cc:1151] Deleting tablet ca17585cd523440ca1e9b754f3aedf8a
0925 01:49:57.181409 (+ 3857us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.492338 (+310929us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.497659 (+ 5321us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.503229 (+ 5570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3397,"tablet-delete.queue_time_us":666244}
I20260925 01:49:57.504292 11931 tablet_replica.cc:333] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:57.504382 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ca17585cd523440ca1e9b754f3aedf8a (table default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]) successfully deleted
I20260925 01:49:57.505077 11931 raft_consensus.cc:2243] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:57.509321 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c06bf5641542f5aa36b160b31d797f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.509858 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4792e46d001464c9aadc374c1428855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.498438 11753 consensus_queue.cc:260] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.493223 11457 leader_election.cc:304] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:57.508024 11314 leader_election.cc:343] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.514400 11212 tablet_service.cc:1511] Processing CreateTablet for tablet db20c20da0ec4785a2a3a18aba109b8f (DEFAULT_TABLE table=default.Table_a162b1569eab48759aac0ea37c2056e7 [id=9d82b2e2ff0440cca6625f55d1bea7ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.515631 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db20c20da0ec4785a2a3a18aba109b8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.519881 11611 log.cc:927] Time spent T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
I20260925 01:49:57.520401 11359 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 367) took 1155 ms. Trace:
I20260925 01:49:57.521140 11359 rpcz_store.cc:276] 0925 01:49:56.352553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.352735 (+ 182us) service_pool.cc:224] Handling call
0925 01:49:56.394767 (+ 42032us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:56.394801 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:57.324166 (+929365us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.479884 (+155718us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:57.508276 (+ 28392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:57.521818 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 67d5d8ea522d4682a0eb4b3a51786f16 (DEFAULT_TABLE table=default.Table_ebffdaf09f574cc4ace973f9ab55d5c3 [id=22e6cb5866ef4168a6555c8c3d95ea3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.505697 11931 raft_consensus.cc:2272] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.522410 11755 raft_consensus.cc:359] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.523111 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 49b110516abb45d1880d0e0e33e20174
I20260925 01:49:57.524838 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b110516abb45d1880d0e0e33e20174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.527143 11755 raft_consensus.cc:385] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:57.527539 11755 raft_consensus.cc:740] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:57.534337 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5e6715233be44b9aad5210d17500f59d
I20260925 01:49:57.535256 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c261fd584d4b43a7bbf9557a024a5a3b" } new_table_name: "default.Table_7b7c710b210a4bb894250a51bc06f3e3" modify_external_catalogs: true
I20260925 01:49:57.536698 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8909181e04be451aa8aeb219c9da8b89
I20260925 01:49:57.537722 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a8c2185b6ac4411baea7759cf6be1e25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.538381 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8c2185b6ac4411baea7759cf6be1e25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.535760 11931 ts_tablet_manager.cc:1916] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.539727 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fce91b00d3a14e6398abacad61ff5b0f
I20260925 01:49:57.540570 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b8778ebbb44b4938910562a360d966ee" } new_table_name: "default.Table_b548583918934673acadda748a1d2aff" modify_external_catalogs: true
I20260925 01:49:57.543198 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e6715233be44b9aad5210d17500f59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.543462 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 8909181e04be451aa8aeb219c9da8b89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.543679 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet fce91b00d3a14e6398abacad61ff5b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.545387 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 811b957c4e6647ccaa688d7273ec9eeb
I20260925 01:49:57.546633 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:57.547895 11953 ts_tablet_manager.cc:1929] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:57.548899 12585 consensus_queue.cc:1048] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260925 01:49:57.548883 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_32a32bf92a704259be81d568b38294a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.549584 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32a32bf92a704259be81d568b38294a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:57.550243 11314 leader_election.cc:343] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b98ad0f02eb74eba897040401a164f5c
I20260925 01:49:57.550868 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1755df2ee2ff47d99b22400e1f9dfbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.553683 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 (DEFAULT_TABLE table=default.Table_780efdb9ac8e46519a54518ad282d2e2 [id=3631e8e172534d31af0c8ac8c22cee4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.554235 11953 log.cc:1199] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/b9937c3776f549dea887ace26dae492c
I20260925 01:49:57.557848 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4792e46d001464c9aadc374c1428855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.557791 11314 leader_election.cc:304] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:57.558463 11314 consensus_peers.cc:597] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b16a38a30ff44fb8d7eb01498f9b9c7. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:57.558776 12445 raft_consensus.cc:2749] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:57.559019 12445 consensus_queue.cc:1048] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:57.559579 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d5d8ea522d4682a0eb4b3a51786f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.536723 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
W20260925 01:49:57.560531 11314 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b05053f5646f4748a99647b7dbfae686
I20260925 01:49:57.561437 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e2286db8340a41b88ba1ce8f2b6df8d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:57.561762 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.562635 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2286db8340a41b88ba1ce8f2b6df8d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.564965 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]). Expected version 2 got 0
I20260925 01:49:57.567145 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6b7ea24cfbf4403b9a9683f626e600df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:57.567670 12623 tablet.cc:1751] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260925 01:49:57.567977 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b7ea24cfbf4403b9a9683f626e600df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.579692 12487 raft_consensus.cc:515] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.587455 11204 tablet_service.cc:1511] Processing CreateTablet for tablet b33e596a71be41839a8e463eec26ce2f (DEFAULT_TABLE table=default.Table_26feb002759949f0881ffb854d49bbf6 [id=393f8c5c94ec487ead8a39a9465a6c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.587884 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33e596a71be41839a8e463eec26ce2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.587787 11502 tablet_service.cc:1511] Processing CreateTablet for tablet db20c20da0ec4785a2a3a18aba109b8f (DEFAULT_TABLE table=default.Table_a162b1569eab48759aac0ea37c2056e7 [id=9d82b2e2ff0440cca6625f55d1bea7ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.588743 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 91f3714b2dec48ee9e082c3a9e7d9e7b (DEFAULT_TABLE table=default.Table_3f4553f93acd4bc68761ffa95f3a0f6e [id=e498b82753cd4ebca78da2a6d2cffb23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.589277 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f3714b2dec48ee9e082c3a9e7d9e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.590863 12487 leader_election.cc:290] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:57.598927 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.601213 11177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 246017us
I20260925 01:49:57.601992 12517 raft_consensus.cc:493] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.602274 12517 raft_consensus.cc:515] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.603081 12517 leader_election.cc:290] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:57.595064 11755 consensus_queue.cc:260] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.607304 11953 ts_tablet_manager.cc:1950] T b9937c3776f549dea887ace26dae492c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:57.608446 12585 raft_consensus.cc:493] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.608632 12585 raft_consensus.cc:515] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.617508 11753 ts_tablet_manager.cc:1434] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.112s user 0.001s sys 0.002s
I20260925 01:49:57.617954 11753 tablet_bootstrap.cc:492] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:57.617548 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 132488us
I20260925 01:49:57.622745 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:57.627785 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b110516abb45d1880d0e0e33e20174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.628408 11501 tablet_service.cc:1511] Processing CreateTablet for tablet b33e596a71be41839a8e463eec26ce2f (DEFAULT_TABLE table=default.Table_26feb002759949f0881ffb854d49bbf6 [id=393f8c5c94ec487ead8a39a9465a6c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.628505 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 121) took 8844 ms. Trace:
I20260925 01:49:57.628921 11485 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e6715233be44b9aad5210d17500f59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.629173 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.629334 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.629479 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet fce91b00d3a14e6398abacad61ff5b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.629611 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 8909181e04be451aa8aeb219c9da8b89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:57.629834 12516 raft_consensus.cc:2804] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:57.630314 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db20c20da0ec4785a2a3a18aba109b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.630590 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45925c3a3dca4f0c88c0a5c52f2b4d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.631023 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.633076 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 91f3714b2dec48ee9e082c3a9e7d9e7b (DEFAULT_TABLE table=default.Table_3f4553f93acd4bc68761ffa95f3a0f6e [id=e498b82753cd4ebca78da2a6d2cffb23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.633476 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f3714b2dec48ee9e082c3a9e7d9e7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.635831 11753 tablet_bootstrap.cc:654] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:57.636052 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:57.636266 11238 raft_consensus.cc:3060] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:57.639529 12623 tablet.cc:1751] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:49:57.643117 12585 leader_election.cc:290] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:57.643047 12606 raft_consensus.cc:515] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.647821 11238 raft_consensus.cc:2468] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
W20260925 01:49:57.656934 11177 leader_election.cc:343] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.657246 11177 leader_election.cc:304] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:57.657639 12517 raft_consensus.cc:2749] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:57.659107 11314 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:49:57.672263 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:57.672631 11238 raft_consensus.cc:3060] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:57.674588 11755 ts_tablet_manager.cc:1434] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.203s user 0.002s sys 0.003s
I20260925 01:49:57.678689 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b28192e3b45e7b5370d55804cb043" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:57.679701 12606 leader_election.cc:290] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:57.680401 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 45c06bf5641542f5aa36b160b31d797f (DEFAULT_TABLE table=default.Table_c348106a82d5453083795cc37f76375b [id=b0a922b07ae645cbb10f22a6426ac388]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.683830 11177 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.684489 12510 raft_consensus.cc:493] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:57.687000 11755 tablet_bootstrap.cc:492] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:57.690565 11238 raft_consensus.cc:2468] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:57.691036 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33e596a71be41839a8e463eec26ce2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.693794 12510 raft_consensus.cc:515] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:57.694769 12510 leader_election.cc:290] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:57.683892 11931 ts_tablet_manager.cc:1929] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:49:57.695748 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b (DEFAULT_TABLE table=default.Table_a4cf2abec50042869b042af574e134b2 [id=0ab73bfe0e814f68b14134be8ca04343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.696100 11931 log.cc:1199] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/0fa7a3941254478c800f9e366e3f7b06
I20260925 01:49:57.698431 11518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b28192e3b45e7b5370d55804cb043" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:57.699043 11176 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.699173 11176 leader_election.cc:304] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:57.701725 12622 raft_consensus.cc:2749] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:57.702361 11931 ts_tablet_manager.cc:1950] T 0fa7a3941254478c800f9e366e3f7b06 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:57.648468 11953 rpcz_store.cc:276] 0925 01:49:48.763531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.763894 (+ 363us) service_pool.cc:224] Handling call
0925 01:49:56.950921 (+8187027us) ts_tablet_manager.cc:1151] Deleting tablet b9937c3776f549dea887ace26dae492c
0925 01:49:56.950933 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.021465 (+ 70532us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x6160002ea8b8. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74e24cb0 00007f1c74e035e5 00007f1c74eb3f2c 00007f1c74f24b53 00007f1c762ad583 00007f1c78e7a8b7 00007f1c78eada64 00007f1c78e8e3a0 00007f1c78e8e12d 0000000000aaef9c
0925 01:49:57.314655 (+293190us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.516703 (+202048us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.607737 (+ 91034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26571520,"tablet-delete.queue_time_us":8186755}
I20260925 01:49:57.704695 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet b9937c3776f549dea887ace26dae492c (table default.Table_7b5309958b834d63b67d8a48293e5edd [id=96eed11bd70c486199e13071d27865da]) successfully deleted
W20260925 01:49:57.704914 11456 leader_election.cc:343] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 86079f22abb74d438c61ecc2a7379cbd
I20260925 01:49:57.708305 11314 leader_election.cc:304] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:57.712495 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 406) took 1116 ms. Trace:
I20260925 01:49:57.713035 11497 tablet_service.cc:1511] Processing CreateTablet for tablet af6f0e35e7184b16bd53dba85941b192 (DEFAULT_TABLE table=default.Table_9fe01830d8654ba98bf36de7f9bf2ee3 [id=a6038d2814054a19a1333ef1086fffd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.713541 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af6f0e35e7184b16bd53dba85941b192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.713441 11931 rpcz_store.cc:276] 0925 01:49:56.596032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.596668 (+ 636us) service_pool.cc:224] Handling call
0925 01:49:57.504134 (+907466us) ts_tablet_manager.cc:1151] Deleting tablet 0fa7a3941254478c800f9e366e3f7b06
0925 01:49:57.504145 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.660409 (+156264us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.683797 (+ 23388us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.712296 (+ 28499us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":907164}
I20260925 01:49:57.716899 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]) successfully deleted
I20260925 01:49:57.717535 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 405) took 1122 ms. Trace:
I20260925 01:49:57.718046 11216 tablet_service.cc:1511] Processing CreateTablet for tablet db1339652d744cda9215d84e846d1e8e (DEFAULT_TABLE table=default.Table_280affebcd9b4f96ab322b25e3b854f8 [id=cca0481e89f64b9fa256cfd8df8c6dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.718319 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 4af9f89eff914aceb05ff00847099693 (DEFAULT_TABLE table=default.Table_54f5638c946a48a9be39bfb1d5904aed [id=115380b358644b7680753b0142db45f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.719188 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1339652d744cda9215d84e846d1e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.718550 11203 tablet_service.cc:1511] Processing CreateTablet for tablet b2b6e338d18343eb80088ac994b6152d (DEFAULT_TABLE table=default.Table_73c8de7884964f1e9a3da5929fe9f64e [id=445546e140e24f9d825af7c67dfd7664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.719550 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b6e338d18343eb80088ac994b6152d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.718767 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 98eb63fecb5c421e8ecc746762663c06 (DEFAULT_TABLE table=default.Table_a44ffb8d5f914021ab1145c6010efd54 [id=757b5fa02a3044688750c11f5082e988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.719934 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eb63fecb5c421e8ecc746762663c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.722751 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af9f89eff914aceb05ff00847099693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.723896 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 4af9f89eff914aceb05ff00847099693 (DEFAULT_TABLE table=default.Table_54f5638c946a48a9be39bfb1d5904aed [id=115380b358644b7680753b0142db45f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.724303 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af9f89eff914aceb05ff00847099693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.726519 11499 tablet_service.cc:1511] Processing CreateTablet for tablet b2b6e338d18343eb80088ac994b6152d (DEFAULT_TABLE table=default.Table_73c8de7884964f1e9a3da5929fe9f64e [id=445546e140e24f9d825af7c67dfd7664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.727027 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b6e338d18343eb80088ac994b6152d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.730909 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_680652ee5db44c0ca4fa70ca72f3afef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.731626 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_680652ee5db44c0ca4fa70ca72f3afef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.731669 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 8909181e04be451aa8aeb219c9da8b89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.734730 11492 tablet_service.cc:1511] Processing CreateTablet for tablet db1339652d744cda9215d84e846d1e8e (DEFAULT_TABLE table=default.Table_280affebcd9b4f96ab322b25e3b854f8 [id=cca0481e89f64b9fa256cfd8df8c6dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.735235 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1339652d744cda9215d84e846d1e8e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.739773 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 45673.3us
I20260925 01:49:57.740438 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c06bf5641542f5aa36b160b31d797f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.718302 11931 rpcz_store.cc:276] 0925 01:49:56.594899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.597039 (+ 2140us) service_pool.cc:224] Handling call
0925 01:49:57.716286 (+1119247us) ts_tablet_manager.cc:1151] Deleting tablet 4f117df272c342b6b4ea5e5a4d7fd137
0925 01:49:57.716300 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.717507 (+ 1207us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1118828}
I20260925 01:49:57.742954 11931 tablet_replica.cc:333] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:57.744801 11931 raft_consensus.cc:2243] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:57.752583 12425 raft_consensus.cc:2804] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:57.754576 11212 tablet_service.cc:1511] Processing CreateTablet for tablet af6f0e35e7184b16bd53dba85941b192 (DEFAULT_TABLE table=default.Table_9fe01830d8654ba98bf36de7f9bf2ee3 [id=a6038d2814054a19a1333ef1086fffd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.755208 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af6f0e35e7184b16bd53dba85941b192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.756587 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 91f3714b2dec48ee9e082c3a9e7d9e7b (DEFAULT_TABLE table=default.Table_3f4553f93acd4bc68761ffa95f3a0f6e [id=e498b82753cd4ebca78da2a6d2cffb23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.759749 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_701924856dbf4c96afa419ddee50b09b" } new_table_name: "default.Table_6529ebbfdfc342a0b8dd088869ca0556" modify_external_catalogs: true
I20260925 01:49:57.760459 11931 raft_consensus.cc:2272] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.761510 11931 ts_tablet_manager.cc:1916] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.761543 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ae4548d7f5a946568a2f0c4515aa6107" } new_table_name: "default.Table_eb4b0c04d7514df3878af58f571b941f" modify_external_catalogs: true
I20260925 01:49:57.763161 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 45925c3a3dca4f0c88c0a5c52f2b4d6e (DEFAULT_TABLE table=default.Table_1ff7d1bdc46449e9adbec517b976a6bb [id=5a51e70940be43a3820e9331ec85b1f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.764338 12630 tablet.cc:1751] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:57.764803 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b110516abb45d1880d0e0e33e20174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.765622 11354 tablet_service.cc:1511] Processing CreateTablet for tablet b33e596a71be41839a8e463eec26ce2f (DEFAULT_TABLE table=default.Table_26feb002759949f0881ffb854d49bbf6 [id=393f8c5c94ec487ead8a39a9465a6c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.766937 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e6715233be44b9aad5210d17500f59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.767431 11345 tablet_service.cc:1511] Processing CreateTablet for tablet af6f0e35e7184b16bd53dba85941b192 (DEFAULT_TABLE table=default.Table_9fe01830d8654ba98bf36de7f9bf2ee3 [id=a6038d2814054a19a1333ef1086fffd3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.772733 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c6e5c4dd0d64fb389a7ff2620203a38 has no consensus state
I20260925 01:49:57.778571 11343 tablet_service.cc:1511] Processing CreateTablet for tablet db20c20da0ec4785a2a3a18aba109b8f (DEFAULT_TABLE table=default.Table_a162b1569eab48759aac0ea37c2056e7 [id=9d82b2e2ff0440cca6625f55d1bea7ef]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.778630 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 64ce95e571524d6ea6c98087bc08d4b9 (table default.Table_b234dbd8701a48f9ac1db6517557eb62 [id=a366ecc4f824423ea7184781cf6a0206], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 64ce95e571524d6ea6c98087bc08d4b9 consensus state has no leader
I20260925 01:49:57.796765 12425 raft_consensus.cc:697] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:57.799037 11946 ts_tablet_manager.cc:1929] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:57.799211 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c8971e1e09594fddab21222ee8b73730" } new_table_name: "default.Table_e99b81ca19e74a4d9f6a5cb474507f7f" modify_external_catalogs: true
I20260925 01:49:57.799945 11357 tablet_service.cc:1511] Processing CreateTablet for tablet db1339652d744cda9215d84e846d1e8e (DEFAULT_TABLE table=default.Table_280affebcd9b4f96ab322b25e3b854f8 [id=cca0481e89f64b9fa256cfd8df8c6dcd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.801502 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 90432.4us
I20260925 01:49:57.804288 11457 leader_election.cc:304] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:57.805949 11946 log.cc:1199] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/1396d679e5824c469490170d257f6a9b
I20260925 01:49:57.807559 11946 ts_tablet_manager.cc:1950] T 1396d679e5824c469490170d257f6a9b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:57.807956 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 178) took 7092 ms. Trace:
I20260925 01:49:57.816648 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 4af9f89eff914aceb05ff00847099693 (DEFAULT_TABLE table=default.Table_54f5638c946a48a9be39bfb1d5904aed [id=115380b358644b7680753b0142db45f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.821904 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:57.831396 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9064b44c74cd4452be3e52fd938cf131"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:57.832640 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9064b44c74cd4452be3e52fd938cf131 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:57.832854 11358 tablet_service.cc:1511] Processing CreateTablet for tablet b2b6e338d18343eb80088ac994b6152d (DEFAULT_TABLE table=default.Table_73c8de7884964f1e9a3da5929fe9f64e [id=445546e140e24f9d825af7c67dfd7664]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.835908 11522 raft_consensus.cc:3060] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:57.836764 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 98eb63fecb5c421e8ecc746762663c06 (DEFAULT_TABLE table=default.Table_a44ffb8d5f914021ab1145c6010efd54 [id=757b5fa02a3044688750c11f5082e988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.837958 11946 rpcz_store.cc:276] 0925 01:49:50.715244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.722175 (+ 6931us) service_pool.cc:224] Handling call
0925 01:49:57.141538 (+6419363us) ts_tablet_manager.cc:1151] Deleting tablet 1396d679e5824c469490170d257f6a9b
0925 01:49:57.141551 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.336960 (+195409us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.706012 (+369052us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.807922 (+101910us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6383372}
I20260925 01:49:57.838827 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 1396d679e5824c469490170d257f6a9b (table default.Table_9f4e74bbaa2e4916a69570f511ad227f [id=09b99e28bf4b4ef4816110285191b951]) successfully deleted
I20260925 01:49:57.839668 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet fce91b00d3a14e6398abacad61ff5b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.840091 12516 raft_consensus.cc:697] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:57.840170 12623 tablet.cc:1746] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Skipping requested alter to schema version 2, tablet already version 2
I20260925 01:49:57.840798 12627 tablet.cc:1751] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:57.843011 11314 leader_election.cc:304] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:57.843381 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca17585cd523440ca1e9b754f3aedf8a" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:57.844074 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 6a81ba9001f047648d92f13a729408ed (DEFAULT_TABLE table=default.Table_999ce0c90de544958ffaff0670501f96 [id=9cdb3f901a0e4002b9d95d4d8dc7a6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.844161 12339 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" instance_seqno: 1790300980193841) as {username='slave'} at 127.10.159.194:39555; Asking this server to re-register.
I20260925 01:49:57.844532 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a81ba9001f047648d92f13a729408ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.846318 12558 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 01:49:57.847121 12326 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" instance_seqno: 1790300980724084) as {username='slave'} at 127.10.159.195:56827; Asking this server to re-register.
I20260925 01:49:57.847635 12606 raft_consensus.cc:2804] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:57.847817 12606 raft_consensus.cc:697] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:57.848358 12338 ts_manager.cc:194] Registered new tserver with Master: b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:57.848670 12636 raft_consensus.cc:2804] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:57.833465 11931 ts_tablet_manager.cc:1929] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:57.849133 11931 log.cc:1199] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/3c5021ab79dc4eaf9ed612f7125a6dca
I20260925 01:49:57.850011 12606 consensus_queue.cc:237] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.850569 11425 heartbeater.cc:461] Registering TS with master...
W20260925 01:49:57.854269 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 103215us
I20260925 01:49:57.856034 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:57.856683 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 185) took 6993 ms. Trace:
I20260925 01:49:57.858180 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eb63fecb5c421e8ecc746762663c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.860018 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 98eb63fecb5c421e8ecc746762663c06 (DEFAULT_TABLE table=default.Table_a44ffb8d5f914021ab1145c6010efd54 [id=757b5fa02a3044688750c11f5082e988]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:57.867255 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 774d14d5c7884f4e96662779b3100056 consensus state has no leader
I20260925 01:49:57.867451 11931 ts_tablet_manager.cc:1950] T 3c5021ab79dc4eaf9ed612f7125a6dca P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:57.868395 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 408) took 1162 ms. Trace:
I20260925 01:49:57.868498 11931 rpcz_store.cc:276] 0925 01:49:56.706036 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.706867 (+ 831us) service_pool.cc:224] Handling call
0925 01:49:57.742885 (+1036018us) ts_tablet_manager.cc:1151] Deleting tablet 3c5021ab79dc4eaf9ed612f7125a6dca
0925 01:49:57.742896 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.801767 (+ 58871us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.833386 (+ 31619us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.868371 (+ 34985us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1022313}
I20260925 01:49:57.869279 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_17cf387aca9e4b949195e91a5101157e [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]) successfully deleted
I20260925 01:49:57.871644 12636 raft_consensus.cc:493] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:57.872890 11755 tablet_bootstrap.cc:654] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:57.872974 11753 tablet_bootstrap.cc:492] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:57.873569 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet ca17585cd523440ca1e9b754f3aedf8a with delete_type TABLET_DATA_DELETED (replaced by tablet 01d50e428bfc46caa130f96ccc7e8f40) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.874593 11569 heartbeater.cc:461] Registering TS with master...
I20260925 01:49:57.875134 11931 tablet_replica.cc:333] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:57.875375 11931 raft_consensus.cc:2243] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:57.875588 11931 raft_consensus.cc:2272] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.878609 11946 rpcz_store.cc:276] 0925 01:49:50.847509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.847583 (+ 74us) service_pool.cc:224] Handling call
0925 01:49:57.838339 (+6990756us) ts_tablet_manager.cc:1151] Deleting tablet 01d50e428bfc46caa130f96ccc7e8f40
0925 01:49:57.838348 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.840614 (+ 2266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6989068}
I20260925 01:49:57.880577 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86079f22abb74d438c61ecc2a7379cbd" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:57.880565 12516 consensus_queue.cc:237] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:57.881290 12636 raft_consensus.cc:3060] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:57.883886 11314 leader_election.cc:343] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b05053f5646f4748a99647b7dbfae686
I20260925 01:49:57.884087 11314 leader_election.cc:304] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:57.884430 12487 raft_consensus.cc:2749] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:49:57.885304 11314 leader_election.cc:343] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:49:57.885617 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 01d50e428bfc46caa130f96ccc7e8f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d50e428bfc46caa130f96ccc7e8f40 already in progress: creating tablet
W20260925 01:49:57.886104 11314 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.886519 12585 consensus_queue.cc:1048] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260925 01:49:57.889024 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ca11a48fdf91477da5a1262664f1bb58" } modify_external_catalogs: true
I20260925 01:49:57.889274 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ca11a48fdf91477da5a1262664f1bb58" } modify_external_catalogs: true
I20260925 01:49:57.891033 11753 ts_tablet_manager.cc:1403] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.255s user 0.014s sys 0.009s
I20260925 01:49:57.891263 11931 ts_tablet_manager.cc:1916] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.896392 12619 raft_consensus.cc:493] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.896529 12619 raft_consensus.cc:515] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.897233 12619 leader_election.cc:290] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:57.898607 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b9df8d98e5414186ef23b8b7f9cb61" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:57.899268 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 186) took 7043 ms. Trace:
W20260925 01:49:57.899806 11177 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.905871 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b9df8d98e5414186ef23b8b7f9cb61" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:49:57.906502 11176 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.906579 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 6a81ba9001f047648d92f13a729408ed (DEFAULT_TABLE table=default.Table_999ce0c90de544958ffaff0670501f96 [id=9cdb3f901a0e4002b9d95d4d8dc7a6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.906635 11176 leader_election.cc:304] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:57.907183 12619 raft_consensus.cc:2749] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:57.886361 11314 leader_election.cc:304] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:57.913363 12585 raft_consensus.cc:493] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.914745 12585 raft_consensus.cc:515] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:57.915447 12585 leader_election.cc:290] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:57.916729 12585 raft_consensus.cc:2749] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:57.916838 11753 raft_consensus.cc:359] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.918975 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a81ba9001f047648d92f13a729408ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.904333 11946 rpcz_store.cc:276] 0925 01:49:50.848189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.848264 (+ 75us) service_pool.cc:224] Handling call
0925 01:49:57.885008 (+7036744us) ts_tablet_manager.cc:1151] Deleting tablet 15376374d9f2401fb9bb83d2f0acf7b3
0925 01:49:57.887100 (+ 2092us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.891816 (+ 4716us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6973985}
I20260925 01:49:57.919844 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet f0157a45817246cfaa0b016afdbd59cb (table default.Table_0d0d9ed21e9a4d94a35dffea244c87a8 [id=c3bda2bcc66f4f4ea55f4a7066905c87]). Expected version 4 got 0
I20260925 01:49:57.921384 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a4b81d45884b4b448624e0ce194da08b" } modify_external_catalogs: true
I20260925 01:49:57.921602 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a4b81d45884b4b448624e0ce194da08b" } modify_external_catalogs: true
W20260925 01:49:57.923501 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 15376374d9f2401fb9bb83d2f0acf7b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15376374d9f2401fb9bb83d2f0acf7b3 already in progress: creating tablet
I20260925 01:49:57.925100 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 5d55dc17217347138e912b48381f01c7 (DEFAULT_TABLE table=default.Table_528651c000214450855f6b0e0a816d7a [id=1d67698724ae431ab35ce6524db9afce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.925602 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d55dc17217347138e912b48381f01c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:57.926247 11314 leader_election.cc:343] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:57.931625 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 187) took 7047 ms. Trace:
I20260925 01:49:57.932034 11931 ts_tablet_manager.cc:1929] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:57.932161 11931 log.cc:1199] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c4eb584e929c46f891d28ad01e6d78ae
I20260925 01:49:57.932562 11931 ts_tablet_manager.cc:1950] T c4eb584e929c46f891d28ad01e6d78ae P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:57.933166 11753 raft_consensus.cc:385] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:57.933461 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 410) took 1204 ms. Trace:
I20260925 01:49:57.933566 11931 rpcz_store.cc:276] 0925 01:49:56.729239 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.736932 (+ 7693us) service_pool.cc:224] Handling call
0925 01:49:57.875081 (+1138149us) ts_tablet_manager.cc:1151] Deleting tablet c4eb584e929c46f891d28ad01e6d78ae
0925 01:49:57.875092 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.928314 (+ 53222us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.931968 (+ 3654us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:57.933437 (+ 1469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1137195}
I20260925 01:49:57.934473 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]) successfully deleted
I20260925 01:49:57.939831 11753 raft_consensus.cc:740] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:57.942922 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 5d55dc17217347138e912b48381f01c7 (DEFAULT_TABLE table=default.Table_528651c000214450855f6b0e0a816d7a [id=1d67698724ae431ab35ce6524db9afce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.946532 12649 tablet.cc:1751] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:49:57.948207 12636 raft_consensus.cc:515] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:57.950961 11456 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:49:57.956709 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e6ae26fb382848328c1929063046a7b7" } modify_external_catalogs: true
I20260925 01:49:57.956980 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e6ae26fb382848328c1929063046a7b7" } modify_external_catalogs: true
I20260925 01:49:57.960573 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 6a81ba9001f047648d92f13a729408ed (DEFAULT_TABLE table=default.Table_999ce0c90de544958ffaff0670501f96 [id=9cdb3f901a0e4002b9d95d4d8dc7a6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.962189 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 7eee30b35eb94fa196e9ccd1de37175a (DEFAULT_TABLE table=default.Table_4089f8c8017247ab96430424fa118dd5 [id=d230d433cce54a6d8984d2c7a752c6b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.962728 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eee30b35eb94fa196e9ccd1de37175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.970978 12627 tablet.cc:1746] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Skipping requested alter to schema version 2, tablet already version 2
I20260925 01:49:57.971906 12510 raft_consensus.cc:493] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:57.972134 12510 raft_consensus.cc:515] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:57.972946 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 5d55dc17217347138e912b48381f01c7 (DEFAULT_TABLE table=default.Table_528651c000214450855f6b0e0a816d7a [id=1d67698724ae431ab35ce6524db9afce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.973345 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d55dc17217347138e912b48381f01c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.973996 12636 leader_election.cc:290] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:57.971868 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 7eee30b35eb94fa196e9ccd1de37175a (DEFAULT_TABLE table=default.Table_4089f8c8017247ab96430424fa118dd5 [id=d230d433cce54a6d8984d2c7a752c6b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:57.974507 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eee30b35eb94fa196e9ccd1de37175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.976330 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 409) took 1205 ms. Trace:
I20260925 01:49:57.976526 11931 rpcz_store.cc:276] 0925 01:49:56.729089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.739488 (+ 10399us) service_pool.cc:224] Handling call
0925 01:49:57.933905 (+1194417us) ts_tablet_manager.cc:1151] Deleting tablet a86ac7e553854304ba7b3b1d38c86c53
0925 01:49:57.933931 (+ 26us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.934039 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1193815}
W20260925 01:49:57.977247 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a86ac7e553854304ba7b3b1d38c86c53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a86ac7e553854304ba7b3b1d38c86c53 already in progress: creating tablet
I20260925 01:49:57.971694 11946 rpcz_store.cc:276] 0925 01:49:50.875269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.875513 (+ 244us) service_pool.cc:224] Handling call
0925 01:49:57.919429 (+7043916us) ts_tablet_manager.cc:1151] Deleting tablet 06fca09010f841c5a7b58678560065f3
0925 01:49:57.919440 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.922635 (+ 3195us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6965837}
I20260925 01:49:57.978718 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 188) took 6790 ms. Trace:
I20260925 01:49:57.978626 11931 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 411) took 1197 ms. Trace:
W20260925 01:49:57.978848 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 06fca09010f841c5a7b58678560065f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06fca09010f841c5a7b58678560065f3 already in progress: creating tablet
I20260925 01:49:57.978858 11946 rpcz_store.cc:276] 0925 01:49:51.188622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.188920 (+ 298us) service_pool.cc:224] Handling call
0925 01:49:57.978580 (+6789660us) ts_tablet_manager.cc:1151] Deleting tablet 45a794ad0d87475a88efc02f5ae080f4
0925 01:49:57.978589 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.978685 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6789422}
I20260925 01:49:57.979280 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 189) took 6789 ms. Trace:
W20260925 01:49:57.979405 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 45a794ad0d87475a88efc02f5ae080f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a794ad0d87475a88efc02f5ae080f4 already in progress: creating tablet
I20260925 01:49:57.979403 11946 rpcz_store.cc:276] 0925 01:49:51.189563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.190699 (+ 1136us) service_pool.cc:224] Handling call
0925 01:49:57.979118 (+6788419us) ts_tablet_manager.cc:1151] Deleting tablet 95ac080782664fca8661c188ab822e89
0925 01:49:57.979129 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.979251 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6788073}
I20260925 01:49:57.979722 11946 tablet_replica.cc:333] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:57.979954 11946 raft_consensus.cc:2243] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:57.980039 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 95ac080782664fca8661c188ab822e89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95ac080782664fca8661c188ab822e89 already in progress: creating tablet
I20260925 01:49:57.980195 11946 raft_consensus.cc:2272] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.979085 11931 rpcz_store.cc:276] 0925 01:49:56.780924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.792283 (+ 11359us) service_pool.cc:224] Handling call
0925 01:49:57.977982 (+1185699us) ts_tablet_manager.cc:1151] Deleting tablet b4e5d28d466741a0a085a4f9938fffd1
0925 01:49:57.978092 (+ 110us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.978507 (+ 415us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185349}
I20260925 01:49:57.980928 11946 ts_tablet_manager.cc:1916] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:57.981061 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b4e5d28d466741a0a085a4f9938fffd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4e5d28d466741a0a085a4f9938fffd1 already in progress: creating tablet
I20260925 01:49:57.981405 11931 tablet_replica.cc:333] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:57.982899 11931 raft_consensus.cc:2243] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:57.971797 11753 consensus_queue.cc:260] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.983829 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:57.984189 12425 consensus_queue.cc:237] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:57.984400 11753 ts_tablet_manager.cc:1434] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.093s user 0.001s sys 0.001s
I20260925 01:49:57.984495 11931 raft_consensus.cc:2272] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:57.984777 11753 tablet_bootstrap.cc:492] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:57.985363 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 122) took 8979 ms. Trace:
I20260925 01:49:57.985502 11953 rpcz_store.cc:276] 0925 01:49:48.764415 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:48.764464 (+ 49us) service_pool.cc:224] Handling call
0925 01:49:57.704219 (+8939755us) ts_tablet_manager.cc:1151] Deleting tablet a65faada47c34cd1908970460d3d3f6b
0925 01:49:57.704229 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:57.744150 (+ 39921us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8939520}
I20260925 01:49:57.985913 11953 tablet_replica.cc:333] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:57.986011 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.987296 11753 tablet_bootstrap.cc:654] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:57.990542 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a65faada47c34cd1908970460d3d3f6b because the tablet was not found. No further retry: Not found: Tablet not found: a65faada47c34cd1908970460d3d3f6b
I20260925 01:49:57.994040 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b1db4b0f469d42dab727679dc96ceef7" } modify_external_catalogs: true
I20260925 01:49:57.994328 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b1db4b0f469d42dab727679dc96ceef7" } modify_external_catalogs: true
I20260925 01:49:57.995223 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af9f89eff914aceb05ff00847099693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:57.995499 11931 ts_tablet_manager.cc:1916] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:57.996498 12649 tablet.cc:1751] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:49:57.999068 12510 leader_election.cc:290] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:58.000162 11456 leader_election.cc:343] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: bb98d5a38f43450c80d057d9eb2f92d1
I20260925 01:49:58.008211 11222 tablet_service.cc:1511] Processing CreateTablet for tablet c3e2709b3b0f4157938d8d8bca8a7b10 (DEFAULT_TABLE table=default.Table_b07f6029133f4c1598ae22b43dc3a7cb [id=54334f8450ac49d4815b08ddd24361a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.008687 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e2709b3b0f4157938d8d8bca8a7b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.018977 11489 tablet_service.cc:1511] Processing CreateTablet for tablet c3e2709b3b0f4157938d8d8bca8a7b10 (DEFAULT_TABLE table=default.Table_b07f6029133f4c1598ae22b43dc3a7cb [id=54334f8450ac49d4815b08ddd24361a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.019769 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e2709b3b0f4157938d8d8bca8a7b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.026679 11677 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f] alter complete (version 2)
I20260925 01:49:58.027901 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0e29902f6a844cb5b9bc1d8e99da120e" } modify_external_catalogs: true
I20260925 01:49:58.028265 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0e29902f6a844cb5b9bc1d8e99da120e" } modify_external_catalogs: true
I20260925 01:49:58.032807 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d4f2056b19b145b39c9d355ada53671f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.033640 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4f2056b19b145b39c9d355ada53671f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.034089 11931 ts_tablet_manager.cc:1929] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:58.034224 11931 log.cc:1199] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/644b28192e3b45e7b5370d55804cb043
I20260925 01:49:58.034547 11931 ts_tablet_manager.cc:1950] T 644b28192e3b45e7b5370d55804cb043 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:58.038051 11946 ts_tablet_manager.cc:1929] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:58.046417 11946 log.cc:1199] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8b16a38a30ff44fb8d7eb01498f9b9c7
I20260925 01:49:58.046598 11753 tablet_bootstrap.cc:492] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:58.048306 11753 ts_tablet_manager.cc:1403] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.001s
I20260925 01:49:58.049942 11753 raft_consensus.cc:359] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.050264 11753 raft_consensus.cc:385] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.050442 11753 raft_consensus.cc:740] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.050773 11753 consensus_queue.cc:260] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.051525 11753 ts_tablet_manager.cc:1434] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:49:58.051894 11753 tablet_bootstrap.cc:492] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:58.054607 11946 ts_tablet_manager.cc:1950] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:58.056216 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 644b28192e3b45e7b5370d55804cb043 (table default.Table_58fdde0b3e6a47b79d42646ec2ed37ef [id=70a49de4b7e04789bb0a1afaf2df1900]) successfully deleted
W20260925 01:49:58.057719 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b306496f992f45a9b64b05b73712cb5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b306496f992f45a9b64b05b73712cb5b already in progress: creating tablet
W20260925 01:49:58.058161 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9e112a4ce48f40a196f655379c758c9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e112a4ce48f40a196f655379c758c9c already in progress: creating tablet
I20260925 01:49:58.062642 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 190) took 6869 ms. Trace:
W20260925 01:49:58.062737 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 3e3a033c9e7545479130c7a3c48ac254 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e3a033c9e7545479130c7a3c48ac254 already in progress: creating tablet
I20260925 01:49:58.063053 11753 tablet_bootstrap.cc:654] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.063972 11946 rpcz_store.cc:276] 0925 01:49:51.191219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.191903 (+ 684us) service_pool.cc:224] Handling call
0925 01:49:57.979639 (+6787736us) ts_tablet_manager.cc:1151] Deleting tablet 8b16a38a30ff44fb8d7eb01498f9b9c7
0925 01:49:57.979647 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.011974 (+ 32327us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.037978 (+ 26004us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.061013 (+ 23035us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6787399}
I20260925 01:49:58.066159 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 191) took 6873 ms. Trace:
I20260925 01:49:58.066310 11946 rpcz_store.cc:276] 0925 01:49:51.192482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.203624 (+ 11142us) service_pool.cc:224] Handling call
0925 01:49:58.064832 (+6861208us) ts_tablet_manager.cc:1151] Deleting tablet a07f37b8469a497ba3fe504cb21105d2
0925 01:49:58.064842 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.065954 (+ 1112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6860908}
W20260925 01:49:58.067034 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a07f37b8469a497ba3fe504cb21105d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a07f37b8469a497ba3fe504cb21105d2 already in progress: creating tablet
I20260925 01:49:58.068518 11931 tablet_replica.cc:333] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:58.068753 11931 raft_consensus.cc:2243] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:58.068912 11931 raft_consensus.cc:2272] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:58.069343 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 4930edeb2edd4e7494dbf1761b5d20c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4930edeb2edd4e7494dbf1761b5d20c0 already in progress: creating tablet
I20260925 01:49:58.067863 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 197) took 6830 ms. Trace:
I20260925 01:49:58.070109 11946 rpcz_store.cc:276] 0925 01:49:51.236672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.236724 (+ 52us) service_pool.cc:224] Handling call
0925 01:49:58.067362 (+6830638us) ts_tablet_manager.cc:1151] Deleting tablet ae948bf42ae34a7ab72112d5f1f02585
0925 01:49:58.067383 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.067531 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6830259}
W20260925 01:49:58.072147 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ae948bf42ae34a7ab72112d5f1f02585 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae948bf42ae34a7ab72112d5f1f02585 already in progress: creating tablet
I20260925 01:49:58.072769 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 211) took 6565 ms. Trace:
I20260925 01:49:58.073709 11946 rpcz_store.cc:276] 0925 01:49:51.507018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.508559 (+ 1541us) service_pool.cc:224] Handling call
0925 01:49:58.072527 (+6563968us) ts_tablet_manager.cc:1151] Deleting tablet 927bc1194884470e9fc977ca870f1b0c
0925 01:49:58.072536 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.072658 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6554491}
I20260925 01:49:58.076560 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 2487a41e682740cb83a4281aeef0368a (DEFAULT_TABLE table=default.Table_6fd1a490f7b14d32891655ef19ec0616 [id=444fd89a1cb64649994db88b39dc002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.077201 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2487a41e682740cb83a4281aeef0368a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.077793 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 927bc1194884470e9fc977ca870f1b0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 927bc1194884470e9fc977ca870f1b0c already in progress: creating tablet
I20260925 01:49:58.078547 11946 tablet_replica.cc:333] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:58.079612 11946 raft_consensus.cc:2243] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:58.081614 11931 ts_tablet_manager.cc:1916] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:58.082000 11946 raft_consensus.cc:2272] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:58.083173 11946 ts_tablet_manager.cc:1916] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:58.093130 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48bd9071170d4f6f9ac4039020de5c00 consensus state has no leader
I20260925 01:49:58.105444 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 2487a41e682740cb83a4281aeef0368a (DEFAULT_TABLE table=default.Table_6fd1a490f7b14d32891655ef19ec0616 [id=444fd89a1cb64649994db88b39dc002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.106119 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2487a41e682740cb83a4281aeef0368a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.111419 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_c361990e57274e58b9e99c7086a27792 [id=8dcfe1cef923411faea69f4f694a51e6]). Expected version 3 got 0
I20260925 01:49:58.115834 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a69c32a8461b431d9573c99f2cbf16e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.116684 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a69c32a8461b431d9573c99f2cbf16e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.123063 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9 (DEFAULT_TABLE table=default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.123548 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.126662 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9 (DEFAULT_TABLE table=default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.127103 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.130753 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e457c4ab4e814fc4be11ced6ca69284f consensus state has no leader
I20260925 01:49:58.132050 11931 ts_tablet_manager.cc:1929] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:58.132179 11931 log.cc:1199] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:49:58.132517 11931 ts_tablet_manager.cc:1950] T e2b9df8d98e5414186ef23b8b7f9cb61 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:58.133888 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet e2b9df8d98e5414186ef23b8b7f9cb61 (table default.Table_a33362d5d6de41e985d86740d8af966c [id=351fd2bbafea4565a9cc4537f7f0c1aa]) successfully deleted
W20260925 01:49:58.134725 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 49b110516abb45d1880d0e0e33e20174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49b110516abb45d1880d0e0e33e20174 already in progress: creating tablet
W20260925 01:49:58.135116 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5e6715233be44b9aad5210d17500f59d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e6715233be44b9aad5210d17500f59d already in progress: creating tablet
I20260925 01:49:58.143318 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_64f66e588ec44c4a8f677885695767e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.144078 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64f66e588ec44c4a8f677885695767e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.163259 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e119f5d392bc4cae8bf871b63c0f9f40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.164078 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e119f5d392bc4cae8bf871b63c0f9f40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.166435 12623 tablet.cc:1751] T 5ef1b5f18d074016a6dea82da8e2d2b2 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260925 01:49:58.167342 12627 tablet.cc:1751] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
W20260925 01:49:58.170045 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8909181e04be451aa8aeb219c9da8b89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8909181e04be451aa8aeb219c9da8b89 already in progress: creating tablet
W20260925 01:49:58.170594 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet fce91b00d3a14e6398abacad61ff5b0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fce91b00d3a14e6398abacad61ff5b0f already in progress: creating tablet
W20260925 01:49:58.170817 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 811b957c4e6647ccaa688d7273ec9eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 811b957c4e6647ccaa688d7273ec9eeb already in progress: creating tablet
I20260925 01:49:58.175462 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91f3714b2dec48ee9e082c3a9e7d9e7b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.177709 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 76452.5us
W20260925 01:49:58.178079 11314 consensus_peers.cc:597] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:58.179255 12517 raft_consensus.cc:493] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:58.179414 12517 raft_consensus.cc:515] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.179677 11457 leader_election.cc:304] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.179750 11237 raft_consensus.cc:2468] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:58.180197 12517 leader_election.cc:290] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.180307 12510 raft_consensus.cc:2749] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:58.181592 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 09a79f0bd7374dabb2edc5ddf5fc8e41
I20260925 01:49:58.181653 11754 ts_tablet_manager.cc:1434] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.722s user 0.024s sys 0.000s
W20260925 01:49:58.181744 11754 ts_tablet_manager.cc:1467] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Tablet startup took 722ms
W20260925 01:49:58.181815 11754 ts_tablet_manager.cc:1469] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Trace:
0925 01:49:46.812267 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:46.812329 (+ 62us) service_pool.cc:224] Handling call
0925 01:49:46.812954 (+ 625us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:46.812984 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:46.817297 (+ 4313us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:47.117786 (+300489us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:47.117968 (+ 182us) inbound_call.cc:177] Queueing success response
0925 01:49:57.211680 (+10093712us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0925 01:49:57.459241 (+247561us) ts_tablet_manager.cc:1435] Starting tablet replica
0925 01:49:57.459640 (+ 399us) tablet_replica.cc:261] Starting instrumentation
0925 01:49:57.459792 (+ 152us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":44,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":52,"tablet-open.queue_time_us":10093195}
I20260925 01:49:58.182425 11754 tablet_bootstrap.cc:492] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:58.184000 11754 tablet_bootstrap.cc:654] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.184588 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af6f0e35e7184b16bd53dba85941b192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.177737 11347 tablet_service.cc:1511] Processing CreateTablet for tablet c3e2709b3b0f4157938d8d8bca8a7b10 (DEFAULT_TABLE table=default.Table_b07f6029133f4c1598ae22b43dc3a7cb [id=54334f8450ac49d4815b08ddd24361a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.185994 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e2709b3b0f4157938d8d8bca8a7b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.186105 12623 tablet.cc:1751] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:49:58.188131 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a6ec9b9b5d4f60a7e5f3edf0687b56" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:58.193427 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9 (DEFAULT_TABLE table=default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:58.194998 11176 leader_election.cc:343] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:58.195683 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa2e2d4bfe14b5db5b1dfd67e19f11c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:58.195992 12627 tablet.cc:1751] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:49:58.197985 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 7eee30b35eb94fa196e9ccd1de37175a (DEFAULT_TABLE table=default.Table_4089f8c8017247ab96430424fa118dd5 [id=d230d433cce54a6d8984d2c7a752c6b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.203343 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.204068 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.205157 11753 tablet_bootstrap.cc:492] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:49:58.205308 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 already in progress: creating tablet
I20260925 01:49:58.206027 11753 ts_tablet_manager.cc:1403] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.154s user 0.004s sys 0.011s
I20260925 01:49:58.209098 11753 raft_consensus.cc:359] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.210457 11753 raft_consensus.cc:385] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.211004 11753 raft_consensus.cc:740] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.213547 12508 raft_consensus.cc:493] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aac4ec033f794d7a90b52aa4e0b6155d)
I20260925 01:49:58.213714 12508 raft_consensus.cc:515] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.214736 12508 leader_election.cc:290] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.215488 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:58.215729 11380 raft_consensus.cc:3060] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:58.217655 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e0eda87385444fd39c1cb29576fc9884" } new_table_name: "default.Table_6f80c3a17c384f9391cd5164d3c8b03a" modify_external_catalogs: true
I20260925 01:49:58.218147 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:58.218207 12638 tablet.cc:1751] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:49:58.218394 11376 raft_consensus.cc:2468] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
W20260925 01:49:58.218616 11314 leader_election.cc:343] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 8dd27c6d835948ba859b4c11d8ebf783
W20260925 01:49:58.218771 12607 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.540s user 0.000s sys 0.013s
W20260925 01:49:58.218957 12607 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.572s user 0.000s sys 0.013s
I20260925 01:49:58.220068 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:58.220256 12338 ts_manager.cc:194] Registered new tserver with Master: 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:58.224906 11753 consensus_queue.cc:260] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.207906 11946 ts_tablet_manager.cc:1929] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:58.225245 11946 log.cc:1199] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8bf42293dd5d452aa7ed9e0eaa78f54d
I20260925 01:49:58.225756 11946 ts_tablet_manager.cc:1950] T 8bf42293dd5d452aa7ed9e0eaa78f54d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:58.226154 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e2ba874cb6a34ccd9e59cc9146280c17
I20260925 01:49:58.226658 11753 ts_tablet_manager.cc:1434] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260925 01:49:58.226965 11753 tablet_bootstrap.cc:492] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:58.228778 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 212) took 6718 ms. Trace:
I20260925 01:49:58.228927 11946 rpcz_store.cc:276] 0925 01:49:51.509867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.509934 (+ 67us) service_pool.cc:224] Handling call
0925 01:49:58.078336 (+6568402us) ts_tablet_manager.cc:1151] Deleting tablet 8bf42293dd5d452aa7ed9e0eaa78f54d
0925 01:49:58.078347 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.097354 (+ 19007us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.207802 (+110448us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.228742 (+ 20940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2118,"tablet-delete.queue_time_us":6555951}
I20260925 01:49:58.229477 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]) successfully deleted
I20260925 01:49:58.229779 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet e2ba874cb6a34ccd9e59cc9146280c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.230140 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet e2ba874cb6a34ccd9e59cc9146280c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.232070 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 213) took 6713 ms. Trace:
I20260925 01:49:58.232086 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db20c20da0ec4785a2a3a18aba109b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.232203 11946 rpcz_store.cc:276] 0925 01:49:51.518992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.519041 (+ 49us) service_pool.cc:224] Handling call
0925 01:49:58.231860 (+6712819us) ts_tablet_manager.cc:1151] Deleting tablet f2618c46630c4295949b36f3d0087941
0925 01:49:58.231876 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.232033 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6680048}
I20260925 01:49:58.232600 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet f0157a45817246cfaa0b016afdbd59cb (table default.Table_0d0d9ed21e9a4d94a35dffea244c87a8 [id=c3bda2bcc66f4f4ea55f4a7066905c87]). Expected version 4 got 0
W20260925 01:49:58.232808 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f2618c46630c4295949b36f3d0087941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2618c46630c4295949b36f3d0087941 already in progress: creating tablet
I20260925 01:49:58.233747 11753 tablet_bootstrap.cc:654] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:58.234244 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e2ba874cb6a34ccd9e59cc9146280c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ba874cb6a34ccd9e59cc9146280c17 already in progress: creating tablet
I20260925 01:49:58.234862 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 214) took 6682 ms. Trace:
I20260925 01:49:58.234980 11946 rpcz_store.cc:276] 0925 01:49:51.551937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.566386 (+ 14449us) service_pool.cc:224] Handling call
0925 01:49:58.234720 (+6668334us) ts_tablet_manager.cc:1151] Deleting tablet d7f97ead49634bf6b03e292544af4d07
0925 01:49:58.234729 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.234830 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6664137}
W20260925 01:49:58.235450 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d7f97ead49634bf6b03e292544af4d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7f97ead49634bf6b03e292544af4d07 already in progress: creating tablet
I20260925 01:49:58.236063 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5327ae9a53fe4dc0b6b5b3dace30d9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.236202 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 218) took 6487 ms. Trace:
I20260925 01:49:58.236367 11946 rpcz_store.cc:276] 0925 01:49:51.748748 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.748806 (+ 58us) service_pool.cc:224] Handling call
0925 01:49:58.236071 (+6487265us) ts_tablet_manager.cc:1151] Deleting tablet 96b68399843a422b8da3ddfab2c522e6
0925 01:49:58.236080 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.236170 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6487008}
I20260925 01:49:58.236514 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eee30b35eb94fa196e9ccd1de37175a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.236894 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 96b68399843a422b8da3ddfab2c522e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b68399843a422b8da3ddfab2c522e6 already in progress: creating tablet
I20260925 01:49:58.237319 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 217) took 6491 ms. Trace:
I20260925 01:49:58.237506 11946 rpcz_store.cc:276] 0925 01:49:51.745870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.745927 (+ 57us) service_pool.cc:224] Handling call
0925 01:49:58.237183 (+6491256us) ts_tablet_manager.cc:1151] Deleting tablet 31353cc95e014e5bb24e5e5cefab1503
0925 01:49:58.237191 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.237284 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6487819}
W20260925 01:49:58.238027 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 31353cc95e014e5bb24e5e5cefab1503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31353cc95e014e5bb24e5e5cefab1503 already in progress: creating tablet
I20260925 01:49:58.238481 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 219) took 6489 ms. Trace:
I20260925 01:49:58.238631 11946 rpcz_store.cc:276] 0925 01:49:51.749369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.749416 (+ 47us) service_pool.cc:224] Handling call
0925 01:49:58.238319 (+6488903us) ts_tablet_manager.cc:1151] Deleting tablet 98ffeb9d70374afdb72a728d7b211d33
0925 01:49:58.238328 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.238447 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6488506}
I20260925 01:49:58.239353 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 220) took 6488 ms. Trace:
I20260925 01:49:58.239521 11946 rpcz_store.cc:276] 0925 01:49:51.750771 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.750821 (+ 50us) service_pool.cc:224] Handling call
0925 01:49:58.239232 (+6488411us) ts_tablet_manager.cc:1151] Deleting tablet 8c1abd3c2cb34915a595ea73a8d10743
0925 01:49:58.239240 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.239323 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6488180}
W20260925 01:49:58.239974 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8c1abd3c2cb34915a595ea73a8d10743 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c1abd3c2cb34915a595ea73a8d10743 already in progress: creating tablet
I20260925 01:49:58.240365 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 221) took 6487 ms. Trace:
I20260925 01:49:58.240533 11946 rpcz_store.cc:276] 0925 01:49:51.752558 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.752618 (+ 60us) service_pool.cc:224] Handling call
0925 01:49:58.240247 (+6487629us) ts_tablet_manager.cc:1151] Deleting tablet 86c8c3bba9614539bfe3018461ad21f8
0925 01:49:58.240255 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.240333 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6487272}
W20260925 01:49:58.241190 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 86c8c3bba9614539bfe3018461ad21f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86c8c3bba9614539bfe3018461ad21f8 already in progress: creating tablet
I20260925 01:49:58.241714 11946 tablet_replica.cc:333] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:58.242027 11946 raft_consensus.cc:2243] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:58.242458 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45925c3a3dca4f0c88c0a5c52f2b4d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.242609 11946 raft_consensus.cc:2272] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:58.243364 11946 ts_tablet_manager.cc:1916] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:58.243698 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 6a773feeb51349a084efedfd338eafe0
I20260925 01:49:58.244714 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a773feeb51349a084efedfd338eafe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:58.245591 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c8944feb988d4509b8601689ac02b11b
I20260925 01:49:58.247187 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet c8944feb988d4509b8601689ac02b11b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:58.247469 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a773feeb51349a084efedfd338eafe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.248345 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98eb63fecb5c421e8ecc746762663c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.248477 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9663d7f4008e4ee0a3ba4373258242eb
I20260925 01:49:58.249801 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:58.251722 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet c8944feb988d4509b8601689ac02b11b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.251938 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet c8944feb988d4509b8601689ac02b11b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.251981 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.252250 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.253118 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_13b4489711b34220a1a3deb6528e80c0" } new_table_name: "default.Table_51ebd0c312174327b9602cc9358ab16c" modify_external_catalogs: true
I20260925 01:49:58.253276 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_139172e2d0ec420c8c2484e90f7a160b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.254148 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_139172e2d0ec420c8c2484e90f7a160b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.255438 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d8cc810ec8854fec9b0d3ddb25985f8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.256052 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8cc810ec8854fec9b0d3ddb25985f8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:58.260566 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 6a773feeb51349a084efedfd338eafe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a773feeb51349a084efedfd338eafe0 already in progress: creating tablet
W20260925 01:49:58.261370 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c8944feb988d4509b8601689ac02b11b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8944feb988d4509b8601689ac02b11b already in progress: creating tablet
W20260925 01:49:58.262161 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9663d7f4008e4ee0a3ba4373258242eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9663d7f4008e4ee0a3ba4373258242eb already in progress: creating tablet
W20260925 01:49:58.254073 11372 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.579s user 0.006s sys 0.009s
I20260925 01:49:58.277024 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a7d1848c346a4268ace995c919f1be64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.277885 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7d1848c346a4268ace995c919f1be64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:58.279577 11314 consensus_peers.cc:597] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b16a38a30ff44fb8d7eb01498f9b9c7. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:58.283576 11372 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.645s user 0.006s sys 0.009s
I20260925 01:49:58.285501 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet e2ba874cb6a34ccd9e59cc9146280c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:58.286012 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a6ec9b9b5d4f60a7e5f3edf0687b56" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:58.287084 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a773feeb51349a084efedfd338eafe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.288017 12516 raft_consensus.cc:493] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:58.288344 12516 raft_consensus.cc:515] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.289129 12516 leader_election.cc:290] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.289569 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:58.289812 11237 raft_consensus.cc:2393] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:49:58.289825 11379 raft_consensus.cc:2468] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:49:58.289885 11380 raft_consensus.cc:2468] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:58.298381 11946 ts_tablet_manager.cc:1929] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:58.299067 11946 log.cc:1199] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/99913eb35197442880a27b3c288237f4
I20260925 01:49:58.299760 11946 ts_tablet_manager.cc:1950] T 99913eb35197442880a27b3c288237f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:58.300340 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_0d0d9ed21e9a4d94a35dffea244c87a8 [id=c3bda2bcc66f4f4ea55f4a7066905c87] alter complete (version 4)
I20260925 01:49:58.300868 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 226) took 6453 ms. Trace:
I20260925 01:49:58.301039 11946 rpcz_store.cc:276] 0925 01:49:51.847588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.847790 (+ 202us) service_pool.cc:224] Handling call
0925 01:49:58.241651 (+6393861us) ts_tablet_manager.cc:1151] Deleting tablet 99913eb35197442880a27b3c288237f4
0925 01:49:58.241660 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.248045 (+ 6385us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.298292 (+ 50247us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.300793 (+ 2501us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6321483}
I20260925 01:49:58.303025 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 99913eb35197442880a27b3c288237f4 (table default.Table_bf94da756bf24c42b0debbb732b59861 [id=5a101d4224e546e686f9bf819b07c07b]) successfully deleted
I20260925 01:49:58.310810 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 234) took 6324 ms. Trace:
I20260925 01:49:58.311088 11946 rpcz_store.cc:276] 0925 01:49:51.980172 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.980508 (+ 336us) service_pool.cc:224] Handling call
0925 01:49:58.303976 (+6323468us) ts_tablet_manager.cc:1151] Deleting tablet 5d23c5d52faa4b6da2996fabb16bd74a
0925 01:49:58.303988 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.304150 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6267662}
W20260925 01:49:58.311882 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5d23c5d52faa4b6da2996fabb16bd74a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d23c5d52faa4b6da2996fabb16bd74a already in progress: creating tablet
I20260925 01:49:58.312383 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.313273 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 235) took 6328 ms. Trace:
I20260925 01:49:58.313468 11946 rpcz_store.cc:276] 0925 01:49:51.984418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.984490 (+ 72us) service_pool.cc:224] Handling call
0925 01:49:58.312738 (+6328248us) ts_tablet_manager.cc:1151] Deleting tablet 4f19bccf3c5540cb828ec7bfc89a1c17
0925 01:49:58.312754 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.312940 (+ 186us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6264803}
W20260925 01:49:58.314239 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f19bccf3c5540cb828ec7bfc89a1c17 already in progress: creating tablet
I20260925 01:49:58.315117 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bdec13308f734fc98b23b4015fdf0b7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.315899 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdec13308f734fc98b23b4015fdf0b7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.317632 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b1e57df563c64536a49824c81a2ab45c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:58.318264 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33e596a71be41839a8e463eec26ce2f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.318302 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1e57df563c64536a49824c81a2ab45c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.326261 11314 leader_election.cc:304] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:58.326743 12651 raft_consensus.cc:2804] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:58.326925 12651 raft_consensus.cc:493] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:58.327167 12651 raft_consensus.cc:3060] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:49:58.328114 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 46540.7us
W20260925 01:49:58.328673 11314 leader_election.cc:343] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8dd27c6d835948ba859b4c11d8ebf783
I20260925 01:49:58.329267 11314 leader_election.cc:304] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.329623 12606 raft_consensus.cc:2749] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:58.330148 12649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40776 (request call id 388) took 1280 ms. Trace:
I20260925 01:49:58.330259 12649 rpcz_store.cc:276] 0925 01:49:57.015909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.017569 (+ 1660us) service_pool.cc:224] Handling call
0925 01:49:58.296090 (+1278521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:57.049340 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:57.049464 (+ 124us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:57.049473 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:57.049482 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:57.049521 (+ 39us) alter_schema_op.cc:128] START. Timestamp: 1790300997049447
0925 01:49:57.049524 (+ 3us) op_driver.cc:348] REPLICATION: starting
0925 01:49:57.089776 (+ 40252us) log.cc:844] Serialized 173 byte log entry
0925 01:49:57.647223 (+557447us) op_driver.cc:464] REPLICATION: finished
0925 01:49:57.996450 (+349227us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:49:57.996887 (+ 437us) log.cc:844] Serialized 5 byte log entry
0925 01:49:58.293965 (+297078us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.295843 (+ 1878us) log.cc:844] Serialized 14 byte log entry
0925 01:49:58.296049 (+ 206us) alter_schema_op.cc:73] Released schema lock
0925 01:49:58.296054 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":349176,"prepare.queue_time_us":89,"prepare.run_cpu_time_us":15973,"prepare.run_wall_time_us":186182,"raft.queue_time_us":157,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":597661,"thread_start_us":714674,"threads_started":2,"wal-append.queue_time_us":91178}]]}
I20260925 01:49:58.333245 12487 raft_consensus.cc:493] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:58.333434 12487 raft_consensus.cc:515] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:58.334096 12487 leader_election.cc:290] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:58.335361 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba378e9d37c64a8ebd56894b2101ed8f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:58.336920 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0157a45817246cfaa0b016afdbd59cb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:58.337987 11314 leader_election.cc:343] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 86079f22abb74d438c61ecc2a7379cbd
I20260925 01:49:58.338621 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 2487a41e682740cb83a4281aeef0368a (DEFAULT_TABLE table=default.Table_6fd1a490f7b14d32891655ef19ec0616 [id=444fd89a1cb64649994db88b39dc002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.339109 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2487a41e682740cb83a4281aeef0368a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.346264 11457 leader_election.cc:304] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.346761 11457 leader_election.cc:304] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.347980 11457 leader_election.cc:304] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.348500 11457 leader_election.cc:304] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.349598 12640 raft_consensus.cc:3060] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:58.350095 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 237) took 6273 ms. Trace:
I20260925 01:49:58.351584 12510 raft_consensus.cc:2749] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:58.352298 12636 raft_consensus.cc:2804] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:58.353010 12508 raft_consensus.cc:2804] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:58.353165 12508 raft_consensus.cc:697] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:58.353444 12508 consensus_queue.cc:237] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:58.354363 12627 tablet.cc:1751] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:49:58.347834 12651 raft_consensus.cc:515] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.354979 12636 raft_consensus.cc:493] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:58.355109 12636 raft_consensus.cc:3060] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:58.355254 12651 leader_election.cc:290] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:58.349071 12638 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40776 (request call id 399) took 1171 ms. Trace:
I20260925 01:49:58.355430 12638 rpcz_store.cc:276] 0925 01:49:57.177811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.177873 (+ 62us) service_pool.cc:224] Handling call
0925 01:49:58.349029 (+1171156us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:57.178542 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:57.178631 (+ 89us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:57.178639 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:57.178646 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:57.178685 (+ 39us) alter_schema_op.cc:128] START. Timestamp: 1790300997178651
0925 01:49:57.178688 (+ 3us) op_driver.cc:348] REPLICATION: starting
0925 01:49:57.178898 (+ 210us) log.cc:844] Serialized 173 byte log entry
0925 01:49:57.928310 (+749412us) op_driver.cc:464] REPLICATION: finished
0925 01:49:58.199289 (+270979us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:49:58.341309 (+142020us) log.cc:844] Serialized 5 byte log entry
0925 01:49:58.346041 (+ 4732us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.348754 (+ 2713us) log.cc:844] Serialized 14 byte log entry
0925 01:49:58.348980 (+ 226us) alter_schema_op.cc:73] Released schema lock
0925 01:49:58.348985 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":262368,"prepare.queue_time_us":241,"prepare.run_cpu_time_us":494,"prepare.run_wall_time_us":494,"raft.queue_time_us":443,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":385,"replication_time_us":749195,"thread_start_us":36190,"threads_started":1}]]}
I20260925 01:49:58.349372 11755 tablet_bootstrap.cc:492] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:58.357079 11755 ts_tablet_manager.cc:1403] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.672s user 0.005s sys 0.016s
I20260925 01:49:58.358263 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a6ec9b9b5d4f60a7e5f3edf0687b56" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:58.358439 11237 raft_consensus.cc:3060] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:58.361223 11237 raft_consensus.cc:2468] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:58.364283 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2b6e338d18343eb80088ac994b6152d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.366760 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d55dc17217347138e912b48381f01c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.358023 12636 raft_consensus.cc:515] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:58.373073 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a6ec9b9b5d4f60a7e5f3edf0687b56" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:58.373368 11314 leader_election.cc:304] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:58.373891 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1339652d744cda9215d84e846d1e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.374244 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86079f22abb74d438c61ecc2a7379cbd" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:58.374456 11522 raft_consensus.cc:2468] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:58.376752 11953 raft_consensus.cc:2243] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:58.377318 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a81ba9001f047648d92f13a729408ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.378048 12640 raft_consensus.cc:2749] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:58.379544 12338 ts_manager.cc:194] Registered new tserver with Master: aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.380620 11953 pending_rounds.cc:70] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:58.380762 11953 pending_rounds.cc:77] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072871864864768 op_type: NO_OP noop_request { }
I20260925 01:49:58.380997 11953 raft_consensus.cc:2889] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:58.381163 11953 raft_consensus.cc:2272] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:58.382012 11953 ts_tablet_manager.cc:1916] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:58.382117 11456 leader_election.cc:343] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: bb98d5a38f43450c80d057d9eb2f92d1
I20260925 01:49:58.382628 12636 leader_election.cc:290] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:58.390226 12651 raft_consensus.cc:2804] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:58.390571 12651 raft_consensus.cc:697] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:58.391002 12651 consensus_queue.cc:237] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.391417 11753 tablet_bootstrap.cc:492] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:58.391695 11753 ts_tablet_manager.cc:1403] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.165s user 0.027s sys 0.043s
I20260925 01:49:58.392875 11753 raft_consensus.cc:359] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.393301 11753 raft_consensus.cc:385] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.393522 11753 raft_consensus.cc:740] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.393954 11753 consensus_queue.cc:260] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.394121 11946 rpcz_store.cc:276] 0925 01:49:52.046418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.046529 (+ 111us) service_pool.cc:224] Handling call
0925 01:49:58.319963 (+6273434us) ts_tablet_manager.cc:1151] Deleting tablet f1b6ea676a1f4d99807029d8401251ef
0925 01:49:58.319978 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.320160 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6262067}
I20260925 01:49:58.395038 11753 ts_tablet_manager.cc:1434] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:49:58.395064 11953 ts_tablet_manager.cc:1929] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:58.395220 11953 log.cc:1199] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/00906edfa6b648229bcba8e59d68b969
W20260925 01:49:58.395255 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f1b6ea676a1f4d99807029d8401251ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1b6ea676a1f4d99807029d8401251ef already in progress: creating tablet
I20260925 01:49:58.395798 11953 ts_tablet_manager.cc:1950] T 00906edfa6b648229bcba8e59d68b969 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:58.396234 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 146) took 8946 ms. Trace:
I20260925 01:49:58.396395 11953 rpcz_store.cc:276] 0925 01:49:49.449380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.449971 (+ 591us) service_pool.cc:224] Handling call
0925 01:49:57.985824 (+8535853us) ts_tablet_manager.cc:1151] Deleting tablet 00906edfa6b648229bcba8e59d68b969
0925 01:49:57.985836 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.386685 (+400849us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.389998 (+ 3313us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.396169 (+ 6171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":393898,"tablet-delete.queue_time_us":8534410}
I20260925 01:49:58.397094 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 00906edfa6b648229bcba8e59d68b969 (table default.Table_6ae7ffbe7b334c87a1be9c5c18761c65 [id=1c424cf98429473f9896b9c4028e11f6]) successfully deleted
I20260925 01:49:58.397771 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 147) took 8945 ms. Trace:
I20260925 01:49:58.396020 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 236) took 6356 ms. Trace:
I20260925 01:49:58.402369 11946 rpcz_store.cc:276] 0925 01:49:52.042490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.042766 (+ 276us) service_pool.cc:224] Handling call
0925 01:49:58.395816 (+6353050us) ts_tablet_manager.cc:1151] Deleting tablet 35b123ac1e894239875404438ed19927
0925 01:49:58.395829 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.395961 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6336859}
W20260925 01:49:58.403045 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 35b123ac1e894239875404438ed19927 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35b123ac1e894239875404438ed19927 already in progress: creating tablet
I20260925 01:49:58.398093 11753 tablet_bootstrap.cc:492] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:58.406733 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 239) took 6348 ms. Trace:
I20260925 01:49:58.406898 11946 rpcz_store.cc:276] 0925 01:49:52.058437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.058833 (+ 396us) service_pool.cc:224] Handling call
0925 01:49:58.406312 (+6347479us) ts_tablet_manager.cc:1151] Deleting tablet 1f1d2d998d834c21ab83694daae37520
0925 01:49:58.406328 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.406587 (+ 259us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6347193}
I20260925 01:49:58.415525 11753 tablet_bootstrap.cc:654] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.426868 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 238) took 6369 ms. Trace:
I20260925 01:49:58.433269 11946 rpcz_store.cc:276] 0925 01:49:52.057195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.057353 (+ 158us) service_pool.cc:224] Handling call
0925 01:49:58.426536 (+6369183us) ts_tablet_manager.cc:1151] Deleting tablet 30a5240093dd442a93bff006a965bc41
0925 01:49:58.426551 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.426722 (+ 171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6366518}
W20260925 01:49:58.438578 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 30a5240093dd442a93bff006a965bc41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30a5240093dd442a93bff006a965bc41 already in progress: creating tablet
I20260925 01:49:58.439249 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 242) took 6365 ms. Trace:
I20260925 01:49:58.439373 11946 rpcz_store.cc:276] 0925 01:49:52.073555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.073614 (+ 59us) service_pool.cc:224] Handling call
0925 01:49:58.439029 (+6365415us) ts_tablet_manager.cc:1151] Deleting tablet 329a5af9fb654d4c894e1cf4fd636c13
0925 01:49:58.439041 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.439187 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6363484}
I20260925 01:49:58.439610 11177 leader_election.cc:304] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9
I20260925 01:49:58.440029 12517 raft_consensus.cc:2764] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260925 01:49:58.440018 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 329a5af9fb654d4c894e1cf4fd636c13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329a5af9fb654d4c894e1cf4fd636c13 already in progress: creating tablet
I20260925 01:49:58.441174 12636 raft_consensus.cc:493] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:58.441437 12636 raft_consensus.cc:515] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.442564 12636 leader_election.cc:290] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.444273 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 240) took 6371 ms. Trace:
I20260925 01:49:58.444382 11946 rpcz_store.cc:276] 0925 01:49:52.073215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.073721 (+ 506us) service_pool.cc:224] Handling call
0925 01:49:58.444057 (+6370336us) ts_tablet_manager.cc:1151] Deleting tablet 24cd89d238bf4220a48ecdf59cca5e6d
0925 01:49:58.444072 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.444214 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6368318}
I20260925 01:49:58.444934 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 241) took 6371 ms. Trace:
I20260925 01:49:58.445030 11946 rpcz_store.cc:276] 0925 01:49:52.073384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.073752 (+ 368us) service_pool.cc:224] Handling call
0925 01:49:58.444737 (+6370985us) ts_tablet_manager.cc:1151] Deleting tablet 31ecfc5a2a80449c9905c83b6bcb3652
0925 01:49:58.444751 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.444873 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6368658}
I20260925 01:49:58.445425 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 243) took 6355 ms. Trace:
I20260925 01:49:58.445519 11946 rpcz_store.cc:276] 0925 01:49:52.090421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.090488 (+ 67us) service_pool.cc:224] Handling call
0925 01:49:58.445277 (+6354789us) ts_tablet_manager.cc:1151] Deleting tablet a9944a1422d14ae2b22451e67c477d5b
0925 01:49:58.445288 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.445366 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6353588}
I20260925 01:49:58.445905 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 249) took 6320 ms. Trace:
I20260925 01:49:58.446002 11946 rpcz_store.cc:276] 0925 01:49:52.125281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.125376 (+ 95us) service_pool.cc:224] Handling call
0925 01:49:58.445716 (+6320340us) ts_tablet_manager.cc:1151] Deleting tablet c28c8f00a8634ef89e4773b62e095b74
0925 01:49:58.445725 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.445848 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6320071}
I20260925 01:49:58.446400 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 266) took 5969 ms. Trace:
I20260925 01:49:58.446501 11946 rpcz_store.cc:276] 0925 01:49:52.476896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.478714 (+ 1818us) service_pool.cc:224] Handling call
0925 01:49:58.446264 (+5967550us) ts_tablet_manager.cc:1151] Deleting tablet 226498ea628a475d8fcab28a6598a819
0925 01:49:58.446271 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.446342 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5967357}
I20260925 01:49:58.446787 11946 tablet_replica.cc:333] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:58.447036 11946 raft_consensus.cc:2243] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:58.447446 11946 raft_consensus.cc:2272] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:58.449219 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 24cd89d238bf4220a48ecdf59cca5e6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24cd89d238bf4220a48ecdf59cca5e6d already in progress: creating tablet
W20260925 01:49:58.449551 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 31ecfc5a2a80449c9905c83b6bcb3652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ecfc5a2a80449c9905c83b6bcb3652 already in progress: creating tablet
I20260925 01:49:58.399859 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb98d5a38f43450c80d057d9eb2f92d1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:58.422782 11755 raft_consensus.cc:359] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.441398 12638 tablet.cc:1746] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Skipping requested alter to schema version 2, tablet already version 2
W20260925 01:49:58.449807 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a9944a1422d14ae2b22451e67c477d5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9944a1422d14ae2b22451e67c477d5b already in progress: creating tablet
W20260925 01:49:58.450156 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c28c8f00a8634ef89e4773b62e095b74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c28c8f00a8634ef89e4773b62e095b74 already in progress: creating tablet
W20260925 01:49:58.450449 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 226498ea628a475d8fcab28a6598a819 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 226498ea628a475d8fcab28a6598a819 already in progress: creating tablet
W20260925 01:49:58.451545 11456 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 039ee80a2822417898c1d1d779f52867
W20260925 01:49:58.452440 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9feb00f881ed4518a32e08d170080a46 consensus state has no leader
I20260925 01:49:58.452601 11946 ts_tablet_manager.cc:1916] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:58.452863 11753 tablet_bootstrap.cc:492] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:58.453186 11753 ts_tablet_manager.cc:1403] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.005s
I20260925 01:49:58.454456 11753 raft_consensus.cc:359] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.454782 11753 raft_consensus.cc:385] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.454901 11753 raft_consensus.cc:740] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.455546 11753 consensus_queue.cc:260] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.456485 11753 ts_tablet_manager.cc:1434] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:49:58.463030 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_88643d9e310644a3a751773450f73959" } new_table_name: "default.Table_ba84ef815eb14b9f845a5dc6ae6af351" modify_external_catalogs: true
I20260925 01:49:58.473614 11953 rpcz_store.cc:276] 0925 01:49:49.452070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.458527 (+ 6457us) service_pool.cc:224] Handling call
0925 01:49:58.397569 (+8939042us) ts_tablet_manager.cc:1151] Deleting tablet 1f778b87d307483b9edb17dce7355a65
0925 01:49:58.397588 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.397710 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8938764}
W20260925 01:49:58.474686 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1f778b87d307483b9edb17dce7355a65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f778b87d307483b9edb17dce7355a65 already in progress: creating tablet
I20260925 01:49:58.481647 11380 raft_consensus.cc:3060] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:58.484375 11755 raft_consensus.cc:385] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.484575 11755 raft_consensus.cc:740] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
W20260925 01:49:58.484933 11314 leader_election.cc:343] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:58.474038 11946 ts_tablet_manager.cc:1929] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:58.488036 11946 log.cc:1199] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/67921f86c4f6422e97d7f306262569f8
I20260925 01:49:58.488663 11946 ts_tablet_manager.cc:1950] T 67921f86c4f6422e97d7f306262569f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:58.489223 11755 consensus_queue.cc:260] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.489833 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 267) took 6012 ms. Trace:
I20260925 01:49:58.489970 11946 rpcz_store.cc:276] 0925 01:49:52.477028 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.478930 (+ 1902us) service_pool.cc:224] Handling call
0925 01:49:58.446710 (+5967780us) ts_tablet_manager.cc:1151] Deleting tablet 67921f86c4f6422e97d7f306262569f8
0925 01:49:58.446717 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.458256 (+ 11539us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.473930 (+ 15674us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.489772 (+ 15842us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5967627}
I20260925 01:49:58.490638 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 268) took 6013 ms. Trace:
I20260925 01:49:58.490828 11946 rpcz_store.cc:276] 0925 01:49:52.477110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.479094 (+ 1984us) service_pool.cc:224] Handling call
0925 01:49:58.490387 (+6011293us) ts_tablet_manager.cc:1151] Deleting tablet 8afcf8f6d0e24472a3190059df032698
0925 01:49:58.490398 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.490546 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6011144}
I20260925 01:49:58.491345 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 269) took 6014 ms. Trace:
I20260925 01:49:58.491897 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 148) took 9023 ms. Trace:
I20260925 01:49:58.492048 11953 rpcz_store.cc:276] 0925 01:49:49.459054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.459528 (+ 474us) service_pool.cc:224] Handling call
0925 01:49:58.475256 (+9015728us) ts_tablet_manager.cc:1151] Deleting tablet 9cd2e1bf7d3e4459a84235b9c3f5383c
0925 01:49:58.475270 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.482872 (+ 7602us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9015488}
I20260925 01:49:58.492177 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 67921f86c4f6422e97d7f306262569f8 (table default.Table_c33c7eb6481e4876aed3d7038afa9f93 [id=107d0cda55154f5e84ce4dd14d36364a]) successfully deleted
W20260925 01:49:58.492648 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8afcf8f6d0e24472a3190059df032698 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8afcf8f6d0e24472a3190059df032698 already in progress: creating tablet
I20260925 01:49:58.493057 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 151) took 8962 ms. Trace:
I20260925 01:49:58.493187 11953 rpcz_store.cc:276] 0925 01:49:49.530311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.530373 (+ 62us) service_pool.cc:224] Handling call
0925 01:49:58.492772 (+8962399us) ts_tablet_manager.cc:1151] Deleting tablet 644b28192e3b45e7b5370d55804cb043
0925 01:49:58.492783 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.492917 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8962121}
I20260925 01:49:58.493731 11953 tablet_replica.cc:333] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:58.493990 11953 raft_consensus.cc:2243] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:58.494027 11753 tablet_bootstrap.cc:492] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:58.492671 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9cd2e1bf7d3e4459a84235b9c3f5383c already in progress: creating tablet
I20260925 01:49:58.494361 11953 raft_consensus.cc:2272] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 01:49:58.494722 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 644b28192e3b45e7b5370d55804cb043 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 644b28192e3b45e7b5370d55804cb043 already in progress: creating tablet
W20260925 01:49:58.494953 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f92450c05b394603ba475328d5a3eb71 has no consensus state
I20260925 01:49:58.491539 11946 rpcz_store.cc:276] 0925 01:49:52.477196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.479234 (+ 2038us) service_pool.cc:224] Handling call
0925 01:49:58.491102 (+6011868us) ts_tablet_manager.cc:1151] Deleting tablet 7347b31f782c4508b004c7523dc11dbb
0925 01:49:58.491111 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.491263 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6011712}
I20260925 01:49:58.495083 11953 ts_tablet_manager.cc:1916] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:58.495332 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7347b31f782c4508b004c7523dc11dbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7347b31f782c4508b004c7523dc11dbb already in progress: creating tablet
I20260925 01:49:58.495748 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 270) took 6018 ms. Trace:
I20260925 01:49:58.495914 11946 rpcz_store.cc:276] 0925 01:49:52.477326 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.479401 (+ 2075us) service_pool.cc:224] Handling call
0925 01:49:58.495612 (+6016211us) ts_tablet_manager.cc:1151] Deleting tablet 818a792969a245f5b0fe5f80128206ba
0925 01:49:58.495621 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.495716 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6016070}
W20260925 01:49:58.496424 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 818a792969a245f5b0fe5f80128206ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 818a792969a245f5b0fe5f80128206ba already in progress: creating tablet
I20260925 01:49:58.496886 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 272) took 5210 ms. Trace:
I20260925 01:49:58.497048 11946 rpcz_store.cc:276] 0925 01:49:53.286797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.286850 (+ 53us) service_pool.cc:224] Handling call
0925 01:49:58.496700 (+5209850us) ts_tablet_manager.cc:1151] Deleting tablet 031687d4b26b4c7889dfbe3485c9f4c5
0925 01:49:58.496709 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.496830 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5209435}
W20260925 01:49:58.497643 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 031687d4b26b4c7889dfbe3485c9f4c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 031687d4b26b4c7889dfbe3485c9f4c5 already in progress: creating tablet
I20260925 01:49:58.498097 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 276) took 5135 ms. Trace:
I20260925 01:49:58.498261 11946 rpcz_store.cc:276] 0925 01:49:53.362390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.362470 (+ 80us) service_pool.cc:224] Handling call
0925 01:49:58.497938 (+5135468us) ts_tablet_manager.cc:1151] Deleting tablet 0b92054aaa704c7ebd6b075c30db2616
0925 01:49:58.497946 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.498043 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5133525}
W20260925 01:49:58.498782 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 0b92054aaa704c7ebd6b075c30db2616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b92054aaa704c7ebd6b075c30db2616 already in progress: creating tablet
I20260925 01:49:58.499125 11314 leader_election.cc:304] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.499195 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 279) took 5105 ms. Trace:
I20260925 01:49:58.499434 11946 rpcz_store.cc:276] 0925 01:49:53.393235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.393290 (+ 55us) service_pool.cc:224] Handling call
0925 01:49:58.499061 (+5105771us) ts_tablet_manager.cc:1151] Deleting tablet 81024a75b31e45e098d108bae4cc17c9
0925 01:49:58.499070 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.499153 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5105288}
I20260925 01:49:58.500162 11755 ts_tablet_manager.cc:1434] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.133s user 0.001s sys 0.001s
W20260925 01:49:58.500195 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 81024a75b31e45e098d108bae4cc17c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81024a75b31e45e098d108bae4cc17c9 already in progress: creating tablet
I20260925 01:49:58.503443 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 280) took 5094 ms. Trace:
I20260925 01:49:58.503661 11946 rpcz_store.cc:276] 0925 01:49:53.409213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.409482 (+ 269us) service_pool.cc:224] Handling call
0925 01:49:58.503189 (+5093707us) ts_tablet_manager.cc:1151] Deleting tablet 829d167dc0214890b722c0197500f159
0925 01:49:58.503199 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.503364 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5082914}
I20260925 01:49:58.504304 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 281) took 5079 ms. Trace:
I20260925 01:49:58.504586 12487 raft_consensus.cc:2804] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:58.504705 12487 raft_consensus.cc:493] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:58.504838 12487 raft_consensus.cc:3060] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:58.505457 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_99e2eca2291a4b8796db4daec4dd1433" } new_table_name: "default.Table_4ac6f82f8b014d6d8c31810a615b7cd8" modify_external_catalogs: true
I20260925 01:49:58.505414 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_366edf53ad054347ab1fdcaccf94d77e" } new_table_name: "default.Table_dd5e778c67f542cd8cdfdac93b91875b" modify_external_catalogs: true
I20260925 01:49:58.507936 11946 rpcz_store.cc:276] 0925 01:49:53.424510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.424785 (+ 275us) service_pool.cc:224] Handling call
0925 01:49:58.504093 (+5079308us) ts_tablet_manager.cc:1151] Deleting tablet 9771b89303094974902c4ad1f1c8608e
0925 01:49:58.504102 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.504216 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5079111}
W20260925 01:49:58.508298 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 829d167dc0214890b722c0197500f159 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 829d167dc0214890b722c0197500f159 already in progress: creating tablet
I20260925 01:49:58.508412 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 297) took 4611 ms. Trace:
I20260925 01:49:58.508914 11755 tablet_bootstrap.cc:492] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:49:58.509008 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9771b89303094974902c4ad1f1c8608e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9771b89303094974902c4ad1f1c8608e already in progress: creating tablet
I20260925 01:49:58.509042 11946 rpcz_store.cc:276] 0925 01:49:53.896413 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.896470 (+ 57us) service_pool.cc:224] Handling call
0925 01:49:58.508200 (+4611730us) ts_tablet_manager.cc:1151] Deleting tablet 200caea41ba4466386b091875f017956
0925 01:49:58.508210 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.508338 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4611482}
W20260925 01:49:58.509636 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 200caea41ba4466386b091875f017956 because the tablet was not found. No further retry: Not found: Tablet not found: 200caea41ba4466386b091875f017956
I20260925 01:49:58.510871 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_695a13c8a1d34501a3974088cc356262"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.511656 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_695a13c8a1d34501a3974088cc356262 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.512176 12638 tablet.cc:1746] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: Skipping requested alter to schema version 4, tablet already version 4
I20260925 01:49:58.512543 12638 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40776 (request call id 398) took 1335 ms. Trace:
I20260925 01:49:58.512677 12638 rpcz_store.cc:276] 0925 01:49:57.177475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.177544 (+ 69us) service_pool.cc:224] Handling call
0925 01:49:58.512500 (+1334956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:57.237626 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:57.237881 (+ 255us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:58.365965 (+1128084us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:58.365979 (+ 14us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:58.366035 (+ 56us) alter_schema_op.cc:128] START. Timestamp: 1790300998365973
0925 01:49:58.366038 (+ 3us) op_driver.cc:348] REPLICATION: starting
0925 01:49:58.366229 (+ 191us) log.cc:844] Serialized 173 byte log entry
0925 01:49:58.508722 (+142493us) op_driver.cc:464] REPLICATION: finished
0925 01:49:58.508840 (+ 118us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:49:58.512404 (+ 3564us) log.cc:844] Serialized 94 byte log entry
0925 01:49:58.512456 (+ 52us) alter_schema_op.cc:73] Released schema lock
0925 01:49:58.512462 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":69,"mutex_wait_us":20196,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":26393,"prepare.run_wall_time_us":1160442,"raft.queue_time_us":20288,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":346,"replication_time_us":142651}]]}
I20260925 01:49:58.514106 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ee80a2822417898c1d1d779f52867" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:58.517958 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 296) took 4621 ms. Trace:
I20260925 01:49:58.499665 11753 tablet_bootstrap.cc:654] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.520561 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c348106a82d5453083795cc37f76375b" } modify_external_catalogs: true
I20260925 01:49:58.520833 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c348106a82d5453083795cc37f76375b" } modify_external_catalogs: true
I20260925 01:49:58.523336 12663 tablet.cc:1746] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: Skipping requested alter to schema version 4, tablet already version 4
I20260925 01:49:58.527119 11754 tablet_bootstrap.cc:492] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:58.527297 11754 ts_tablet_manager.cc:1403] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.345s user 0.005s sys 0.002s
I20260925 01:49:58.527700 12627 tablet.cc:1746] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: Skipping requested alter to schema version 4, tablet already version 4
I20260925 01:49:58.528220 11754 raft_consensus.cc:359] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.528391 11754 raft_consensus.cc:385] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.528447 11754 raft_consensus.cc:740] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.528656 11754 consensus_queue.cc:260] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.529487 12487 raft_consensus.cc:515] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:58.530193 12487 leader_election.cc:290] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:58.534085 11379 raft_consensus.cc:2468] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:58.534564 11380 raft_consensus.cc:2468] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 2.
I20260925 01:49:58.535072 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86079f22abb74d438c61ecc2a7379cbd" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:58.535295 11522 raft_consensus.cc:3060] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:58.539656 11522 raft_consensus.cc:2468] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 2.
I20260925 01:49:58.540815 11314 leader_election.cc:304] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:58.541316 12445 raft_consensus.cc:2804] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 01:49:58.541303 11457 leader_election.cc:304] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:58.541344 11314 leader_election.cc:343] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 86079f22abb74d438c61ecc2a7379cbd
I20260925 01:49:58.541447 12445 raft_consensus.cc:697] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:58.541715 12445 consensus_queue.cc:237] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:58.541826 11457 leader_election.cc:304] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.542243 12636 raft_consensus.cc:2804] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:58.542379 12636 raft_consensus.cc:493] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:58.542484 12636 raft_consensus.cc:3060] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:58.542850 11754 ts_tablet_manager.cc:1434] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260925 01:49:58.546136 12636 raft_consensus.cc:515] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.547183 12508 raft_consensus.cc:2804] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 01:49:58.547453 12508 raft_consensus.cc:697] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:58.547873 11754 tablet_bootstrap.cc:492] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:58.547868 12508 consensus_queue.cc:237] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:58.549897 12651 raft_consensus.cc:493] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:49:58.550098 12651 raft_consensus.cc:515] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:58.550791 11456 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 039ee80a2822417898c1d1d779f52867
I20260925 01:49:58.550887 12651 leader_election.cc:290] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:58.551230 11946 rpcz_store.cc:276] 0925 01:49:53.896313 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.896611 (+ 298us) service_pool.cc:224] Handling call
0925 01:49:58.517369 (+4620758us) ts_tablet_manager.cc:1151] Deleting tablet 02f9e96bcdf9418ea54dc73bf68a2be6
0925 01:49:58.517387 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.517726 (+ 339us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4612425}
I20260925 01:49:58.553778 11339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 212) took 1718 ms. Trace:
I20260925 01:49:58.553987 11754 tablet_bootstrap.cc:654] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.553892 11339 rpcz_store.cc:276] 0925 01:49:56.834845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.835172 (+ 327us) service_pool.cc:224] Handling call
0925 01:49:56.994267 (+159095us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x6160000a2154. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.189990 (+195723us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x6160001a0e54. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.513776 (+1323786us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x616000200254. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.553754 (+ 39978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650570624}
I20260925 01:49:58.558369 11337 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 214) took 1279 ms. Trace:
I20260925 01:49:58.558526 11337 rpcz_store.cc:276] 0925 01:49:57.279294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.281258 (+ 1964us) service_pool.cc:224] Handling call
0925 01:49:57.643790 (+362532us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x6160001e1654. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.685206 (+ 41416us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x6160000a2154. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.341412 (+656206us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x6160000e2054. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.558346 (+216934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177255296}
I20260925 01:49:58.559703 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_780efdb9ac8e46519a54518ad282d2e2" } modify_external_catalogs: true
I20260925 01:49:58.564734 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_27cae369e3864093b7c94613cec41e94" } modify_external_catalogs: true
I20260925 01:49:58.564980 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_27cae369e3864093b7c94613cec41e94" } modify_external_catalogs: true
I20260925 01:49:58.565474 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_780efdb9ac8e46519a54518ad282d2e2" } modify_external_catalogs: true
W20260925 01:49:58.565910 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 02f9e96bcdf9418ea54dc73bf68a2be6 because the tablet was not found. No further retry: Not found: Tablet not found: 02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:58.573885 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
I20260925 01:49:58.575963 11674 catalog_manager.cc:5838] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:58.576457 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:49:58.580740 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 128be07ff230461ca7f998de7a02468f (DEFAULT_TABLE table=default.Table_32a32bf92a704259be81d568b38294a6 [id=b25c0d556bb74cce9810b3c81ccb4faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.581295 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128be07ff230461ca7f998de7a02468f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.587131 12636 leader_election.cc:290] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.587219 11946 tablet_replica.cc:333] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:58.587682 11946 raft_consensus.cc:2243] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:58.587937 11946 raft_consensus.cc:2272] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:58.589798 11946 ts_tablet_manager.cc:1916] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:58.599514 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 (DEFAULT_TABLE table=default.Table_eb7ce1a2a7094b9a948582c38d8958a3 [id=627651a505d9487bb0fce8edc1cc931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.599821 11212 tablet_service.cc:1511] Processing CreateTablet for tablet a43584aea51145d2982ee7e28cd1463f (DEFAULT_TABLE table=default.Table_445d4f81dda44494b1559b9c308b5c4c [id=e5bf237a4717465190ba6f478d93acf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.600003 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16dcc2d4bf24480f8e5fe67ae18764d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.600236 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43584aea51145d2982ee7e28cd1463f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.602782 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 60b99f56bd6b49f7998f51c49df4f58e (DEFAULT_TABLE table=default.Table_d830470740bc47ae97621cd325b9ef73 [id=9ed37fa7c9b74e5e9fe783dbf3bc8c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.603153 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b99f56bd6b49f7998f51c49df4f58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.609160 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 128be07ff230461ca7f998de7a02468f (DEFAULT_TABLE table=default.Table_32a32bf92a704259be81d568b38294a6 [id=b25c0d556bb74cce9810b3c81ccb4faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.609788 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128be07ff230461ca7f998de7a02468f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.618975 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 0258eac5971842878c62326952115490 (DEFAULT_TABLE table=default.Table_11479f53e6d343f4a1669c57ca73bf07 [id=268008a4752a4ff9ace0131b5523a37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.619297 11204 tablet_service.cc:1511] Processing CreateTablet for tablet f92450c05b394603ba475328d5a3eb71 (DEFAULT_TABLE table=default.Table_51ebd0c312174327b9602cc9358ab16c [id=8fb47e3a8f244d5b861e5878dbad047e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.619608 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0258eac5971842878c62326952115490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.619848 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92450c05b394603ba475328d5a3eb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.626559 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 (DEFAULT_TABLE table=default.Table_eb7ce1a2a7094b9a948582c38d8958a3 [id=627651a505d9487bb0fce8edc1cc931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.627022 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16dcc2d4bf24480f8e5fe67ae18764d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.627918 11499 tablet_service.cc:1511] Processing CreateTablet for tablet f92450c05b394603ba475328d5a3eb71 (DEFAULT_TABLE table=default.Table_51ebd0c312174327b9602cc9358ab16c [id=8fb47e3a8f244d5b861e5878dbad047e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.628324 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92450c05b394603ba475328d5a3eb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.630385 11484 tablet_service.cc:1511] Processing CreateTablet for tablet a43584aea51145d2982ee7e28cd1463f (DEFAULT_TABLE table=default.Table_445d4f81dda44494b1559b9c308b5c4c [id=e5bf237a4717465190ba6f478d93acf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.630787 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43584aea51145d2982ee7e28cd1463f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.634410 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 60b99f56bd6b49f7998f51c49df4f58e (DEFAULT_TABLE table=default.Table_d830470740bc47ae97621cd325b9ef73 [id=9ed37fa7c9b74e5e9fe783dbf3bc8c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.634902 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b99f56bd6b49f7998f51c49df4f58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.635075 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1d19fcc7804baa94da9fa2b25cdfe3 (DEFAULT_TABLE table=default.Table_a1355a6457f9415093fde818d0226dd7 [id=3f3e2aa462f340759715d39218ce8407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.635444 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1d19fcc7804baa94da9fa2b25cdfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.638470 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1c05b5a87e43d38a24f63242415fd7 (DEFAULT_TABLE table=default.Table_5218ba01b3f44905b240a69ebbd6d9f8 [id=2c67feb2811f423fb06736b7f82be74b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.638841 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1c05b5a87e43d38a24f63242415fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.642441 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 0258eac5971842878c62326952115490 (DEFAULT_TABLE table=default.Table_11479f53e6d343f4a1669c57ca73bf07 [id=268008a4752a4ff9ace0131b5523a37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.642905 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0258eac5971842878c62326952115490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.643376 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5eac56d95549e5a2f33d03f4b258de (DEFAULT_TABLE table=default.Table_e2734747e1e44e7badcbbe01c9b4b040 [id=543c29c809c0483fad0c0a9c6e5164ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.643780 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5eac56d95549e5a2f33d03f4b258de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.647059 12636 raft_consensus.cc:493] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:58.647258 12636 raft_consensus.cc:515] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.648299 12636 leader_election.cc:290] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.650565 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:58.650831 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 847e476ad4f94e17861a1b121451f0e0 (DEFAULT_TABLE table=default.Table_17a677951c834a40ae758b0e86f9165b [id=fa3a828088424db4bdec9ceca39c81e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.652166 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5eac56d95549e5a2f33d03f4b258de (DEFAULT_TABLE table=default.Table_e2734747e1e44e7badcbbe01c9b4b040 [id=543c29c809c0483fad0c0a9c6e5164ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.652662 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5eac56d95549e5a2f33d03f4b258de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.653141 11353 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 421) took 1376 ms. Trace:
I20260925 01:49:58.653263 11353 rpcz_store.cc:276] 0925 01:49:57.277144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.697625 (+420481us) service_pool.cc:224] Handling call
0925 01:49:57.763350 (+ 65725us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:57.763367 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:58.476368 (+713001us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.652916 (+176548us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:58.653119 (+ 203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:58.654398 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 847e476ad4f94e17861a1b121451f0e0 (DEFAULT_TABLE table=default.Table_17a677951c834a40ae758b0e86f9165b [id=fa3a828088424db4bdec9ceca39c81e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.654771 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847e476ad4f94e17861a1b121451f0e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.655599 11314 leader_election.cc:343] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a3358b78a1da48388d1f72536b1ed0a2
W20260925 01:49:58.655818 12630 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.213s user 0.002s sys 0.006s
I20260925 01:49:58.656764 11221 tablet_service.cc:1511] Processing CreateTablet for tablet c2fa459a53a54f47be961067736d2d16 (DEFAULT_TABLE table=default.Table_6b7ea24cfbf4403b9a9683f626e600df [id=eea02d2c6a074b3d8092aa230696c2ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.651232 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847e476ad4f94e17861a1b121451f0e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.660296 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3541e17b47bc47f5b69add361877a2bf consensus state has no leader
I20260925 01:49:58.660732 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6071e9aeccf94c38b3a13b08027ad884" } modify_external_catalogs: true
I20260925 01:49:58.660907 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6071e9aeccf94c38b3a13b08027ad884" } modify_external_catalogs: true
I20260925 01:49:58.661506 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fa459a53a54f47be961067736d2d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.665064 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 128be07ff230461ca7f998de7a02468f (DEFAULT_TABLE table=default.Table_32a32bf92a704259be81d568b38294a6 [id=b25c0d556bb74cce9810b3c81ccb4faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.671154 11946 ts_tablet_manager.cc:1929] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260925 01:49:58.671573 11946 log.cc:1199] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:49:58.673588 11946 ts_tablet_manager.cc:1950] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:58.675050 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 298) took 4778 ms. Trace:
W20260925 01:49:58.677619 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2b1e462c544f4c04a148e273f545570d consensus state has no leader
W20260925 01:49:58.677814 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a82e0251ebb4500b628924c89bfe1b2 consensus state has no leader
I20260925 01:49:58.677876 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 (DEFAULT_TABLE table=default.Table_eb7ce1a2a7094b9a948582c38d8958a3 [id=627651a505d9487bb0fce8edc1cc931b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.678081 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3ce60e2486054c3081ecab5a46f58e16" } modify_external_catalogs: true
I20260925 01:49:58.678263 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_beb6ee96dba041d6a7c99c5d8dc3a403"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:58.678390 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16dcc2d4bf24480f8e5fe67ae18764d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.678272 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3ce60e2486054c3081ecab5a46f58e16" } modify_external_catalogs: true
I20260925 01:49:58.678550 11946 rpcz_store.cc:276] 0925 01:49:53.896553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.896604 (+ 51us) service_pool.cc:224] Handling call
0925 01:49:58.555944 (+4659340us) ts_tablet_manager.cc:1151] Deleting tablet ea0fa393abfe4c5cb5a7f821ffdfaea7
0925 01:49:58.555956 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.594682 (+ 38726us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.656739 (+ 62057us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.674986 (+ 18247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4659012}
W20260925 01:49:58.678865 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_beb6ee96dba041d6a7c99c5d8dc3a403 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.679035 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 299) took 4543 ms. Trace:
I20260925 01:49:58.679116 11946 rpcz_store.cc:276] 0925 01:49:54.135790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.135843 (+ 53us) service_pool.cc:224] Handling call
0925 01:49:58.678872 (+4543029us) ts_tablet_manager.cc:1151] Deleting tablet 04f412cbebe04a629070aecf2753287c
0925 01:49:58.678881 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.678984 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4542700}
I20260925 01:49:58.679503 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 300) took 4506 ms. Trace:
I20260925 01:49:58.679594 11946 rpcz_store.cc:276] 0925 01:49:54.173618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.174465 (+ 847us) service_pool.cc:224] Handling call
0925 01:49:58.679341 (+4504876us) ts_tablet_manager.cc:1151] Deleting tablet 148f74b071c6420f8c78278c0cb37738
0925 01:49:58.679349 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.679452 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4504652}
I20260925 01:49:58.676851 11502 tablet_service.cc:1511] Processing CreateTablet for tablet c2fa459a53a54f47be961067736d2d16 (DEFAULT_TABLE table=default.Table_6b7ea24cfbf4403b9a9683f626e600df [id=eea02d2c6a074b3d8092aa230696c2ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.679949 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 306) took 4372 ms. Trace:
I20260925 01:49:58.680034 11946 rpcz_store.cc:276] 0925 01:49:54.307624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.308079 (+ 455us) service_pool.cc:224] Handling call
0925 01:49:58.679785 (+4371706us) ts_tablet_manager.cc:1151] Deleting tablet 33967e5e11524b78bb86ce7a3e2e16ad
0925 01:49:58.679794 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.679865 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4368461}
I20260925 01:49:58.680212 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fa459a53a54f47be961067736d2d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.680356 11946 tablet_replica.cc:333] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:58.680569 11946 raft_consensus.cc:2243] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:49:58.680565 11314 leader_election.cc:343] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a3358b78a1da48388d1f72536b1ed0a2
I20260925 01:49:58.680792 11946 raft_consensus.cc:2272] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:58.682207 11755 tablet_bootstrap.cc:654] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.683554 12638 tablet.cc:1751] T 5ef1b5f18d074016a6dea82da8e2d2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260925 01:49:58.677428 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 17d628e46be942b3be3a69afd3f6968b (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.686312 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d628e46be942b3be3a69afd3f6968b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.689491 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1c05b5a87e43d38a24f63242415fd7 (DEFAULT_TABLE table=default.Table_5218ba01b3f44905b240a69ebbd6d9f8 [id=2c67feb2811f423fb06736b7f82be74b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.689911 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1c05b5a87e43d38a24f63242415fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.692229 12636 raft_consensus.cc:493] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:58.692384 12636 raft_consensus.cc:515] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.693213 12636 leader_election.cc:290] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:49:58.694732 11456 leader_election.cc:343] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 331380a2be9a4893927c9b94a2c3e08b
I20260925 01:49:58.695246 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f892954cd22c48aaad2f0e20b1277844" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:58.695374 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 38249392c0df4d50b0e09f3671f92800 (DEFAULT_TABLE table=default.Table_b65cab23b4894abc96c8bb874bf3dde2 [id=0f87aa3f044841658a7d1077400a15e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.695803 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38249392c0df4d50b0e09f3671f92800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.696041 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 17d628e46be942b3be3a69afd3f6968b (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.697618 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d628e46be942b3be3a69afd3f6968b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.700081 11946 ts_tablet_manager.cc:1916] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:58.702188 11354 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 429) took 1115 ms. Trace:
I20260925 01:49:58.702539 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 60b99f56bd6b49f7998f51c49df4f58e (DEFAULT_TABLE table=default.Table_d830470740bc47ae97621cd325b9ef73 [id=9ed37fa7c9b74e5e9fe783dbf3bc8c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.704393 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 (table default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a]) successfully deleted
W20260925 01:49:58.704788 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 148f74b071c6420f8c78278c0cb37738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148f74b071c6420f8c78278c0cb37738 already in progress: creating tablet
I20260925 01:49:58.705155 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 88d8616fc7e243a885c318ce8e631c56 (DEFAULT_TABLE table=default.Table_a8c2185b6ac4411baea7759cf6be1e25 [id=4ba467af09804b30bf310d776c74f415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.705560 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d8616fc7e243a885c318ce8e631c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.706579 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 5c1c05b5a87e43d38a24f63242415fd7 (DEFAULT_TABLE table=default.Table_5218ba01b3f44905b240a69ebbd6d9f8 [id=2c67feb2811f423fb06736b7f82be74b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.707227 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6e5c4dd0d64fb389a7ff2620203a38 (DEFAULT_TABLE table=default.Table_7b7c710b210a4bb894250a51bc06f3e3 [id=0f3550462b5a4ee489da87bc79ee1ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.708230 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6e5c4dd0d64fb389a7ff2620203a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.713932 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128be07ff230461ca7f998de7a02468f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.719738 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 38249392c0df4d50b0e09f3671f92800 (DEFAULT_TABLE table=default.Table_b65cab23b4894abc96c8bb874bf3dde2 [id=0f87aa3f044841658a7d1077400a15e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.721202 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c1c05b5a87e43d38a24f63242415fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.725957 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38249392c0df4d50b0e09f3671f92800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.726233 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "039ee80a2822417898c1d1d779f52867" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:58.726454 11380 raft_consensus.cc:3060] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:58.726459 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1d19fcc7804baa94da9fa2b25cdfe3 (DEFAULT_TABLE table=default.Table_a1355a6457f9415093fde818d0226dd7 [id=3f3e2aa462f340759715d39218ce8407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.726788 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1d19fcc7804baa94da9fa2b25cdfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.727514 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 88d8616fc7e243a885c318ce8e631c56 (DEFAULT_TABLE table=default.Table_a8c2185b6ac4411baea7759cf6be1e25 [id=4ba467af09804b30bf310d776c74f415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.727804 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d8616fc7e243a885c318ce8e631c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.730392 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6e5c4dd0d64fb389a7ff2620203a38 (DEFAULT_TABLE table=default.Table_7b7c710b210a4bb894250a51bc06f3e3 [id=0f3550462b5a4ee489da87bc79ee1ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.730791 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6e5c4dd0d64fb389a7ff2620203a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.732007 11355 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 419) took 1435 ms. Trace:
W20260925 01:49:58.734210 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 110062us
I20260925 01:49:58.739817 11314 leader_election.cc:304] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.740245 12651 raft_consensus.cc:2749] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:49:58.741751 11380 raft_consensus.cc:2468] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:58.744076 11343 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 427) took 1159 ms. Trace:
I20260925 01:49:58.744244 11343 rpcz_store.cc:276] 0925 01:49:57.584310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.707547 (+123237us) service_pool.cc:224] Handling call
0925 01:49:57.778784 (+ 71237us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:57.778810 (+ 26us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:58.498397 (+719587us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.743715 (+245318us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:58.743958 (+ 243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:58.711158 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 45c06bf5641542f5aa36b160b31d797f
I20260925 01:49:58.749775 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:58.749840 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 847e476ad4f94e17861a1b121451f0e0 (DEFAULT_TABLE table=default.Table_17a677951c834a40ae758b0e86f9165b [id=fa3a828088424db4bdec9ceca39c81e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.712231 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 67c5e0fdc70243e8ba59e5e1faeecfc0
I20260925 01:49:58.738581 11671 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_c361990e57274e58b9e99c7086a27792 [id=8dcfe1cef923411faea69f4f694a51e6] alter complete (version 3)
I20260925 01:49:58.740568 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d3aadd649e4b4f489bfe4b0eea13ede8
I20260925 01:49:58.740976 11680 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_eb4b0c04d7514df3878af58f571b941f [id=f14bcaf842ad44929f252de69d2c40a7] alter complete (version 6)
I20260925 01:49:58.753031 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60b99f56bd6b49f7998f51c49df4f58e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.754251 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 17d628e46be942b3be3a69afd3f6968b (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:58.756814 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 59632.7us
I20260925 01:49:58.757766 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 0258eac5971842878c62326952115490 (DEFAULT_TABLE table=default.Table_11479f53e6d343f4a1669c57ca73bf07 [id=268008a4752a4ff9ace0131b5523a37f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:58.758011 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 53252.9us
W20260925 01:49:58.758854 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 33967e5e11524b78bb86ce7a3e2e16ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33967e5e11524b78bb86ce7a3e2e16ad already in progress: creating tablet
I20260925 01:49:58.758953 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 847e476ad4f94e17861a1b121451f0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.763346 11457 leader_election.cc:304] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.763767 11457 leader_election.cc:304] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:58.764321 12636 raft_consensus.cc:2749] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:58.764516 12636 raft_consensus.cc:2804] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:58.764614 12636 raft_consensus.cc:697] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:58.762423 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 2e839ce4c66c40eba5553a81e865a12a (DEFAULT_TABLE table=default.Table_e2286db8340a41b88ba1ce8f2b6df8d1 [id=e90c455ed0e04b398e3aea50cf81b436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.764848 12636 consensus_queue.cc:237] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.765187 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e839ce4c66c40eba5553a81e865a12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.767200 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_775faf150b3041519250a4f17a5bdae1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.767827 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_775faf150b3041519250a4f17a5bdae1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.770130 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a4cf2abec50042869b042af574e134b2" } new_table_name: "default.Table_af74504d5f9b4581a2d263665d820c48" modify_external_catalogs: true
I20260925 01:49:58.770974 11753 tablet_bootstrap.cc:492] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:58.771088 11753 ts_tablet_manager.cc:1403] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.277s user 0.007s sys 0.009s
I20260925 01:49:58.771392 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0a4622121fdc4b45881e03cba7c04e0a" } new_table_name: "default.Table_f78a88f277724061b29c49a4de82da50" modify_external_catalogs: true
I20260925 01:49:58.771791 11753 raft_consensus.cc:359] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.771973 11753 raft_consensus.cc:385] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.772032 11753 raft_consensus.cc:740] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.772161 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5eac56d95549e5a2f33d03f4b258de (DEFAULT_TABLE table=default.Table_e2734747e1e44e7badcbbe01c9b4b040 [id=543c29c809c0483fad0c0a9c6e5164ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.772238 11753 consensus_queue.cc:260] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.772370 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5fb6a5e0ac944a3bacc808d58b0d6c7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:58.772545 11341 tablet_service.cc:1511] Processing CreateTablet for tablet c2fa459a53a54f47be961067736d2d16 (DEFAULT_TABLE table=default.Table_6b7ea24cfbf4403b9a9683f626e600df [id=eea02d2c6a074b3d8092aa230696c2ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.772718 11753 ts_tablet_manager.cc:1434] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:58.773021 11753 tablet_bootstrap.cc:492] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:58.773043 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fb6a5e0ac944a3bacc808d58b0d6c7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.774420 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3e1405f7d12447309d5dbebd0aa43adc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.774895 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e1405f7d12447309d5dbebd0aa43adc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.776226 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6e5c4dd0d64fb389a7ff2620203a38 (DEFAULT_TABLE table=default.Table_7b7c710b210a4bb894250a51bc06f3e3 [id=0f3550462b5a4ee489da87bc79ee1ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.778509 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bd05ebe158af4ec9bf154690b3008162"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.779152 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd05ebe158af4ec9bf154690b3008162 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.786161 11753 tablet_bootstrap.cc:654] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.787609 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 70f4777a789a48a18cfadbfb9d49a708
W20260925 01:49:58.788379 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 2b1e462c544f4c04a148e273f545570d (table default.Table_4ac6f82f8b014d6d8c31810a615b7cd8 [id=f318edf82c57433098a317160c89b7db], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2b1e462c544f4c04a148e273f545570d consensus state has no leader
I20260925 01:49:58.791267 11946 ts_tablet_manager.cc:1929] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:58.791397 11946 log.cc:1199] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ccffbe61eea34333abdc6da94612c0f6
I20260925 01:49:58.791853 11946 ts_tablet_manager.cc:1950] T ccffbe61eea34333abdc6da94612c0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:58.795568 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:49:58.799295 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet d401574e89014d2aaa5f98d0d9a2729f from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:58.801047 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2b63b653cd24456594dea1d971c6a930"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.801750 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b63b653cd24456594dea1d971c6a930 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.806732 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 85ae2fbcec1d41dda3e0b32ce09a32f2
I20260925 01:49:58.807427 11672 catalog_manager.cc:6934] ReplaceTablet: tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 deleted and replaced by tablet 9b75b12794fa4f4fa53156c212632cdc
I20260925 01:49:58.808122 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dd2fbf6d10f744cd86b10091a53b0372"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.808898 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd2fbf6d10f744cd86b10091a53b0372 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:58.811568 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8036963ed28c4e0aae2c4a0bd8e9c99b consensus state has no leader
I20260925 01:49:58.812112 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 38249392c0df4d50b0e09f3671f92800 (DEFAULT_TABLE table=default.Table_b65cab23b4894abc96c8bb874bf3dde2 [id=0f87aa3f044841658a7d1077400a15e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.812225 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b29d5c3e7011407a920707f27614b3de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.812846 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b29d5c3e7011407a920707f27614b3de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.816197 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7dad99b3f361482389400168bbd281d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:58.816996 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dad99b3f361482389400168bbd281d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.821182 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1d19fcc7804baa94da9fa2b25cdfe3 (DEFAULT_TABLE table=default.Table_a1355a6457f9415093fde818d0226dd7 [id=3f3e2aa462f340759715d39218ce8407]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:58.822120 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f7639fd1f1149a7973eba0c77bd7065 consensus state has no leader
I20260925 01:49:58.823379 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331380a2be9a4893927c9b94a2c3e08b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:58.823941 11355 rpcz_store.cc:276] 0925 01:49:57.276846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.656687 (+379841us) service_pool.cc:224] Handling call
0925 01:49:57.685613 (+ 28926us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:57.685670 (+ 57us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:58.426598 (+740928us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.712587 (+285989us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:58.712759 (+ 172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:58.824576 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 2e839ce4c66c40eba5553a81e865a12a (DEFAULT_TABLE table=default.Table_e2286db8340a41b88ba1ce8f2b6df8d1 [id=e90c455ed0e04b398e3aea50cf81b436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.825134 11353 tablet_service.cc:1511] Processing CreateTablet for tablet a43584aea51145d2982ee7e28cd1463f (DEFAULT_TABLE table=default.Table_445d4f81dda44494b1559b9c308b5c4c [id=e5bf237a4717465190ba6f478d93acf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.834789 12630 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40776 (request call id 377) took 2117 ms. Trace:
I20260925 01:49:58.840130 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 88d8616fc7e243a885c318ce8e631c56 (DEFAULT_TABLE table=default.Table_a8c2185b6ac4411baea7759cf6be1e25 [id=4ba467af09804b30bf310d776c74f415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.834954 12630 rpcz_store.cc:276] 0925 01:49:56.571371 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.571597 (+ 226us) service_pool.cc:224] Handling call
0925 01:49:58.689228 (+2117631us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:56.963159 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:56.963527 (+ 368us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x60c0003f1c40. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c7cd4c015 00007f1c747ce0b0 00007f1c68e55510 0000000000a9ba26 00007f1c68e7478a 00007f1c68e701d1 00007f1c68e6f63e 00007f1c763147f3 00007f1c762b6c6f 00007f1c78db2f52
0925 01:49:57.052574 (+ 89047us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:57.052584 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:57.052594 (+ 10us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:57.052634 (+ 40us) alter_schema_op.cc:128] START. Timestamp: 1790300997052556
0925 01:49:57.052639 (+ 5us) op_driver.cc:348] REPLICATION: starting
0925 01:49:57.085075 (+ 32436us) log.cc:844] Serialized 173 byte log entry
0925 01:49:57.560130 (+475055us) op_driver.cc:464] REPLICATION: finished
0925 01:49:57.706156 (+146026us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:49:58.370295 (+664139us) log.cc:844] Serialized 5 byte log entry
0925 01:49:58.583245 (+212950us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x60c0003f1c40. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c7cd4c015 00007f1c747ce0b0 00007f1c68e55510 0000000000a9ba26 00007f1c68e7478a 00007f1c68e701d1 00007f1c68e754de 00007f1c747b32dc 00007f1c747c060b 00007f1c747c2ae3
0925 01:49:58.688831 (+105586us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.689118 (+ 287us) log.cc:844] Serialized 14 byte log entry
0925 01:49:58.689175 (+ 57us) alter_schema_op.cc:73] Released schema lock
0925 01:49:58.689182 (+ 7us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":130470,"prepare.queue_time_us":380753,"prepare.run_cpu_time_us":1218,"prepare.run_wall_time_us":122020,"raft.queue_time_us":90,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":238,"replication_time_us":507458,"spinlock_wait_cycles":97246848,"thread_start_us":650673,"threads_started":3,"wal-append.queue_time_us":143373}]]}
I20260925 01:49:58.844067 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d401574e89014d2aaa5f98d0d9a2729f
I20260925 01:49:58.844947 11679 catalog_manager.cc:6934] ReplaceTablet: tablet d401574e89014d2aaa5f98d0d9a2729f deleted and replaced by tablet 0492ea6f9d0a4cdf9e339920863b54f9
I20260925 01:49:58.850756 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 2e839ce4c66c40eba5553a81e865a12a (DEFAULT_TABLE table=default.Table_e2286db8340a41b88ba1ce8f2b6df8d1 [id=e90c455ed0e04b398e3aea50cf81b436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.854679 11754 tablet_bootstrap.cc:492] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:58.854833 11754 ts_tablet_manager.cc:1403] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.307s user 0.004s sys 0.016s
I20260925 01:49:58.855819 11754 raft_consensus.cc:359] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.856003 11754 raft_consensus.cc:385] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.856112 11754 raft_consensus.cc:740] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.856351 11754 consensus_queue.cc:260] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.856887 11754 ts_tablet_manager.cc:1434] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:49:58.857247 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4219ce09e54d268c55c19f7b5cbc7d (DEFAULT_TABLE table=default.Table_f272b10ac9224db48f3c16d93a0ea84e [id=e6ecbf90b3084f4c880e10311bc91fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.857321 11216 tablet_service.cc:1511] Processing CreateTablet for tablet a92e93e5478846c7ac2eee8a8e76c7aa (DEFAULT_TABLE table=default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c [id=923936ead93f43d5bb7370a3605f8098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.857849 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 8042784d3ab14285836a008745daabbc (DEFAULT_TABLE table=default.Table_680652ee5db44c0ca4fa70ca72f3afef [id=e4704deee78343708d5ba1472967730d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.857838 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4219ce09e54d268c55c19f7b5cbc7d (DEFAULT_TABLE table=default.Table_f272b10ac9224db48f3c16d93a0ea84e [id=e6ecbf90b3084f4c880e10311bc91fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.858402 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 8042784d3ab14285836a008745daabbc (DEFAULT_TABLE table=default.Table_680652ee5db44c0ca4fa70ca72f3afef [id=e4704deee78343708d5ba1472967730d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.859012 11754 tablet_bootstrap.cc:492] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:58.861470 11754 tablet_bootstrap.cc:654] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.864625 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4219ce09e54d268c55c19f7b5cbc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.865332 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d658fd300e03462995eddeb99aaf8f45" } new_table_name: "default.Table_c4b146df79f340bf9b1dc7663cdbbcaf" modify_external_catalogs: true
I20260925 01:49:58.867867 12517 raft_consensus.cc:493] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:58.868001 12517 raft_consensus.cc:515] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.868892 12517 leader_election.cc:290] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:58.873183 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad9d992f7ed4021a7e472dd38ad2c2e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:58.874532 11354 rpcz_store.cc:276] 0925 01:49:57.586369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.765088 (+178719us) service_pool.cc:224] Handling call
0925 01:49:57.766603 (+ 1515us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:57.766651 (+ 48us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:58.467152 (+700501us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.701842 (+234690us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:58.702147 (+ 305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:58.874692 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c06bf5641542f5aa36b160b31d797f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.874794 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.874192 11498 tablet_service.cc:1511] Processing CreateTablet for tablet a92e93e5478846c7ac2eee8a8e76c7aa (DEFAULT_TABLE table=default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c [id=923936ead93f43d5bb7370a3605f8098]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:58.875458 11176 leader_election.cc:343] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:58.876220 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92e93e5478846c7ac2eee8a8e76c7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.886240 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.894339 11351 tablet_service.cc:1511] Processing CreateTablet for tablet f92450c05b394603ba475328d5a3eb71 (DEFAULT_TABLE table=default.Table_51ebd0c312174327b9602cc9358ab16c [id=8fb47e3a8f244d5b861e5878dbad047e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.898914 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 00906edfa6b648229bcba8e59d68b969 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:58.899298 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4089f8c8017247ab96430424fa118dd5" } new_table_name: "default.Table_08407df8b897403bbecc67268e6f0262" modify_external_catalogs: true
I20260925 01:49:58.902841 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3f397bb38f82466883e8e43a81afcf4a" } new_table_name: "default.Table_9c9ce5397aab47629f8271efca8c100f" modify_external_catalogs: true
W20260925 01:49:58.908609 11314 consensus_peers.cc:597] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4eb584e929c46f891d28ad01e6d78ae. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:58.909228 11676 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_c361990e57274e58b9e99c7086a27792 [id=8dcfe1cef923411faea69f4f694a51e6]). Expected version 3 got 0
I20260925 01:49:58.909597 11676 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:49:58.917387 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8042784d3ab14285836a008745daabbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.923063 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:58.923306 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 101948us
I20260925 01:49:58.924113 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0258eac5971842878c62326952115490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.925223 11349 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 435) took 1027 ms. Trace:
I20260925 01:49:58.925271 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet d3aadd649e4b4f489bfe4b0eea13ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.925565 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4219ce09e54d268c55c19f7b5cbc7d (DEFAULT_TABLE table=default.Table_f272b10ac9224db48f3c16d93a0ea84e [id=e6ecbf90b3084f4c880e10311bc91fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:58.925129 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad9d992f7ed4021a7e472dd38ad2c2e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:49:58.929185 11177 leader_election.cc:343] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:58.929327 11177 leader_election.cc:304] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:49:58.930024 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 331380a2be9a4893927c9b94a2c3e08b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.930124 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet 70f4777a789a48a18cfadbfb9d49a708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.930464 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.930675 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 039ee80a2822417898c1d1d779f52867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.925393 11349 rpcz_store.cc:276] 0925 01:49:57.851383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.851453 (+ 70us) service_pool.cc:224] Handling call
0925 01:49:57.863393 (+ 11940us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:57.863432 (+ 39us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:58.693080 (+829648us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.878706 (+185626us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:58.878885 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:58.930891 12517 raft_consensus.cc:2749] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:58.932371 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet d3aadd649e4b4f489bfe4b0eea13ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:58.935775 12689 tablet_replica.cc:333] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:58.936286 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e839ce4c66c40eba5553a81e865a12a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:58.939126 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7eee30b35eb94fa196e9ccd1de37175a consensus state has no leader
I20260925 01:49:58.946023 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7825567ce8ce424aab880bd345cf3c3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:58.948401 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c06bf5641542f5aa36b160b31d797f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:58.950484 12636 raft_consensus.cc:493] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:58.950627 12636 raft_consensus.cc:515] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:49:58.951035 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7825567ce8ce424aab880bd345cf3c3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:58.951493 12636 leader_election.cc:290] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:58.952874 11456 leader_election.cc:343] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ca76f6f710d841fd8999b40e5a48693f
I20260925 01:49:58.957886 11754 tablet_bootstrap.cc:492] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:58.958156 11754 ts_tablet_manager.cc:1403] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.099s user 0.006s sys 0.006s
I20260925 01:49:58.959124 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_22a3f87d316e46268ed60c79ab7a9824" } modify_external_catalogs: true
I20260925 01:49:58.959463 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_22a3f87d316e46268ed60c79ab7a9824" } modify_external_catalogs: true
I20260925 01:49:58.959195 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0d011eae3e3e4b40a2df36dd1362b71e" } modify_external_catalogs: true
I20260925 01:49:58.960695 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0d011eae3e3e4b40a2df36dd1362b71e" } modify_external_catalogs: true
I20260925 01:49:58.961483 11754 raft_consensus.cc:359] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.961791 11754 raft_consensus.cc:385] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:58.961900 11754 raft_consensus.cc:740] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:58.962303 11754 consensus_queue.cc:260] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:58.966691 11754 ts_tablet_manager.cc:1434] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:49:58.967216 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3
W20260925 01:49:58.969676 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ad9d992f7ed4021a7e472dd38ad2c2e consensus state has no leader
I20260925 01:49:58.974483 11754 tablet_bootstrap.cc:492] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:58.975025 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f92450c05b394603ba475328d5a3eb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.976249 11754 tablet_bootstrap.cc:654] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:58.977026 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_96968765ba9045588fca7ce661775b0d" } modify_external_catalogs: true
I20260925 01:49:58.977289 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_96968765ba9045588fca7ce661775b0d" } modify_external_catalogs: true
I20260925 01:49:58.979981 11674 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 1 got 0
I20260925 01:49:58.935992 12689 raft_consensus.cc:2243] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:58.985050 12689 raft_consensus.cc:2272] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:58.986042 11359 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 436) took 1041 ms. Trace:
I20260925 01:49:58.975526 11380 raft_consensus.cc:2468] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:58.986800 12689 ts_tablet_manager.cc:1916] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:58.993016 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43584aea51145d2982ee7e28cd1463f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:58.994693 11755 tablet_bootstrap.cc:492] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:58.995219 12607 consensus_queue.cc:1048] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
W20260925 01:49:58.997895 11314 consensus_peers.cc:597] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:58.997951 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f385af75e11c4643b4e7c2d899ee99a4
I20260925 01:49:58.999006 12607 consensus_queue.cc:1048] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:59.000958 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 982b2a3dcdcb44bd8ad8562f30c38f13
I20260925 01:49:59.002364 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e297a48065794637b13d401d13c54906" } modify_external_catalogs: true
I20260925 01:49:59.002697 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e297a48065794637b13d401d13c54906" } modify_external_catalogs: true
I20260925 01:49:59.006130 11457 leader_election.cc:304] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.007385 12487 raft_consensus.cc:493] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.007718 12636 raft_consensus.cc:2804] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:59.007795 12636 raft_consensus.cc:493] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:59.007858 12636 raft_consensus.cc:3060] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.008752 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 8042784d3ab14285836a008745daabbc (DEFAULT_TABLE table=default.Table_680652ee5db44c0ca4fa70ca72f3afef [id=e4704deee78343708d5ba1472967730d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.011253 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b75b12794fa4f4fa53156c212632cdc) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.011673 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.011953 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 70f4777a789a48a18cfadbfb9d49a708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.012162 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.012228 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1d19fcc7804baa94da9fa2b25cdfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.014869 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b75b12794fa4f4fa53156c212632cdc) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.015231 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet d401574e89014d2aaa5f98d0d9a2729f with delete_type TABLET_DATA_DELETED (replaced by tablet 0492ea6f9d0a4cdf9e339920863b54f9) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.015692 12487 raft_consensus.cc:515] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.017599 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea85f72e10443229f5f927bcaf31cb3 (DEFAULT_TABLE table=default.Table_695a13c8a1d34501a3974088cc356262 [id=788e6b26bf764d7f9af70a4e2b312817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.018137 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea85f72e10443229f5f927bcaf31cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.022084 11359 rpcz_store.cc:276] 0925 01:49:57.906568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.960257 (+ 53689us) service_pool.cc:224] Handling call
0925 01:49:57.960861 (+ 604us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:57.960892 (+ 31us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:58.479860 (+518968us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.947476 (+467616us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:58.947628 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:59.022424 11755 ts_tablet_manager.cc:1403] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.495s user 0.012s sys 0.009s
I20260925 01:49:59.022744 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d628e46be942b3be3a69afd3f6968b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.022228 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet d401574e89014d2aaa5f98d0d9a2729f with delete_type TABLET_DATA_DELETED (replaced by tablet 0492ea6f9d0a4cdf9e339920863b54f9) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.024117 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea85f72e10443229f5f927bcaf31cb3 (DEFAULT_TABLE table=default.Table_695a13c8a1d34501a3974088cc356262 [id=788e6b26bf764d7f9af70a4e2b312817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.025110 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c06bf5641542f5aa36b160b31d797f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.025321 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4219ce09e54d268c55c19f7b5cbc7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.025238 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 621a4a75ba204a99a9954cd381f712e7 (DEFAULT_TABLE table=default.Table_e119f5d392bc4cae8bf871b63c0f9f40 [id=2e8859565a3d4b87b25737fec97a377c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.025943 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e839ce4c66c40eba5553a81e865a12a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.026432 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_08407df8b897403bbecc67268e6f0262" } modify_external_catalogs: true
I20260925 01:49:59.026656 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_08407df8b897403bbecc67268e6f0262" } modify_external_catalogs: true
I20260925 01:49:59.027328 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_192ad0421b7d4133831b8b433981f74f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.027880 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.028044 12636 raft_consensus.cc:515] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:49:59.028867 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_192ad0421b7d4133831b8b433981f74f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.029188 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4219ce09e54d268c55c19f7b5cbc7d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.029580 11456 leader_election.cc:343] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 331380a2be9a4893927c9b94a2c3e08b
I20260925 01:49:59.030313 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fc194d4f46f0472fafaeeaa06e43f1dc" } new_table_name: "default.Table_cb8a2634625e4318a33e4cdf80a1c078" modify_external_catalogs: true
I20260925 01:49:59.030678 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c8919df13a3e476cb936abc0b4625aae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.031260 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8919df13a3e476cb936abc0b4625aae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.031925 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5652bb3084d3458c95041da9ffa64c8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.032423 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_abb11ad0c29f45e2a38ef498da7e605b" } new_table_name: "default.Table_f6390a24da7e46038a7947594b1aacd8" modify_external_catalogs: true
W20260925 01:49:59.032506 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5652bb3084d3458c95041da9ffa64c8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.033586 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c60e42eaec624765b51e956e32a4619c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.034091 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c60e42eaec624765b51e956e32a4619c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.034313 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8042784d3ab14285836a008745daabbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.038326 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2bd8fecb1710484f8d3db44a6385718c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.038847 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bd8fecb1710484f8d3db44a6385718c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.038776 12607 consensus_queue.cc:1048] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:59.039183 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 4d14ab205bba4f9d92797d34ab82f13d (DEFAULT_TABLE table=default.Table_bdec13308f734fc98b23b4015fdf0b7f [id=75ef360d45ff45e8b22bf9cded9afb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.039582 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d14ab205bba4f9d92797d34ab82f13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.039948 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92e93e5478846c7ac2eee8a8e76c7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.042234 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e572f77e242d799c334820579268d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:59.042451 11237 raft_consensus.cc:2468] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:59.043237 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 308) took 4727 ms. Trace:
I20260925 01:49:59.043318 11946 rpcz_store.cc:276] 0925 01:49:54.315589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.315751 (+ 162us) service_pool.cc:224] Handling call
0925 01:49:58.680264 (+4364513us) ts_tablet_manager.cc:1151] Deleting tablet ccffbe61eea34333abdc6da94612c0f6
0925 01:49:58.680273 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.719246 (+ 38973us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:58.791197 (+ 71951us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.043218 (+252021us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4364229}
I20260925 01:49:59.043821 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 309) took 4728 ms. Trace:
I20260925 01:49:59.043893 11946 rpcz_store.cc:276] 0925 01:49:54.315694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.316084 (+ 390us) service_pool.cc:224] Handling call
0925 01:49:59.043660 (+4727576us) ts_tablet_manager.cc:1151] Deleting tablet 7900db92b35048aaa200ed3183031d6b
0925 01:49:59.043668 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.043804 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4727416}
I20260925 01:49:59.044176 11946 tablet_replica.cc:333] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.044358 11946 raft_consensus.cc:2243] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 LEADER]: Raft consensus shutting down.
I20260925 01:49:59.044628 11946 pending_rounds.cc:70] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:59.044680 11946 pending_rounds.cc:77] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7333072890055254016 op_type: NO_OP noop_request { }
I20260925 01:49:59.044770 11946 raft_consensus.cc:2889] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:59.044850 11946 raft_consensus.cc:2272] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.046098 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ca6dba60babb4961bfc10a76b8cec13d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.046650 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca6dba60babb4961bfc10a76b8cec13d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.055819 11946 ts_tablet_manager.cc:1916] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.058939 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2fa459a53a54f47be961067736d2d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.059301 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 621a4a75ba204a99a9954cd381f712e7 (DEFAULT_TABLE table=default.Table_e119f5d392bc4cae8bf871b63c0f9f40 [id=2e8859565a3d4b87b25737fec97a377c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.059748 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621a4a75ba204a99a9954cd381f712e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.060753 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc4a51356880486a928181ee701f74d0 consensus state has no leader
I20260925 01:49:59.061077 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d8616fc7e243a885c318ce8e631c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.061290 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6e5c4dd0d64fb389a7ff2620203a38. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.061625 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6599a18283614e759cf3886d72c8250b consensus state has no leader
I20260925 01:49:59.063783 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:59.065457 11344 tablet_service.cc:1511] Processing CreateTablet for tablet a92e93e5478846c7ac2eee8a8e76c7aa (DEFAULT_TABLE table=default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c [id=923936ead93f43d5bb7370a3605f8098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.066253 11753 tablet_bootstrap.cc:492] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:59.066471 11753 ts_tablet_manager.cc:1403] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.294s user 0.004s sys 0.000s
I20260925 01:49:59.066594 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet d3aadd649e4b4f489bfe4b0eea13ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.066818 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.066975 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b75b12794fa4f4fa53156c212632cdc) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.067126 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet d401574e89014d2aaa5f98d0d9a2729f with delete_type TABLET_DATA_DELETED (replaced by tablet 0492ea6f9d0a4cdf9e339920863b54f9) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.067485 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 1ea85f72e10443229f5f927bcaf31cb3 (DEFAULT_TABLE table=default.Table_695a13c8a1d34501a3974088cc356262 [id=788e6b26bf764d7f9af70a4e2b312817]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.064033 11380 raft_consensus.cc:2468] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:59.067790 11753 raft_consensus.cc:359] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.067951 11753 raft_consensus.cc:385] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.068002 11753 raft_consensus.cc:740] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.068114 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 4d14ab205bba4f9d92797d34ab82f13d (DEFAULT_TABLE table=default.Table_bdec13308f734fc98b23b4015fdf0b7f [id=75ef360d45ff45e8b22bf9cded9afb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.068210 11753 consensus_queue.cc:260] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.068718 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d14ab205bba4f9d92797d34ab82f13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.068759 11753 ts_tablet_manager.cc:1434] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:49:59.069031 11753 tablet_bootstrap.cc:492] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:59.073318 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c2fe086048c04e0db797272e50f21c91
I20260925 01:49:59.078213 12487 leader_election.cc:290] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:49:59.079238 11314 consensus_peers.cc:597] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:59.079661 11314 consensus_peers.cc:597] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea0fa393abfe4c5cb5a7f821ffdfaea7. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:59.082468 11314 leader_election.cc:304] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:59.082919 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5eac56d95549e5a2f33d03f4b258de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.084534 11218 tablet_service.cc:1511] Processing CreateTablet for tablet ab09d980c0814a2f8babc83222f2bc17 (DEFAULT_TABLE table=default.Table_a7d1848c346a4268ace995c919f1be64 [id=98825c86621d4ad783c876d282c4a8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.085049 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab09d980c0814a2f8babc83222f2bc17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.085966 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ccffbe61eea34333abdc6da94612c0f6 (table default.Table_b2c32d1c9f694835aa159840a4024f00 [id=fd0ffd9fb56b40f590be7bd7b9128f45]) successfully deleted
I20260925 01:49:59.087409 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea85f72e10443229f5f927bcaf31cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.090554 12689 ts_tablet_manager.cc:1929] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:59.090654 12689 log.cc:1199] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/23a6ec9b9b5d4f60a7e5f3edf0687b56
I20260925 01:49:59.090952 12689 ts_tablet_manager.cc:1950] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:59.077155 12636 leader_election.cc:290] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:59.081296 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e572f77e242d799c334820579268d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:59.092998 11519 raft_consensus.cc:2468] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:59.081697 11457 leader_election.cc:304] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.093801 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 6e644bfe06ff4ca89066b1ded01f2b90 (DEFAULT_TABLE table=default.Table_b1e57df563c64536a49824c81a2ab45c [id=d8bf2537974a4656867f245037460af9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.093950 12508 raft_consensus.cc:2804] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:49:59.094089 12508 raft_consensus.cc:493] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:59.093930 12636 consensus_queue.cc:1048] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:59.094167 12508 raft_consensus.cc:3060] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:59.094218 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e644bfe06ff4ca89066b1ded01f2b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.094431 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.094625 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.094782 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.094950 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.095309 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 5366f2487b444e12ad9d63d6825d5e97 (DEFAULT_TABLE table=default.Table_a69c32a8461b431d9573c99f2cbf16e2 [id=cc50d6b58dde476d90d95aa4266e8f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.095654 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5366f2487b444e12ad9d63d6825d5e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.097105 12508 raft_consensus.cc:515] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:59.097752 12508 leader_election.cc:290] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:59.098357 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92e93e5478846c7ac2eee8a8e76c7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.098397 11217 tablet_service.cc:1511] Processing CreateTablet for tablet e3b08f61aaf5442889011fe309dea835 (DEFAULT_TABLE table=default.Table_139172e2d0ec420c8c2484e90f7a160b [id=1367e6eebcb04e0c846fd600cf344f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.098732 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b08f61aaf5442889011fe309dea835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.102258 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet c2fe086048c04e0db797272e50f21c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.102785 11753 tablet_bootstrap.cc:654] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.102739 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 64409139bf964b359ff2be04122c30ce (DEFAULT_TABLE table=default.Table_64f66e588ec44c4a8f677885695767e6 [id=0feace45c16a428c9300d7d29932d0e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.103096 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64409139bf964b359ff2be04122c30ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.104279 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7900db92b35048aaa200ed3183031d6b because the tablet was not found. No further retry: Not found: Tablet not found: 7900db92b35048aaa200ed3183031d6b
I20260925 01:49:59.105724 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.105880 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.106289 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 6e644bfe06ff4ca89066b1ded01f2b90 (DEFAULT_TABLE table=default.Table_b1e57df563c64536a49824c81a2ab45c [id=d8bf2537974a4656867f245037460af9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.106720 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e644bfe06ff4ca89066b1ded01f2b90. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.107088 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 already in progress: creating tablet
I20260925 01:49:59.107971 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 (table default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b [id=4598ed1a6ec844ec8c3930fb1d54cf01]) successfully deleted
I20260925 01:49:59.109791 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.110277 11755 raft_consensus.cc:359] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.110509 11755 raft_consensus.cc:385] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.110430 11484 tablet_service.cc:1511] Processing CreateTablet for tablet e3b08f61aaf5442889011fe309dea835 (DEFAULT_TABLE table=default.Table_139172e2d0ec420c8c2484e90f7a160b [id=1367e6eebcb04e0c846fd600cf344f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.110574 11755 raft_consensus.cc:740] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.110848 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b08f61aaf5442889011fe309dea835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.110775 11755 consensus_queue.cc:260] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.110991 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 5366f2487b444e12ad9d63d6825d5e97 (DEFAULT_TABLE table=default.Table_a69c32a8461b431d9573c99f2cbf16e2 [id=cc50d6b58dde476d90d95aa4266e8f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.111337 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5366f2487b444e12ad9d63d6825d5e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.111354 11755 ts_tablet_manager.cc:1434] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.089s user 0.002s sys 0.000s
I20260925 01:49:59.114497 11497 tablet_service.cc:1511] Processing CreateTablet for tablet c48d8e44694b4a2a904ab8c4751efb06 (DEFAULT_TABLE table=default.Table_9064b44c74cd4452be3e52fd938cf131 [id=86530c7257e44a9dbdbbac3b52580efa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.114864 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d8e44694b4a2a904ab8c4751efb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.118534 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 64409139bf964b359ff2be04122c30ce (DEFAULT_TABLE table=default.Table_64f66e588ec44c4a8f677885695767e6 [id=0feace45c16a428c9300d7d29932d0e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.118865 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64409139bf964b359ff2be04122c30ce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.119333 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d3aadd649e4b4f489bfe4b0eea13ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3aadd649e4b4f489bfe4b0eea13ede8 already in progress: creating tablet
W20260925 01:49:59.119701 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 70f4777a789a48a18cfadbfb9d49a708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f4777a789a48a18cfadbfb9d49a708 already in progress: creating tablet
I20260925 01:49:59.120100 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 59278bcaef934a6b94d5e9cc882e75db (DEFAULT_TABLE table=default.Table_d4f2056b19b145b39c9d355ada53671f [id=5ebf0699d1734c8cbe2580bbea66f36f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.120430 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59278bcaef934a6b94d5e9cc882e75db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.121301 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 70f4777a789a48a18cfadbfb9d49a708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.121714 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 4d14ab205bba4f9d92797d34ab82f13d (DEFAULT_TABLE table=default.Table_bdec13308f734fc98b23b4015fdf0b7f [id=75ef360d45ff45e8b22bf9cded9afb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.122373 11502 tablet_service.cc:1511] Processing CreateTablet for tablet a07f977c6a00450a8e8ceb6580dab980 (DEFAULT_TABLE table=default.Table_d8cc810ec8854fec9b0d3ddb25985f8f [id=c8e55acb8e514a6d871bee98743f0ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.122617 11755 tablet_bootstrap.cc:492] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:59.122720 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07f977c6a00450a8e8ceb6580dab980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.122994 12445 raft_consensus.cc:2804] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:59.123090 12445 raft_consensus.cc:493] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:59.123165 12445 raft_consensus.cc:3060] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.126374 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet c2fe086048c04e0db797272e50f21c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.132102 11753 tablet_bootstrap.cc:492] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:59.134637 11753 ts_tablet_manager.cc:1403] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.066s user 0.005s sys 0.000s
I20260925 01:49:59.135911 11753 raft_consensus.cc:359] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.137228 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 621a4a75ba204a99a9954cd381f712e7 (DEFAULT_TABLE table=default.Table_e119f5d392bc4cae8bf871b63c0f9f40 [id=2e8859565a3d4b87b25737fec97a377c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.136375 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet ca17585cd523440ca1e9b754f3aedf8a with delete_type TABLET_DATA_DELETED (replaced by tablet 01d50e428bfc46caa130f96ccc7e8f40) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.142266 11753 raft_consensus.cc:385] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.143098 11753 raft_consensus.cc:740] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.144134 11753 consensus_queue.cc:260] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.146382 12508 raft_consensus.cc:493] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.146525 12508 raft_consensus.cc:515] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.146765 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 10958
I20260925 01:49:59.147169 12508 leader_election.cc:290] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:59.148360 11021 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 01:49:59.149777 11953 ts_tablet_manager.cc:1929] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:59.149891 11953 log.cc:1199] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/fa619556e5af473998080f4bbc9e5d1e
I20260925 01:49:59.148411 11753 ts_tablet_manager.cc:1434] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260925 01:49:59.151517 11753 tablet_bootstrap.cc:492] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:59.154203 11753 tablet_bootstrap.cc:654] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.164525 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.164863 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.165383 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 6e644bfe06ff4ca89066b1ded01f2b90 (DEFAULT_TABLE table=default.Table_b1e57df563c64536a49824c81a2ab45c [id=d8bf2537974a4656867f245037460af9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.167979 11501 tablet_service.cc:1511] Processing CreateTablet for tablet ab09d980c0814a2f8babc83222f2bc17 (DEFAULT_TABLE table=default.Table_a7d1848c346a4268ace995c919f1be64 [id=98825c86621d4ad783c876d282c4a8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.168632 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab09d980c0814a2f8babc83222f2bc17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.178426 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.179280 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8042784d3ab14285836a008745daabbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.186225 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ea85f72e10443229f5f927bcaf31cb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.188297 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621a4a75ba204a99a9954cd381f712e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.190614 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621a4a75ba204a99a9954cd381f712e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.194517 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38249392c0df4d50b0e09f3671f92800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.179122 11953 ts_tablet_manager.cc:1950] T fa619556e5af473998080f4bbc9e5d1e P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:59.206736 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d14ab205bba4f9d92797d34ab82f13d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.206943 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e644bfe06ff4ca89066b1ded01f2b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.207813 12487 raft_consensus.cc:493] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.207983 12487 raft_consensus.cc:515] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.209904 11946 ts_tablet_manager.cc:1929] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260925 01:49:59.210258 11946 log.cc:1199] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/bb98d5a38f43450c80d057d9eb2f92d1
I20260925 01:49:59.211019 11946 ts_tablet_manager.cc:1950] T bb98d5a38f43450c80d057d9eb2f92d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:59.214018 11351 tablet_service.cc:1511] Processing CreateTablet for tablet ab09d980c0814a2f8babc83222f2bc17 (DEFAULT_TABLE table=default.Table_a7d1848c346a4268ace995c919f1be64 [id=98825c86621d4ad783c876d282c4a8f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.223572 12487 leader_election.cc:290] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:59.225173 11356 tablet_service.cc:1511] Processing CreateTablet for tablet e3b08f61aaf5442889011fe309dea835 (DEFAULT_TABLE table=default.Table_139172e2d0ec420c8c2484e90f7a160b [id=1367e6eebcb04e0c846fd600cf344f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.226459 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 5366f2487b444e12ad9d63d6825d5e97 (DEFAULT_TABLE table=default.Table_a69c32a8461b431d9573c99f2cbf16e2 [id=cc50d6b58dde476d90d95aa4266e8f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.227408 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1a952a0b0caf4fec81d7f1cecb5eb9c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.228176 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a952a0b0caf4fec81d7f1cecb5eb9c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.229475 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 64409139bf964b359ff2be04122c30ce (DEFAULT_TABLE table=default.Table_64f66e588ec44c4a8f677885695767e6 [id=0feace45c16a428c9300d7d29932d0e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.231477 11209 tablet_service.cc:1511] Processing CreateTablet for tablet a07f977c6a00450a8e8ceb6580dab980 (DEFAULT_TABLE table=default.Table_d8cc810ec8854fec9b0d3ddb25985f8f [id=c8e55acb8e514a6d871bee98743f0ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.231892 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07f977c6a00450a8e8ceb6580dab980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.232682 11206 tablet_service.cc:1511] Processing CreateTablet for tablet c48d8e44694b4a2a904ab8c4751efb06 (DEFAULT_TABLE table=default.Table_9064b44c74cd4452be3e52fd938cf131 [id=86530c7257e44a9dbdbbac3b52580efa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.233002 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d8e44694b4a2a904ab8c4751efb06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.234032 11456 leader_election.cc:343] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ca76f6f710d841fd8999b40e5a48693f
I20260925 01:49:59.234241 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab09d980c0814a2f8babc83222f2bc17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.234406 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b08f61aaf5442889011fe309dea835. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.234314 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_13eaf05cb87449d98c6212a88e7147e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.234822 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5366f2487b444e12ad9d63d6825d5e97. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.234884 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13eaf05cb87449d98c6212a88e7147e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.236069 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_51ebd0c312174327b9602cc9358ab16c" } new_table_name: "default.Table_a622c5514c214051a6dbe0ae8749ef6a" modify_external_catalogs: true
W20260925 01:49:59.237066 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 45c06bf5641542f5aa36b160b31d797f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45c06bf5641542f5aa36b160b31d797f already in progress: creating tablet
W20260925 01:49:59.237401 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 already in progress: creating tablet
I20260925 01:49:59.237331 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9f461e15eec54624815b8077dbde7098"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.237630 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet be89c0911dfa4b9d83d6bd88755be2b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be89c0911dfa4b9d83d6bd88755be2b2 already in progress: creating tablet
W20260925 01:49:59.237841 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f461e15eec54624815b8077dbde7098 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.238721 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 59278bcaef934a6b94d5e9cc882e75db (DEFAULT_TABLE table=default.Table_d4f2056b19b145b39c9d355ada53671f [id=5ebf0699d1734c8cbe2580bbea66f36f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:59.244217 11456 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
I20260925 01:49:59.245157 12689 tablet_replica.cc:333] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
W20260925 01:49:59.245158 11456 consensus_peers.cc:597] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55e9d52e3f79408a99216250aefc45c8. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:59.245258 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 152) took 9714 ms. Trace:
I20260925 01:49:59.245349 12689 raft_consensus.cc:2243] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.245496 12689 raft_consensus.cc:2272] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.245744 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet c2fe086048c04e0db797272e50f21c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.246170 12689 ts_tablet_manager.cc:1916] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.246775 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59278bcaef934a6b94d5e9cc882e75db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.247841 11355 tablet_service.cc:1511] Processing CreateTablet for tablet c48d8e44694b4a2a904ab8c4751efb06 (DEFAULT_TABLE table=default.Table_9064b44c74cd4452be3e52fd938cf131 [id=86530c7257e44a9dbdbbac3b52580efa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:59.250626 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d401574e89014d2aaa5f98d0d9a2729f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d401574e89014d2aaa5f98d0d9a2729f already in progress: creating tablet
W20260925 01:49:59.250907 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 already in progress: creating tablet
I20260925 01:49:59.251169 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 307) took 4896 ms. Trace:
I20260925 01:49:59.251252 11946 rpcz_store.cc:276] 0925 01:49:54.315459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.316272 (+ 813us) service_pool.cc:224] Handling call
0925 01:49:59.044135 (+4727863us) ts_tablet_manager.cc:1151] Deleting tablet bb98d5a38f43450c80d057d9eb2f92d1
0925 01:49:59.044143 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.159701 (+115558us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.209839 (+ 50138us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.212048 (+ 2209us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4727690}
I20260925 01:49:59.251755 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet bb98d5a38f43450c80d057d9eb2f92d1 (table default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d]) successfully deleted
I20260925 01:49:59.252146 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 311) took 4917 ms. Trace:
I20260925 01:49:59.252216 11946 rpcz_store.cc:276] 0925 01:49:54.334384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.334455 (+ 71us) service_pool.cc:224] Handling call
0925 01:49:59.252007 (+4917552us) ts_tablet_manager.cc:1151] Deleting tablet a8055cc9b06045449e6133298c8074e1
0925 01:49:59.252019 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.252126 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4917269}
W20260925 01:49:59.252646 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a8055cc9b06045449e6133298c8074e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8055cc9b06045449e6133298c8074e1 already in progress: creating tablet
I20260925 01:49:59.253013 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 313) took 4899 ms. Trace:
I20260925 01:49:59.256215 11946 rpcz_store.cc:276] 0925 01:49:54.353110 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.353174 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:59.252865 (+4899691us) ts_tablet_manager.cc:1151] Deleting tablet 90647937eb364a7a973d04ea69cbc9aa
0925 01:49:59.252875 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.252995 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4899445}
W20260925 01:49:59.256754 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 90647937eb364a7a973d04ea69cbc9aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90647937eb364a7a973d04ea69cbc9aa already in progress: creating tablet
I20260925 01:49:59.257207 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 315) took 4870 ms. Trace:
I20260925 01:49:59.257332 11946 rpcz_store.cc:276] 0925 01:49:54.386380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.394950 (+ 8570us) service_pool.cc:224] Handling call
0925 01:49:59.257089 (+4862139us) ts_tablet_manager.cc:1151] Deleting tablet 85db5688ef064053870a39a906ad9071
0925 01:49:59.257098 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.257191 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4861793}
W20260925 01:49:59.257808 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 85db5688ef064053870a39a906ad9071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85db5688ef064053870a39a906ad9071 already in progress: creating tablet
I20260925 01:49:59.258230 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 316) took 4860 ms. Trace:
I20260925 01:49:59.258342 11946 rpcz_store.cc:276] 0925 01:49:54.398122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.413456 (+ 15334us) service_pool.cc:224] Handling call
0925 01:49:59.258126 (+4844670us) ts_tablet_manager.cc:1151] Deleting tablet b91957f62d8044ea8f6a3464c84b9e10
0925 01:49:59.258134 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.258214 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4844457}
W20260925 01:49:59.258821 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b91957f62d8044ea8f6a3464c84b9e10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91957f62d8044ea8f6a3464c84b9e10 already in progress: creating tablet
I20260925 01:49:59.259212 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 317) took 4828 ms. Trace:
I20260925 01:49:59.259325 11946 rpcz_store.cc:276] 0925 01:49:54.430418 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.431870 (+ 1452us) service_pool.cc:224] Handling call
0925 01:49:59.259119 (+4827249us) ts_tablet_manager.cc:1151] Deleting tablet 80fe96946b294785b8d76564e0f5fa12
0925 01:49:59.259127 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.259197 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4826886}
W20260925 01:49:59.259783 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 80fe96946b294785b8d76564e0f5fa12 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80fe96946b294785b8d76564e0f5fa12 already in progress: creating tablet
I20260925 01:49:59.260123 11946 tablet_replica.cc:333] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.260378 11946 raft_consensus.cc:2243] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.261423 11946 raft_consensus.cc:2272] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.261966 11753 tablet_bootstrap.cc:492] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:59.262146 11753 ts_tablet_manager.cc:1403] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.111s user 0.000s sys 0.018s
I20260925 01:49:59.262940 11753 raft_consensus.cc:359] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.263119 11753 raft_consensus.cc:385] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.263186 11753 raft_consensus.cc:740] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.263372 11946 ts_tablet_manager.cc:1916] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.263398 11753 consensus_queue.cc:260] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.264026 11753 ts_tablet_manager.cc:1434] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:59.264338 11753 tablet_bootstrap.cc:492] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:59.269733 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596f8ddbcd16458aa4f287f4f11282a1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:59.279136 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_75c3e0255c9a431f82d32a7ab3a2a76e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.279914 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75c3e0255c9a431f82d32a7ab3a2a76e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.281104 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "331380a2be9a4893927c9b94a2c3e08b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:59.281301 11380 raft_consensus.cc:3060] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.282691 11353 tablet_service.cc:1511] Processing CreateTablet for tablet a07f977c6a00450a8e8ceb6580dab980 (DEFAULT_TABLE table=default.Table_d8cc810ec8854fec9b0d3ddb25985f8f [id=c8e55acb8e514a6d871bee98743f0ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.283728 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 59278bcaef934a6b94d5e9cc882e75db (DEFAULT_TABLE table=default.Table_d4f2056b19b145b39c9d355ada53671f [id=5ebf0699d1734c8cbe2580bbea66f36f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.245339 11953 rpcz_store.cc:276] 0925 01:49:49.530986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.531038 (+ 52us) service_pool.cc:224] Handling call
0925 01:49:58.493554 (+8962516us) ts_tablet_manager.cc:1151] Deleting tablet fa619556e5af473998080f4bbc9e5d1e
0925 01:49:58.493563 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:58.893157 (+399594us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.149717 (+256560us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.245241 (+ 95524us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8962307}
I20260925 01:49:59.284761 11675 catalog_manager.cc:5838] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } }
I20260925 01:49:59.285233 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
I20260925 01:49:59.285595 11946 ts_tablet_manager.cc:1929] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:59.285717 11946 log.cc:1199] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b98ad0f02eb74eba897040401a164f5c
I20260925 01:49:59.286023 11946 ts_tablet_manager.cc:1950] T b98ad0f02eb74eba897040401a164f5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:59.286340 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0bc7dfa4dadb42fb8d8b5e24e86a2558" } new_table_name: "default.Table_71d7f580cbd84e62a58706a6e1b9b1e4" modify_external_catalogs: true
I20260925 01:49:59.287904 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 321) took 4755 ms. Trace:
I20260925 01:49:59.287886 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5218ba01b3f44905b240a69ebbd6d9f8" } modify_external_catalogs: true
I20260925 01:49:59.288092 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5218ba01b3f44905b240a69ebbd6d9f8" } modify_external_catalogs: true
I20260925 01:49:59.287994 11946 rpcz_store.cc:276] 0925 01:49:54.532781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.532870 (+ 89us) service_pool.cc:224] Handling call
0925 01:49:59.260080 (+4727210us) ts_tablet_manager.cc:1151] Deleting tablet b98ad0f02eb74eba897040401a164f5c
0925 01:49:59.260088 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.267220 (+ 7132us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.285533 (+ 18313us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.287882 (+ 2349us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4723736}
I20260925 01:49:59.288398 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48d8e44694b4a2a904ab8c4751efb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.288579 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59278bcaef934a6b94d5e9cc882e75db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.288564 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b98ad0f02eb74eba897040401a164f5c (table default.Table_f12eeda830be434fbc7fa9b8827978d4 [id=ded734199b0246ab9f10a405170b0091]) successfully deleted
I20260925 01:49:59.289794 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64409139bf964b359ff2be04122c30ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.290036 11946 tablet_replica.cc:333] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.290553 11946 raft_consensus.cc:2243] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.291031 11946 raft_consensus.cc:2272] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.293314 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07f977c6a00450a8e8ceb6580dab980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.293421 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet fa619556e5af473998080f4bbc9e5d1e (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]) successfully deleted
I20260925 01:49:59.294169 11946 ts_tablet_manager.cc:1916] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.294196 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 153) took 9762 ms. Trace:
I20260925 01:49:59.294281 11953 rpcz_store.cc:276] 0925 01:49:49.531436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.531474 (+ 38us) service_pool.cc:224] Handling call
0925 01:49:59.284436 (+9752962us) ts_tablet_manager.cc:1151] Deleting tablet 93329036763146beb8e6a9b039cc1ec1
0925 01:49:59.284444 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.294174 (+ 9730us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9752767}
I20260925 01:49:59.294611 11953 tablet_replica.cc:333] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:59.294863 11953 raft_consensus.cc:2243] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.295035 11953 raft_consensus.cc:2272] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.295567 11953 ts_tablet_manager.cc:1916] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.303885 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7eee30b35eb94fa196e9ccd1de37175a
I20260925 01:49:59.304875 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a1355a6457f9415093fde818d0226dd7" } new_table_name: "default.Table_8e4a66ea46ca4aab97b4dda13f04a5b2" modify_external_catalogs: true
I20260925 01:49:59.305078 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eee30b35eb94fa196e9ccd1de37175a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.309140 11946 ts_tablet_manager.cc:1929] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:59.312367 11946 log.cc:1199] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ba19192502634f8599407d923114a627
I20260925 01:49:59.313107 11946 ts_tablet_manager.cc:1950] T ba19192502634f8599407d923114a627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:59.315025 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 322) took 4778 ms. Trace:
I20260925 01:49:59.315752 11946 rpcz_store.cc:276] 0925 01:49:54.536537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.536640 (+ 103us) service_pool.cc:224] Handling call
0925 01:49:59.289983 (+4753343us) ts_tablet_manager.cc:1151] Deleting tablet ba19192502634f8599407d923114a627
0925 01:49:59.289994 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.303602 (+ 13608us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.309082 (+ 5480us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.315002 (+ 5920us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4745894}
I20260925 01:49:59.292779 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca76f6f710d841fd8999b40e5a48693f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:49:59.316284 11372 raft_consensus.cc:3060] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:49:59.304260 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b28192e3b45e7b5370d55804cb043" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:59.316749 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ba19192502634f8599407d923114a627 (table default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915]) successfully deleted
I20260925 01:49:59.317229 11946 tablet_replica.cc:333] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.317523 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b07f6029133f4c1598ae22b43dc3a7cb" } modify_external_catalogs: true
I20260925 01:49:59.317670 11946 raft_consensus.cc:2243] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.317698 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b07f6029133f4c1598ae22b43dc3a7cb" } modify_external_catalogs: true
I20260925 01:49:59.317826 11946 raft_consensus.cc:2272] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.318426 11946 ts_tablet_manager.cc:1916] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.318526 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_02a831c4d17044d8b03bad381ad3327a" } modify_external_catalogs: true
I20260925 01:49:59.318703 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_02a831c4d17044d8b03bad381ad3327a" } modify_external_catalogs: true
W20260925 01:49:59.320051 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f92450c05b394603ba475328d5a3eb71 consensus state has no leader
I20260925 01:49:59.320397 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2b63b653cd24456594dea1d971c6a930" } new_table_name: "default.Table_23c2c72963784e6b91bed0595827abe2" modify_external_catalogs: true
I20260925 01:49:59.321933 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1952d6b4149e47b994684a0bbdd45b2f" } new_table_name: "default.Table_408d8b2c40464a69b5427f4713abff09" modify_external_catalogs: true
I20260925 01:49:59.326794 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eee30b35eb94fa196e9ccd1de37175a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:59.332114 11347 consensus_meta.cc:287] T c3e2709b3b0f4157938d8d8bca8a7b10 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent flushing consensus metadata: real 1.024s user 0.024s sys 0.002s
I20260925 01:49:59.332420 11347 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40776 (request call id 439) took 1156 ms. Trace:
I20260925 01:49:59.332513 11347 rpcz_store.cc:276] 0925 01:49:58.176024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.176825 (+ 801us) service_pool.cc:224] Handling call
0925 01:49:58.185780 (+ 8955us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:58.185807 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:58.308324 (+122517us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.332274 (+1023950us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:59.332403 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:49:59.333019 11946 ts_tablet_manager.cc:1929] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:59.335265 11946 log.cc:1199] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ca76f6f710d841fd8999b40e5a48693f
I20260925 01:49:59.335902 11946 ts_tablet_manager.cc:1950] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:59.336853 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 329) took 4734 ms. Trace:
I20260925 01:49:59.338105 11753 tablet_bootstrap.cc:654] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.337634 11946 rpcz_store.cc:276] 0925 01:49:54.602738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.602796 (+ 58us) service_pool.cc:224] Handling call
0925 01:49:59.317173 (+4714377us) ts_tablet_manager.cc:1151] Deleting tablet ca76f6f710d841fd8999b40e5a48693f
0925 01:49:59.317185 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.321543 (+ 4358us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.332940 (+ 11397us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.336829 (+ 3889us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4713663}
I20260925 01:49:59.338946 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ca76f6f710d841fd8999b40e5a48693f (table default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87]) successfully deleted
I20260925 01:49:59.339835 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 333) took 4457 ms. Trace:
I20260925 01:49:59.340998 11946 rpcz_store.cc:276] 0925 01:49:54.882715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.883145 (+ 430us) service_pool.cc:224] Handling call
0925 01:49:59.339664 (+4456519us) ts_tablet_manager.cc:1151] Deleting tablet 9f7f7ee517df483b83d1627cdb6f9433
0925 01:49:59.339678 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.339810 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4431782}
W20260925 01:49:59.342152 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9f7f7ee517df483b83d1627cdb6f9433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7f7ee517df483b83d1627cdb6f9433 already in progress: creating tablet
I20260925 01:49:59.342798 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 338) took 4416 ms. Trace:
I20260925 01:49:59.343309 11946 rpcz_store.cc:276] 0925 01:49:54.925923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.926042 (+ 119us) service_pool.cc:224] Handling call
0925 01:49:59.342645 (+4416603us) ts_tablet_manager.cc:1151] Deleting tablet abcb285ebc1a4bfd8317546823e01b09
0925 01:49:59.342660 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.342776 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4406008}
W20260925 01:49:59.344336 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet abcb285ebc1a4bfd8317546823e01b09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abcb285ebc1a4bfd8317546823e01b09 already in progress: creating tablet
I20260925 01:49:59.344353 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 7eee30b35eb94fa196e9ccd1de37175a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.344914 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 340) took 4394 ms. Trace:
I20260925 01:49:59.345362 11946 rpcz_store.cc:276] 0925 01:49:54.950557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.950676 (+ 119us) service_pool.cc:224] Handling call
0925 01:49:59.344779 (+4394103us) ts_tablet_manager.cc:1151] Deleting tablet 0e3ba459a81845699435c2e44f5c9f19
0925 01:49:59.344792 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.344894 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4385676}
I20260925 01:49:59.346210 11754 tablet_bootstrap.cc:492] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:59.346361 11754 ts_tablet_manager.cc:1403] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.372s user 0.044s sys 0.067s
W20260925 01:49:59.348206 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 0e3ba459a81845699435c2e44f5c9f19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e3ba459a81845699435c2e44f5c9f19 already in progress: creating tablet
I20260925 01:49:59.350838 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 342) took 4138 ms. Trace:
I20260925 01:49:59.350998 11946 rpcz_store.cc:276] 0925 01:49:55.213969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.214233 (+ 264us) service_pool.cc:224] Handling call
0925 01:49:59.350672 (+4136439us) ts_tablet_manager.cc:1151] Deleting tablet 0749a0ae58df4ff8b74a86f072332fad
0925 01:49:59.350687 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.350813 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4078343}
I20260925 01:49:59.351476 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 344) took 3912 ms. Trace:
W20260925 01:49:59.351643 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 0749a0ae58df4ff8b74a86f072332fad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0749a0ae58df4ff8b74a86f072332fad already in progress: creating tablet
I20260925 01:49:59.351626 11946 rpcz_store.cc:276] 0925 01:49:55.438598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.438651 (+ 53us) service_pool.cc:224] Handling call
0925 01:49:59.351376 (+3912725us) ts_tablet_manager.cc:1151] Deleting tablet 113d7ccee4e349e19d3948e09d2c533d
0925 01:49:59.351386 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.351460 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3901000}
W20260925 01:49:59.352087 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 113d7ccee4e349e19d3948e09d2c533d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113d7ccee4e349e19d3948e09d2c533d already in progress: creating tablet
I20260925 01:49:59.352423 11946 tablet_replica.cc:333] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.352660 11946 raft_consensus.cc:2243] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.352898 11946 raft_consensus.cc:2272] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.353513 11946 ts_tablet_manager.cc:1916] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.353751 11753 tablet_bootstrap.cc:492] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:59.353952 11753 ts_tablet_manager.cc:1403] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.000s
I20260925 01:49:59.357116 11753 raft_consensus.cc:359] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.357357 11753 raft_consensus.cc:385] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.357589 11753 raft_consensus.cc:740] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.357923 11753 consensus_queue.cc:260] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.360100 11753 ts_tablet_manager.cc:1434] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:49:59.360469 11753 tablet_bootstrap.cc:492] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:59.362454 11755 tablet_bootstrap.cc:654] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.374008 11946 ts_tablet_manager.cc:1929] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:49:59.373896 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bb53a1f08ea54ba89eda67a179045293"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.374529 11946 log.cc:1199] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/86079f22abb74d438c61ecc2a7379cbd
W20260925 01:49:59.374665 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb53a1f08ea54ba89eda67a179045293 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.375097 11946 ts_tablet_manager.cc:1950] T 86079f22abb74d438c61ecc2a7379cbd P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:59.375998 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 345) took 3889 ms. Trace:
I20260925 01:49:59.376127 11946 rpcz_store.cc:276] 0925 01:49:55.486993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.487077 (+ 84us) service_pool.cc:224] Handling call
0925 01:49:59.352377 (+3865300us) ts_tablet_manager.cc:1151] Deleting tablet 86079f22abb74d438c61ecc2a7379cbd
0925 01:49:59.352385 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.357657 (+ 5272us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.373944 (+ 16287us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.375979 (+ 2035us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3863229}
I20260925 01:49:59.376716 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 352) took 3624 ms. Trace:
I20260925 01:49:59.376947 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 86079f22abb74d438c61ecc2a7379cbd (table default.Table_acb7d558d3a9463e9cef61036b44d1c1 [id=0d689fa6870547f3a57c6b6149b94754]) successfully deleted
I20260925 01:49:59.376897 11946 rpcz_store.cc:276] 0925 01:49:55.752810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.752898 (+ 88us) service_pool.cc:224] Handling call
0925 01:49:59.376501 (+3623603us) ts_tablet_manager.cc:1151] Deleting tablet 31ffb404d93a4436ba9e624b45650fe1
0925 01:49:59.376511 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.376698 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3623322}
W20260925 01:49:59.377429 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 31ffb404d93a4436ba9e624b45650fe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ffb404d93a4436ba9e624b45650fe1 already in progress: creating tablet
I20260925 01:49:59.377864 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 353) took 3582 ms. Trace:
I20260925 01:49:59.377980 11946 rpcz_store.cc:276] 0925 01:49:55.795837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.796086 (+ 249us) service_pool.cc:224] Handling call
0925 01:49:59.377755 (+3581669us) ts_tablet_manager.cc:1151] Deleting tablet d12d2cf8c4744858bf0967eeec72f381
0925 01:49:59.377764 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.377846 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3552322}
W20260925 01:49:59.378561 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d12d2cf8c4744858bf0967eeec72f381 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d12d2cf8c4744858bf0967eeec72f381 already in progress: creating tablet
I20260925 01:49:59.378970 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 354) took 3529 ms. Trace:
I20260925 01:49:59.379087 11946 rpcz_store.cc:276] 0925 01:49:55.849099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.849207 (+ 108us) service_pool.cc:224] Handling call
0925 01:49:59.378870 (+3529663us) ts_tablet_manager.cc:1151] Deleting tablet b61b1bf5a8d446918edc6d166b7712ef
0925 01:49:59.378879 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.378954 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3529347}
W20260925 01:49:59.379910 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b61b1bf5a8d446918edc6d166b7712ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b61b1bf5a8d446918edc6d166b7712ef already in progress: creating tablet
I20260925 01:49:59.380497 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 356) took 3494 ms. Trace:
I20260925 01:49:59.380628 11946 rpcz_store.cc:276] 0925 01:49:55.886434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.886906 (+ 472us) service_pool.cc:224] Handling call
0925 01:49:59.380327 (+3493421us) ts_tablet_manager.cc:1151] Deleting tablet d3150980bb72435886486156aa98d342
0925 01:49:59.380396 (+ 69us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.380480 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3493086}
W20260925 01:49:59.381292 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d3150980bb72435886486156aa98d342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3150980bb72435886486156aa98d342 already in progress: creating tablet
I20260925 01:49:59.382658 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 359) took 3410 ms. Trace:
I20260925 01:49:59.382906 11946 rpcz_store.cc:276] 0925 01:49:55.972358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.972430 (+ 72us) service_pool.cc:224] Handling call
0925 01:49:59.382522 (+3410092us) ts_tablet_manager.cc:1151] Deleting tablet 236db241476a4a609869aad539fee426
0925 01:49:59.382531 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.382639 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3409815}
W20260925 01:49:59.383512 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 236db241476a4a609869aad539fee426 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 236db241476a4a609869aad539fee426 already in progress: creating tablet
I20260925 01:49:59.383869 11946 tablet_replica.cc:333] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.384115 11946 raft_consensus.cc:2243] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.384369 11946 raft_consensus.cc:2272] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.385207 11946 ts_tablet_manager.cc:1916] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:59.386401 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6386bd0cb4894068985fe152299f0b47 consensus state has no leader
W20260925 01:49:59.386953 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e1d19fcc7804baa94da9fa2b25cdfe3 consensus state has no leader
I20260925 01:49:59.387516 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f78a88f277724061b29c49a4de82da50" } modify_external_catalogs: true
I20260925 01:49:59.387835 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f78a88f277724061b29c49a4de82da50" } modify_external_catalogs: true
W20260925 01:49:59.390460 11456 consensus_peers.cc:597] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfa2e2d4bfe14b5db5b1dfd67e19f11c. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:59.389479 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596f8ddbcd16458aa4f287f4f11282a1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:59.390841 11676 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:49:59.392436 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 644b28192e3b45e7b5370d55804cb043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.392855 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.394622 12445 raft_consensus.cc:515] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.395255 12445 leader_election.cc:290] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:59.397898 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet cb7bac6e89b8405e8bd541eba6278a0b
W20260925 01:49:59.399155 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e90b7aae9cc41a3a795f601e784d34c has no consensus state
W20260925 01:49:59.399757 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fcb56153a802427aaebbf55a8193d62b consensus state has no leader
I20260925 01:49:59.400736 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet cb7bac6e89b8405e8bd541eba6278a0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.402737 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet cb7bac6e89b8405e8bd541eba6278a0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.409416 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c3e2709b3b0f4157938d8d8bca8a7b10
I20260925 01:49:59.411288 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet c3e2709b3b0f4157938d8d8bca8a7b10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.408077 11754 raft_consensus.cc:359] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.413100 11754 raft_consensus.cc:385] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.413177 11754 raft_consensus.cc:740] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.413393 11754 consensus_queue.cc:260] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.414462 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet c3e2709b3b0f4157938d8d8bca8a7b10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.418133 11754 ts_tablet_manager.cc:1434] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.072s user 0.003s sys 0.000s
I20260925 01:49:59.430716 11953 ts_tablet_manager.cc:1929] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:59.430872 11953 log.cc:1199] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/cedc909f3c864a7cbbd12dbdfb3315ec
I20260925 01:49:59.431574 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:49:59.435761 11754 tablet_bootstrap.cc:492] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:59.441315 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
I20260925 01:49:59.442106 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:49:59.449079 11212 tablet_service.cc:1511] Processing CreateTablet for tablet bd22b1eb643f4229a65566493e21d96c (DEFAULT_TABLE table=default.Table_dd2fbf6d10f744cd86b10091a53b0372 [id=9275d83c8912462fb06a2f58229c5eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.449542 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd22b1eb643f4229a65566493e21d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.452539 11217 tablet_service.cc:1511] Processing CreateTablet for tablet bc99f3613c354d68bfde33e04dc1e9ab (DEFAULT_TABLE table=default.Table_b29d5c3e7011407a920707f27614b3de [id=4fbd33ce9dc14df583082451e1532b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.453971 11222 tablet_service.cc:1511] Processing CreateTablet for tablet afa1558aea804bfc910fe699335eda24 (DEFAULT_TABLE table=default.Table_bd05ebe158af4ec9bf154690b3008162 [id=4ce896b83ce84c25aa2ed19e910b7435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.454185 11210 tablet_service.cc:1511] Processing CreateTablet for tablet fe947074863044c1a8640092735a51fc (DEFAULT_TABLE table=default.Table_7dad99b3f361482389400168bbd281d8 [id=d6c6f9e02b934baeb448b4e865050498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.454416 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa1558aea804bfc910fe699335eda24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.455096 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe947074863044c1a8640092735a51fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.456682 11753 tablet_bootstrap.cc:654] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.462852 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 86f3f75784af42f6b14b919815ab1890 (DEFAULT_TABLE table=default.Table_7825567ce8ce424aab880bd345cf3c3d [id=17bb8fb2387b44d2abba99690d0c4752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.463135 11489 tablet_service.cc:1511] Processing CreateTablet for tablet bd22b1eb643f4229a65566493e21d96c (DEFAULT_TABLE table=default.Table_dd2fbf6d10f744cd86b10091a53b0372 [id=9275d83c8912462fb06a2f58229c5eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.462852 11486 tablet_service.cc:1511] Processing CreateTablet for tablet fe947074863044c1a8640092735a51fc (DEFAULT_TABLE table=default.Table_7dad99b3f361482389400168bbd281d8 [id=d6c6f9e02b934baeb448b4e865050498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.463573 11491 tablet_service.cc:1511] Processing CreateTablet for tablet bc99f3613c354d68bfde33e04dc1e9ab (DEFAULT_TABLE table=default.Table_b29d5c3e7011407a920707f27614b3de [id=4fbd33ce9dc14df583082451e1532b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.463930 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f3f75784af42f6b14b919815ab1890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.464082 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 1e440a8413e945ab9ea793a2016f2ee8 (DEFAULT_TABLE table=default.Table_c8919df13a3e476cb936abc0b4625aae [id=c44d0313c36549bd9bacce856e3cdc3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.464545 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e440a8413e945ab9ea793a2016f2ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.466279 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc99f3613c354d68bfde33e04dc1e9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.471817 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd22b1eb643f4229a65566493e21d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.471712 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 0226f482c8ff49ce976490e6aadfcee4 (DEFAULT_TABLE table=default.Table_beb6ee96dba041d6a7c99c5d8dc3a403 [id=2ff4712cd156430ba7afae4d42c203e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.473611 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5e1d832978450487009a8ff3eaec71 (DEFAULT_TABLE table=default.Table_3e1405f7d12447309d5dbebd0aa43adc [id=6a2da4de6ade49789ae45229b993ece4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.474221 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe947074863044c1a8640092735a51fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.475328 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 86f3f75784af42f6b14b919815ab1890 (DEFAULT_TABLE table=default.Table_7825567ce8ce424aab880bd345cf3c3d [id=17bb8fb2387b44d2abba99690d0c4752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.476780 11502 tablet_service.cc:1511] Processing CreateTablet for tablet afa1558aea804bfc910fe699335eda24 (DEFAULT_TABLE table=default.Table_bd05ebe158af4ec9bf154690b3008162 [id=4ce896b83ce84c25aa2ed19e910b7435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.477219 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa1558aea804bfc910fe699335eda24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.479080 11205 tablet_service.cc:1511] Processing CreateTablet for tablet a1996d50e7874f769bcd8c277a14a082 (DEFAULT_TABLE table=default.Table_775faf150b3041519250a4f17a5bdae1 [id=e40d982f5010435db1e54349166e2591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.480784 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5e1d832978450487009a8ff3eaec71 (DEFAULT_TABLE table=default.Table_3e1405f7d12447309d5dbebd0aa43adc [id=6a2da4de6ade49789ae45229b993ece4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.481112 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5e1d832978450487009a8ff3eaec71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.485431 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 0492ea6f9d0a4cdf9e339920863b54f9 (DEFAULT_TABLE table=default.Table_6734b38bddb6462f81a668efbe01fad0 [id=977b69f7df2c41cab43ee3498fb261c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.486456 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 0226f482c8ff49ce976490e6aadfcee4 (DEFAULT_TABLE table=default.Table_beb6ee96dba041d6a7c99c5d8dc3a403 [id=2ff4712cd156430ba7afae4d42c203e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.486963 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0226f482c8ff49ce976490e6aadfcee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.490253 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 9b75b12794fa4f4fa53156c212632cdc (DEFAULT_TABLE table=default.Table_a9106d4e06b248f9ae0595a67271be8a [id=818ef8f0b2ca46c8b49358df930297c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.490671 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 4e90b7aae9cc41a3a795f601e784d34c (DEFAULT_TABLE table=default.Table_23c2c72963784e6b91bed0595827abe2 [id=de8e5bde62c04f7c9433f49f51a6945d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.490760 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 9845a915c8b94fff8660e2e7e86731f3 (DEFAULT_TABLE table=default.Table_5fb6a5e0ac944a3bacc808d58b0d6c7e [id=13825238e94d418694c22d3d5aefb4e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.492117 11380 raft_consensus.cc:2468] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:59.493378 11372 raft_consensus.cc:2468] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 2.
I20260925 01:49:59.495203 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1880d96ed37f4485be6f8a12f050866e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.495951 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1880d96ed37f4485be6f8a12f050866e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.496381 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e4f96795b3f4431982381d0b4c300ce6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.496922 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4f96795b3f4431982381d0b4c300ce6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.497448 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0226f482c8ff49ce976490e6aadfcee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.497753 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1996d50e7874f769bcd8c277a14a082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.499183 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_04da09b466584f5086ee515c0c9bc634"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.499706 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04da09b466584f5086ee515c0c9bc634 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.500983 11953 ts_tablet_manager.cc:1950] T cedc909f3c864a7cbbd12dbdfb3315ec P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:59.501736 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0492ea6f9d0a4cdf9e339920863b54f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.504500 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 154) took 9972 ms. Trace:
I20260925 01:49:59.504597 11953 rpcz_store.cc:276] 0925 01:49:49.531872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.531920 (+ 48us) service_pool.cc:224] Handling call
0925 01:49:59.294567 (+9762647us) ts_tablet_manager.cc:1151] Deleting tablet cedc909f3c864a7cbbd12dbdfb3315ec
0925 01:49:59.294576 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.359724 (+ 65148us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.430620 (+ 70896us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.504482 (+ 73862us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9762462}
I20260925 01:49:59.505031 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 160) took 9872 ms. Trace:
I20260925 01:49:59.505251 11953 rpcz_store.cc:276] 0925 01:49:49.632773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.632838 (+ 65us) service_pool.cc:224] Handling call
0925 01:49:59.504923 (+9872085us) ts_tablet_manager.cc:1151] Deleting tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b
0925 01:49:59.504932 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.505016 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9871829}
I20260925 01:49:59.506418 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b75b12794fa4f4fa53156c212632cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.507539 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 162) took 9714 ms. Trace:
I20260925 01:49:59.507608 11953 rpcz_store.cc:276] 0925 01:49:49.793339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.799228 (+ 5889us) service_pool.cc:224] Handling call
0925 01:49:59.505470 (+9706242us) ts_tablet_manager.cc:1151] Deleting tablet a9068770de0b473488bd8ea4752fb15d
0925 01:49:59.505478 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.507520 (+ 2042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9705662}
I20260925 01:49:59.508123 11755 tablet_bootstrap.cc:492] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:59.508240 11755 ts_tablet_manager.cc:1403] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.386s user 0.002s sys 0.005s
I20260925 01:49:59.509667 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 167) took 9691 ms. Trace:
I20260925 01:49:59.509755 11953 rpcz_store.cc:276] 0925 01:49:49.818512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.818575 (+ 63us) service_pool.cc:224] Handling call
0925 01:49:59.507864 (+9689289us) ts_tablet_manager.cc:1151] Deleting tablet c7944aa1ac8f4c5d8ea3aa2acae41257
0925 01:49:59.507891 (+ 27us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.509647 (+ 1756us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9689064}
I20260925 01:49:59.510192 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 168) took 9415 ms. Trace:
I20260925 01:49:59.510272 11953 rpcz_store.cc:276] 0925 01:49:50.094696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.095043 (+ 347us) service_pool.cc:224] Handling call
0925 01:49:59.510031 (+9414988us) ts_tablet_manager.cc:1151] Deleting tablet 2e96576354fe46bf9bfcde18f0a53390
0925 01:49:59.510041 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.510173 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9414744}
I20260925 01:49:59.510617 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 169) took 9407 ms. Trace:
I20260925 01:49:59.510687 11953 rpcz_store.cc:276] 0925 01:49:50.103559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.103638 (+ 79us) service_pool.cc:224] Handling call
0925 01:49:59.510500 (+9406862us) ts_tablet_manager.cc:1151] Deleting tablet 85d859207bbc4aefb26c726dce404c44
0925 01:49:59.510510 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.510601 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9406607}
I20260925 01:49:59.510954 11953 tablet_replica.cc:333] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:59.510969 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e99b81ca19e74a4d9f6a5cb474507f7f" } modify_external_catalogs: true
I20260925 01:49:59.511188 11953 raft_consensus.cc:2243] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.511174 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e99b81ca19e74a4d9f6a5cb474507f7f" } modify_external_catalogs: true
I20260925 01:49:59.511354 11953 raft_consensus.cc:2272] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.511794 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e90b7aae9cc41a3a795f601e784d34c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.511952 11338 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 215) took 2222 ms. Trace:
I20260925 01:49:59.512063 12640 raft_consensus.cc:493] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.512042 11338 rpcz_store.cc:276] 0925 01:49:57.279395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.281536 (+ 2141us) service_pool.cc:224] Handling call
0925 01:49:57.334163 (+ 52627us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x6160001c6130. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c762b72c3 00007f1c78deb008 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.506812 (+172649us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x6160001d2a30. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c762b72c3 00007f1c78deb008 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.610814 (+104002us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x6160000d7c30. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c762b72c3 00007f1c78deb008 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.670419 (+ 59605us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x6160001e1654. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.738346 (+ 67927us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x6160000a2154. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.294821 (+556475us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x61800010308c. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c764c0b1e 00007f1c762b755c 00007f1c78deb008 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8
0925 01:49:58.340781 (+ 45960us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x6160000e2054. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:59.501437 (+1160656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325534336}
I20260925 01:49:59.512183 12640 raft_consensus.cc:515] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.512771 12640 leader_election.cc:290] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:59.514292 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9845a915c8b94fff8660e2e7e86731f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.514484 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5e1d832978450487009a8ff3eaec71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.515316 11336 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 213) took 2236 ms. Trace:
I20260925 01:49:59.515415 11336 rpcz_store.cc:276] 0925 01:49:57.279143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.279221 (+ 78us) service_pool.cc:224] Handling call
0925 01:49:58.430815 (+1151594us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x618000080c8c. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c764c0b1e 00007f1c762b755c 00007f1c78deb008 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8
0925 01:49:59.013816 (+583001us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x616000111454. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:59.419731 (+405915us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x616000132154. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:59.493698 (+ 73967us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x616000171454. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:59.515296 (+ 21598us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347646080}
I20260925 01:49:59.515460 11497 tablet_service.cc:1511] Processing CreateTablet for tablet a1996d50e7874f769bcd8c277a14a082 (DEFAULT_TABLE table=default.Table_775faf150b3041519250a4f17a5bdae1 [id=e40d982f5010435db1e54349166e2591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.515543 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 4e90b7aae9cc41a3a795f601e784d34c (DEFAULT_TABLE table=default.Table_23c2c72963784e6b91bed0595827abe2 [id=de8e5bde62c04f7c9433f49f51a6945d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.515893 11953 ts_tablet_manager.cc:1916] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.515974 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1996d50e7874f769bcd8c277a14a082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.518391 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 0492ea6f9d0a4cdf9e339920863b54f9 (DEFAULT_TABLE table=default.Table_6734b38bddb6462f81a668efbe01fad0 [id=977b69f7df2c41cab43ee3498fb261c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.518788 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 9b75b12794fa4f4fa53156c212632cdc (DEFAULT_TABLE table=default.Table_a9106d4e06b248f9ae0595a67271be8a [id=818ef8f0b2ca46c8b49358df930297c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.519186 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0492ea6f9d0a4cdf9e339920863b54f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.519338 11755 raft_consensus.cc:359] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.519550 11755 raft_consensus.cc:385] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.519608 11755 raft_consensus.cc:740] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.519815 11755 consensus_queue.cc:260] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.520558 11755 ts_tablet_manager.cc:1434] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:49:59.520856 11755 tablet_bootstrap.cc:492] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:59.522265 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b75b12794fa4f4fa53156c212632cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.524447 11755 tablet_bootstrap.cc:654] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:49:59.525923 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 255896us
I20260925 01:49:59.526293 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e90b7aae9cc41a3a795f601e784d34c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.529897 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8aa8c36ce7d045509f360f2d180be25d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.530191 11340 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 216) took 2239 ms. Trace:
I20260925 01:49:59.530233 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a9106d4e06b248f9ae0595a67271be8a" } new_table_name: "default.Table_2f72d02df1f14430b93be79f75e09cba" modify_external_catalogs: true
I20260925 01:49:59.530278 11340 rpcz_store.cc:276] 0925 01:49:57.279494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.279588 (+ 94us) service_pool.cc:224] Handling call
0925 01:49:57.500726 (+221138us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x6160001d2a30. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c762b72c3 00007f1c78deb008 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.689927 (+189201us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x6160000a2154. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:57.751413 (+ 61486us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x616000173c30. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c762b72c3 00007f1c78deb008 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.233384 (+481971us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x616000131b54. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.241643 (+ 8259us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x61800004108c. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 0000000000a289b0 00007f1c78deb321 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:58.341072 (+ 99429us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x6160000e2054. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:49:59.518494 (+1177422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708391424}
W20260925 01:49:59.530615 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aa8c36ce7d045509f360f2d180be25d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.532254 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f3f75784af42f6b14b919815ab1890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.544011 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fb1a77602ae243208b79f5f91292701e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.544916 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb1a77602ae243208b79f5f91292701e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.548748 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 1e440a8413e945ab9ea793a2016f2ee8 (DEFAULT_TABLE table=default.Table_c8919df13a3e476cb936abc0b4625aae [id=c44d0313c36549bd9bacce856e3cdc3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.549206 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e440a8413e945ab9ea793a2016f2ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.551786 11517 raft_consensus.cc:3060] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.552044 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:49:59.553771 11457 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:59.553930 11457 leader_election.cc:304] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.553915 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d0fc550ce5ff4bdf9c47eaa60bc71b36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.554539 12640 raft_consensus.cc:2749] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:59.554625 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0fc550ce5ff4bdf9c47eaa60bc71b36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.554940 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e572f77e242d799c334820579268d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:59.555105 11238 raft_consensus.cc:3060] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.555428 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e572f77e242d799c334820579268d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:59.555596 11519 raft_consensus.cc:3060] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.560335 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 9845a915c8b94fff8660e2e7e86731f3 (DEFAULT_TABLE table=default.Table_5fb6a5e0ac944a3bacc808d58b0d6c7e [id=13825238e94d418694c22d3d5aefb4e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.560770 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9845a915c8b94fff8660e2e7e86731f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.564791 11755 tablet_bootstrap.cc:492] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:59.564949 11755 ts_tablet_manager.cc:1403] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.006s
I20260925 01:49:59.566205 11755 raft_consensus.cc:359] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.566385 11755 raft_consensus.cc:385] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.566437 11755 raft_consensus.cc:740] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.566660 11755 consensus_queue.cc:260] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.566725 11457 leader_election.cc:304] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:49:59.566984 11457 raft_consensus.cc:2686] T ca76f6f710d841fd8999b40e5a48693f P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:49:59.567234 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5c1c05b5a87e43d38a24f63242415fd7
I20260925 01:49:59.567442 11755 ts_tablet_manager.cc:1434] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:59.567662 11457 leader_election.cc:304] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.567754 11755 tablet_bootstrap.cc:492] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:59.568234 12508 raft_consensus.cc:2804] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:59.568352 12508 raft_consensus.cc:697] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:59.568579 12508 consensus_queue.cc:237] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.571383 11519 raft_consensus.cc:2468] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:59.573993 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9f7639fd1f1149a7973eba0c77bd7065
I20260925 01:49:59.574685 12704 raft_consensus.cc:493] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:49:59.574843 12704 raft_consensus.cc:515] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:59.574928 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_25e20db647ea459db860551fd250139b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.575433 12704 leader_election.cc:290] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:49:59.575707 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25e20db647ea459db860551fd250139b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.577857 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.578578 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.581351 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e457c4ab4e814fc4be11ced6ca69284f
I20260925 01:49:59.581566 11755 tablet_bootstrap.cc:654] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.584460 11519 raft_consensus.cc:3060] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.585155 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9ec319c6e6fc4eb99b24cd6c3108082b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.585897 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ec319c6e6fc4eb99b24cd6c3108082b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.586211 11754 tablet_bootstrap.cc:654] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.591445 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ba84ef815eb14b9f845a5dc6ae6af351" } new_table_name: "default.Table_10c5ec3219c8401f81c2ee6b0013e4c3" modify_external_catalogs: true
I20260925 01:49:59.592882 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2bd8fecb1710484f8d3db44a6385718c" } new_table_name: "default.Table_af512ab1da7a45759866fe1ded30cc15" modify_external_catalogs: true
I20260925 01:49:59.598605 11953 ts_tablet_manager.cc:1929] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:59.598829 11953 log.cc:1199] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/b05053f5646f4748a99647b7dbfae686
I20260925 01:49:59.599790 11953 ts_tablet_manager.cc:1950] T b05053f5646f4748a99647b7dbfae686 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:59.600226 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 171) took 9308 ms. Trace:
I20260925 01:49:59.600347 11953 rpcz_store.cc:276] 0925 01:49:50.291667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.291861 (+ 194us) service_pool.cc:224] Handling call
0925 01:49:59.510907 (+9219046us) ts_tablet_manager.cc:1151] Deleting tablet b05053f5646f4748a99647b7dbfae686
0925 01:49:59.510917 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.554021 (+ 43104us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.598535 (+ 44514us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.600206 (+ 1671us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9208176}
I20260925 01:49:59.600903 11953 tablet_replica.cc:333] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:59.603643 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
I20260925 01:49:59.603907 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:49:59.605013 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a5cb3c3da42d49eda4923be1eeea6988" } new_table_name: "default.Table_c96bd3104c0d439d92cfbd1d5be90f48" modify_external_catalogs: true
I20260925 01:49:59.605491 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1cdf87a2bed04ce0a5ad9c7eda026822" } new_table_name: "default.Table_6b0927490fa04b2e9766f07ec9ca0e2a" modify_external_catalogs: true
I20260925 01:49:59.624310 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet cedc909f3c864a7cbbd12dbdfb3315ec (table default.Table_21851b803fd649039364f99310471653 [id=c452e2cd091349ca85e86d2f5aafa6b7]) successfully deleted
I20260925 01:49:59.624497 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c1c05b5a87e43d38a24f63242415fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:49:59.624873 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b0ad8ca37e3c49a4a03fc3460bf0bc5b because the tablet was not found. No further retry: Not found: Tablet not found: b0ad8ca37e3c49a4a03fc3460bf0bc5b
W20260925 01:49:59.625442 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a9068770de0b473488bd8ea4752fb15d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9068770de0b473488bd8ea4752fb15d already in progress: creating tablet
I20260925 01:49:59.625757 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet e457c4ab4e814fc4be11ced6ca69284f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:49:59.625960 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7944aa1ac8f4c5d8ea3aa2acae41257 already in progress: creating tablet
W20260925 01:49:59.626477 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2e96576354fe46bf9bfcde18f0a53390 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e96576354fe46bf9bfcde18f0a53390 already in progress: creating tablet
W20260925 01:49:59.627112 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 85d859207bbc4aefb26c726dce404c44 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85d859207bbc4aefb26c726dce404c44 already in progress: creating tablet
I20260925 01:49:59.628156 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet b05053f5646f4748a99647b7dbfae686 (table default.Table_a33362d5d6de41e985d86740d8af966c [id=351fd2bbafea4565a9cc4537f7f0c1aa]) successfully deleted
I20260925 01:49:59.630493 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c1c05b5a87e43d38a24f63242415fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.631209 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7639fd1f1149a7973eba0c77bd7065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.623793 11755 tablet_bootstrap.cc:492] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:59.628537 12487 raft_consensus.cc:493] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.632671 11953 raft_consensus.cc:2243] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:59.632611 12487 raft_consensus.cc:515] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:49:59.632997 11953 pending_rounds.cc:70] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:59.633091 11953 pending_rounds.cc:77] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072862462763008 op_type: NO_OP noop_request { }
I20260925 01:49:59.633272 11953 raft_consensus.cc:2889] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:59.629317 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet c3e2709b3b0f4157938d8d8bca8a7b10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.631291 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 1e440a8413e945ab9ea793a2016f2ee8 (DEFAULT_TABLE table=default.Table_c8919df13a3e476cb936abc0b4625aae [id=c44d0313c36549bd9bacce856e3cdc3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.633634 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7639fd1f1149a7973eba0c77bd7065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.633668 11953 raft_consensus.cc:2272] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.633370 12487 leader_election.cc:290] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:49:59.629019 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet cb7bac6e89b8405e8bd541eba6278a0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.633857 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e440a8413e945ab9ea793a2016f2ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.634004 11755 ts_tablet_manager.cc:1403] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.000s
I20260925 01:49:59.635075 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 86f3f75784af42f6b14b919815ab1890 (DEFAULT_TABLE table=default.Table_7825567ce8ce424aab880bd345cf3c3d [id=17bb8fb2387b44d2abba99690d0c4752]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.637661 11356 tablet_service.cc:1511] Processing CreateTablet for tablet afa1558aea804bfc910fe699335eda24 (DEFAULT_TABLE table=default.Table_bd05ebe158af4ec9bf154690b3008162 [id=4ce896b83ce84c25aa2ed19e910b7435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.637992 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f3f75784af42f6b14b919815ab1890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.635692 11353 tablet_service.cc:1511] Processing CreateTablet for tablet bd22b1eb643f4229a65566493e21d96c (DEFAULT_TABLE table=default.Table_dd2fbf6d10f744cd86b10091a53b0372 [id=9275d83c8912462fb06a2f58229c5eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.638659 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 6b5e1d832978450487009a8ff3eaec71 (DEFAULT_TABLE table=default.Table_3e1405f7d12447309d5dbebd0aa43adc [id=6a2da4de6ade49789ae45229b993ece4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.639182 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b5e1d832978450487009a8ff3eaec71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.639369 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd22b1eb643f4229a65566493e21d96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.635716 12445 raft_consensus.cc:493] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.636236 11351 tablet_service.cc:1511] Processing CreateTablet for tablet fe947074863044c1a8640092735a51fc (DEFAULT_TABLE table=default.Table_7dad99b3f361482389400168bbd281d8 [id=d6c6f9e02b934baeb448b4e865050498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.636888 11354 tablet_service.cc:1511] Processing CreateTablet for tablet bc99f3613c354d68bfde33e04dc1e9ab (DEFAULT_TABLE table=default.Table_b29d5c3e7011407a920707f27614b3de [id=4fbd33ce9dc14df583082451e1532b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.639734 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afa1558aea804bfc910fe699335eda24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.640446 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe947074863044c1a8640092735a51fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.640673 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc99f3613c354d68bfde33e04dc1e9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.642040 12445 raft_consensus.cc:515] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.643179 11755 raft_consensus.cc:359] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.643386 11755 raft_consensus.cc:385] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.643462 11755 raft_consensus.cc:740] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.643783 11755 consensus_queue.cc:260] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.644564 11953 ts_tablet_manager.cc:1916] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.646832 12689 ts_tablet_manager.cc:1929] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:49:59.647179 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b75b12794fa4f4fa53156c212632cdc consensus state has no leader
I20260925 01:49:59.647918 12725 tablet.cc:1751] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:49:59.648483 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4ae934a7969f4cb2aae617f37447aa50" } modify_external_catalogs: true
I20260925 01:49:59.648751 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4ae934a7969f4cb2aae617f37447aa50" } modify_external_catalogs: true
I20260925 01:49:59.649950 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e2f7a1b5f1b94e3b87dcaa2cab95bc6a" } modify_external_catalogs: true
I20260925 01:49:59.650231 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e2f7a1b5f1b94e3b87dcaa2cab95bc6a" } modify_external_catalogs: true
I20260925 01:49:59.650656 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet e457c4ab4e814fc4be11ced6ca69284f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.652639 11755 ts_tablet_manager.cc:1434] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260925 01:49:59.652946 11755 tablet_bootstrap.cc:492] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:59.656620 12689 log.cc:1199] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/596f8ddbcd16458aa4f287f4f11282a1
I20260925 01:49:59.659212 12445 leader_election.cc:290] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:59.667737 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:49:59.669193 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_34c06e31ff804bef91930ab2abeb95f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.669817 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34c06e31ff804bef91930ab2abeb95f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.657065 12689 ts_tablet_manager.cc:1950] T 596f8ddbcd16458aa4f287f4f11282a1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:59.673488 11238 raft_consensus.cc:2468] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:59.674685 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 596f8ddbcd16458aa4f287f4f11282a1 (table default.Table_196b02edd23b4384aef87a7819365849 [id=2a64ecd7c8aa4c058cf50c57d0373c3c]) successfully deleted
W20260925 01:49:59.675485 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f385af75e11c4643b4e7c2d899ee99a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f385af75e11c4643b4e7c2d899ee99a4 already in progress: creating tablet
W20260925 01:49:59.675863 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 982b2a3dcdcb44bd8ad8562f30c38f13 already in progress: creating tablet
W20260925 01:49:59.676151 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c2fe086048c04e0db797272e50f21c91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2fe086048c04e0db797272e50f21c91 already in progress: creating tablet
W20260925 01:49:59.677474 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 7eee30b35eb94fa196e9ccd1de37175a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eee30b35eb94fa196e9ccd1de37175a already in progress: creating tablet
W20260925 01:49:59.677759 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet cb7bac6e89b8405e8bd541eba6278a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb7bac6e89b8405e8bd541eba6278a0b already in progress: creating tablet
I20260925 01:49:59.677925 11753 tablet_bootstrap.cc:492] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:49:59.678033 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c3e2709b3b0f4157938d8d8bca8a7b10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3e2709b3b0f4157938d8d8bca8a7b10 already in progress: creating tablet
I20260925 01:49:59.678169 11753 ts_tablet_manager.cc:1403] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.318s user 0.011s sys 0.008s
W20260925 01:49:59.678289 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5c1c05b5a87e43d38a24f63242415fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c1c05b5a87e43d38a24f63242415fd7 already in progress: creating tablet
W20260925 01:49:59.678534 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9f7639fd1f1149a7973eba0c77bd7065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7639fd1f1149a7973eba0c77bd7065 already in progress: creating tablet
W20260925 01:49:59.678745 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e457c4ab4e814fc4be11ced6ca69284f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e457c4ab4e814fc4be11ced6ca69284f already in progress: creating tablet
I20260925 01:49:59.678965 11753 raft_consensus.cc:359] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.679190 11753 raft_consensus.cc:385] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.679324 11753 raft_consensus.cc:740] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.679584 11753 consensus_queue.cc:260] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.680081 11753 ts_tablet_manager.cc:1434] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:59.680395 11753 tablet_bootstrap.cc:492] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:59.682029 11753 tablet_bootstrap.cc:654] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.685177 11754 tablet_bootstrap.cc:492] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:59.685312 11754 ts_tablet_manager.cc:1403] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.250s user 0.002s sys 0.004s
I20260925 01:49:59.686861 11753 tablet_bootstrap.cc:492] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:59.687060 11753 ts_tablet_manager.cc:1403] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260925 01:49:59.687801 11753 raft_consensus.cc:359] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.687970 11753 raft_consensus.cc:385] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.688086 11753 raft_consensus.cc:740] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.688334 11753 consensus_queue.cc:260] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.688787 11753 ts_tablet_manager.cc:1434] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:49:59.689090 11753 tablet_bootstrap.cc:492] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:49:59.632263 11314 leader_election.cc:343] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: Tablet not RUNNING: STOPPED
W20260925 01:49:59.691056 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 58789.1us
W20260925 01:49:59.692579 11314 consensus_peers.cc:597] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23a6ec9b9b5d4f60a7e5f3edf0687b56. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:59.693759 11314 consensus_peers.cc:597] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86079f22abb74d438c61ecc2a7379cbd. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:59.694083 11314 leader_election.cc:304] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:59.694378 12445 raft_consensus.cc:2804] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:59.694501 12445 raft_consensus.cc:697] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:49:59.694705 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 9663d7f4008e4ee0a3ba4373258242eb from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:59.695724 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6e9bc6f6c7346bfadbd79b8d494641e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:59.701433 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 0492ea6f9d0a4cdf9e339920863b54f9 (DEFAULT_TABLE table=default.Table_6734b38bddb6462f81a668efbe01fad0 [id=977b69f7df2c41cab43ee3498fb261c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.701454 11360 tablet_service.cc:1511] Processing CreateTablet for tablet a1996d50e7874f769bcd8c277a14a082 (DEFAULT_TABLE table=default.Table_775faf150b3041519250a4f17a5bdae1 [id=e40d982f5010435db1e54349166e2591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.705226 11946 ts_tablet_manager.cc:1929] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:49:59.705433 11946 log.cc:1199] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/0fa7a3941254478c800f9e366e3f7b06
I20260925 01:49:59.705945 11946 ts_tablet_manager.cc:1950] T 0fa7a3941254478c800f9e366e3f7b06 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:59.706683 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 9845a915c8b94fff8660e2e7e86731f3 (DEFAULT_TABLE table=default.Table_5fb6a5e0ac944a3bacc808d58b0d6c7e [id=13825238e94d418694c22d3d5aefb4e1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:49:59.710742 11314 leader_election.cc:343] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:49:59.710877 11314 leader_election.cc:304] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.714916 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 0226f482c8ff49ce976490e6aadfcee4 (DEFAULT_TABLE table=default.Table_beb6ee96dba041d6a7c99c5d8dc3a403 [id=2ff4712cd156430ba7afae4d42c203e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.715319 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 9b75b12794fa4f4fa53156c212632cdc (DEFAULT_TABLE table=default.Table_a9106d4e06b248f9ae0595a67271be8a [id=818ef8f0b2ca46c8b49358df930297c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.717653 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0492ea6f9d0a4cdf9e339920863b54f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.718990 12445 consensus_queue.cc:237] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.726233 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1996d50e7874f769bcd8c277a14a082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.726413 12567 mvcc.cc:204] Tried to move back new op lower bound from 7333072872972197888 to 7333072835126013952. Current Snapshot: MvccSnapshot[applied={T|T < 7333072872972197888 or (T in {7333072872972197888})}]
I20260925 01:49:59.726719 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0226f482c8ff49ce976490e6aadfcee4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.728124 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3541e17b47bc47f5b69add361877a2bf consensus state has no leader
I20260925 01:49:59.728302 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b75b12794fa4f4fa53156c212632cdc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:49:59.728865 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 716ad6cdf9864fc3b09d88753d45f45f has no consensus state
I20260925 01:49:59.728940 12705 raft_consensus.cc:2749] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:49:59.729233 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8234c4d0c72541158826416e40f34031 consensus state has no leader
W20260925 01:49:59.729595 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 341dca6f396449daadcaf8bbb77ed04b consensus state has no leader
I20260925 01:49:59.732412 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9845a915c8b94fff8660e2e7e86731f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.738852 11753 tablet_bootstrap.cc:654] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.740690 12705 consensus_queue.cc:1048] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:59.743884 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 941fd8333f6d45878677e55ff6948bbf
I20260925 01:49:59.743909 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa7a3941254478c800f9e366e3f7b06" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:59.745234 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 941fd8333f6d45878677e55ff6948bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:49:59.748787 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet 90647937eb364a7a973d04ea69cbc9aa from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:59.750267 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 941fd8333f6d45878677e55ff6948bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.752108 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 4e90b7aae9cc41a3a795f601e784d34c (DEFAULT_TABLE table=default.Table_23c2c72963784e6b91bed0595827abe2 [id=de8e5bde62c04f7c9433f49f51a6945d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:49:59.752524 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e90b7aae9cc41a3a795f601e784d34c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.753841 12508 raft_consensus.cc:493] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.754030 12508 raft_consensus.cc:515] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.755980 12508 leader_election.cc:290] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:59.756942 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 380) took 3058 ms. Trace:
I20260925 01:49:59.757062 11946 rpcz_store.cc:276] 0925 01:49:56.698022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.698154 (+ 132us) service_pool.cc:224] Handling call
0925 01:49:59.383821 (+2685667us) ts_tablet_manager.cc:1151] Deleting tablet 0fa7a3941254478c800f9e366e3f7b06
0925 01:49:59.383832 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.616208 (+232376us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.705168 (+ 88960us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.756926 (+ 51758us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2682932}
W20260925 01:49:59.757556 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 941fd8333f6d45878677e55ff6948bbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 941fd8333f6d45878677e55ff6948bbf already in progress: creating tablet
I20260925 01:49:59.757601 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 379) took 3063 ms. Trace:
I20260925 01:49:59.757668 11946 rpcz_store.cc:276] 0925 01:49:56.693906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.694321 (+ 415us) service_pool.cc:224] Handling call
0925 01:49:59.757489 (+3063168us) ts_tablet_manager.cc:1151] Deleting tablet 4f117df272c342b6b4ea5e5a4d7fd137
0925 01:49:59.757498 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.757584 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3056477}
I20260925 01:49:59.758025 11946 tablet_replica.cc:333] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.758270 11946 raft_consensus.cc:2243] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:59.758523 11946 pending_rounds.cc:70] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:49:59.758589 11946 pending_rounds.cc:77] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072887340593152 op_type: NO_OP noop_request { }
I20260925 01:49:59.758699 11946 raft_consensus.cc:2889] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:59.758795 11946 raft_consensus.cc:2272] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.759335 11946 ts_tablet_manager.cc:1916] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:49:59.760579 11456 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:49:59.763528 11754 raft_consensus.cc:359] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:59.763957 11754 raft_consensus.cc:385] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.764135 11754 raft_consensus.cc:740] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.764894 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efaaf48f816640e4a36627275d3ce8c9" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:59.765101 11242 raft_consensus.cc:2468] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:59.765239 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efaaf48f816640e4a36627275d3ce8c9" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:49:59.765406 11519 raft_consensus.cc:2468] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:49:59.765753 11754 consensus_queue.cc:260] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:49:59.766558 11456 consensus_peers.cc:597] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 039ee80a2822417898c1d1d779f52867. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:49:59.766862 11457 leader_election.cc:304] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.767570 12640 raft_consensus.cc:2749] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:59.767742 12640 consensus_queue.cc:1048] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:59.774930 11753 tablet_bootstrap.cc:492] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:59.775120 11753 ts_tablet_manager.cc:1403] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.086s user 0.000s sys 0.004s
I20260925 01:49:59.778941 11754 ts_tablet_manager.cc:1434] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.094s user 0.000s sys 0.003s
I20260925 01:49:59.779549 11754 tablet_bootstrap.cc:492] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:59.780571 11753 raft_consensus.cc:359] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:49:59.781279 11314 consensus_peers.cc:597] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86079f22abb74d438c61ecc2a7379cbd. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:49:59.784530 11314 leader_election.cc:343] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:59.785145 11314 leader_election.cc:304] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:49:59.787133 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc99f3613c354d68bfde33e04dc1e9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:49:59.787119 12705 raft_consensus.cc:2804] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:59.787202 12705 raft_consensus.cc:493] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:59.787266 12705 raft_consensus.cc:3060] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.757957 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]) successfully deleted
I20260925 01:49:59.788060 11753 raft_consensus.cc:385] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.788146 11753 raft_consensus.cc:740] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.787760 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca17585cd523440ca1e9b754f3aedf8a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:49:59.788599 11379 raft_consensus.cc:2468] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:59.789081 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7639fd1f1149a7973eba0c77bd7065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:59.789683 11314 leader_election.cc:343] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 0fa7a3941254478c800f9e366e3f7b06
I20260925 01:49:59.790350 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.790652 12689 tablet_replica.cc:333] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:59.790845 12689 raft_consensus.cc:2243] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.790982 12689 raft_consensus.cc:2272] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.791600 12689 ts_tablet_manager.cc:1916] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.788367 11753 consensus_queue.cc:260] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.792302 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c1c05b5a87e43d38a24f63242415fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.795723 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:49:59.796419 11314 leader_election.cc:343] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:49:59.797447 11753 ts_tablet_manager.cc:1434] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260925 01:49:59.796595 11755 tablet_bootstrap.cc:654] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.798418 11314 leader_election.cc:304] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.799494 12705 raft_consensus.cc:515] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.800001 12689 ts_tablet_manager.cc:1929] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:59.800161 12689 log.cc:1199] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/4d7b3c65d8a64734b2c432790dae07e1
I20260925 01:49:59.800519 12689 ts_tablet_manager.cc:1950] T 4d7b3c65d8a64734b2c432790dae07e1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:59.800740 11753 tablet_bootstrap.cc:492] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:59.803246 11754 tablet_bootstrap.cc:654] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.806682 12487 raft_consensus.cc:2749] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:49:59.807636 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 941fd8333f6d45878677e55ff6948bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.808856 12705 leader_election.cc:290] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:59.812443 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet e457c4ab4e814fc4be11ced6ca69284f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:49:59.818987 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
W20260925 01:49:59.819000 11665 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 716ad6cdf9864fc3b09d88753d45f45f (table default.Table_af512ab1da7a45759866fe1ded30cc15 [id=85f9e36e698e4170b4104c627300c724], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 716ad6cdf9864fc3b09d88753d45f45f has no consensus state
I20260925 01:49:59.823462 11754 tablet_bootstrap.cc:492] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:49:59.823681 11754 ts_tablet_manager.cc:1403] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.004s
I20260925 01:49:59.824712 11754 raft_consensus.cc:359] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:59.824887 11953 ts_tablet_manager.cc:1929] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:59.824990 11953 log.cc:1199] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/31fe174270f24ff780c212eaef90ef0d
I20260925 01:49:59.824994 11754 raft_consensus.cc:385] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.825066 11754 raft_consensus.cc:740] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.825356 11754 consensus_queue.cc:260] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:59.825733 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 4d7b3c65d8a64734b2c432790dae07e1 (table default.Table_b00b413ef17343febe7fadd2f08ae596 [id=0cfde61c060841d8b99d75fa7557a258]) successfully deleted
W20260925 01:49:59.825977 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 58507.6us
I20260925 01:49:59.827649 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efaaf48f816640e4a36627275d3ce8c9" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:59.827811 11238 raft_consensus.cc:3060] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.832908 11238 raft_consensus.cc:2468] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:59.834177 11521 raft_consensus.cc:3060] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.844769 11457 leader_election.cc:304] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:49:59.845868 12640 raft_consensus.cc:2804] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:59.845966 12640 raft_consensus.cc:493] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:59.846026 12640 raft_consensus.cc:3060] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.848795 12640 raft_consensus.cc:515] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.850008 12640 leader_election.cc:290] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:49:59.851470 11456 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:49:59.852577 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1f9796971bef489fbaf53b6c189ec489" } modify_external_catalogs: true
I20260925 01:49:59.852856 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1f9796971bef489fbaf53b6c189ec489" } modify_external_catalogs: true
I20260925 01:49:59.853379 12640 consensus_queue.cc:1048] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:49:59.854800 11754 ts_tablet_manager.cc:1434] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.031s user 0.000s sys 0.002s
I20260925 01:49:59.855104 11754 tablet_bootstrap.cc:492] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:49:59.853425 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0c8444676dd247048ee61b454fa4e0c3" } modify_external_catalogs: true
I20260925 01:49:59.856732 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b1e57df563c64536a49824c81a2ab45c" } modify_external_catalogs: true
I20260925 01:49:59.859259 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d766662214594ba9afd39223d4838f35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.860054 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d766662214594ba9afd39223d4838f35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.861304 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b18554efa4ef45df951e50be20d806b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.862329 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b18554efa4ef45df951e50be20d806b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.862816 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_53c0e47ee34948e7a0a677a6b4db8e74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.863878 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53c0e47ee34948e7a0a677a6b4db8e74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.864732 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1aa079cf0846465c986619e062cfdadd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.865312 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1aa079cf0846465c986619e062cfdadd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.866401 11754 tablet_bootstrap.cc:654] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.866853 11946 ts_tablet_manager.cc:1929] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:59.866991 11946 log.cc:1199] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/55e9d52e3f79408a99216250aefc45c8
I20260925 01:49:59.867388 11946 ts_tablet_manager.cc:1950] T 55e9d52e3f79408a99216250aefc45c8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:49:59.868292 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 381) took 3166 ms. Trace:
I20260925 01:49:59.868371 11946 rpcz_store.cc:276] 0925 01:49:56.702183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.702425 (+ 242us) service_pool.cc:224] Handling call
0925 01:49:59.757975 (+3055550us) ts_tablet_manager.cc:1151] Deleting tablet 55e9d52e3f79408a99216250aefc45c8
0925 01:49:59.757983 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.860848 (+102865us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.866788 (+ 5940us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.868260 (+ 1472us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2938462}
I20260925 01:49:59.868988 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 55e9d52e3f79408a99216250aefc45c8 (table default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]) successfully deleted
I20260925 01:49:59.869864 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0c8444676dd247048ee61b454fa4e0c3" } modify_external_catalogs: true
I20260925 01:49:59.872877 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b1e57df563c64536a49824c81a2ab45c" } modify_external_catalogs: true
I20260925 01:49:59.876659 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:49:59.877617 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet d3150980bb72435886486156aa98d342 from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:59.878399 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_beeadc8d27b04484885e077b167d04df" } new_table_name: "default.Table_508d50254458453d8ce5ae125aa65da5" modify_external_catalogs: true
I20260925 01:49:59.881660 11753 tablet_bootstrap.cc:654] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.885524 12640 raft_consensus.cc:493] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.885669 12640 raft_consensus.cc:515] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.886468 12640 leader_election.cc:290] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:59.887223 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:49:59.887418 11238 raft_consensus.cc:2468] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:49:59.888003 11456 leader_election.cc:304] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:59.888504 12640 raft_consensus.cc:2804] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:49:59.888614 12640 raft_consensus.cc:493] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:49:59.888685 12640 raft_consensus.cc:3060] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.891511 12640 raft_consensus.cc:515] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.892717 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:49:59.892925 11238 raft_consensus.cc:3060] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.893922 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet f1b6ea676a1f4d99807029d8401251ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:49:59.854710 11755 tablet_bootstrap.cc:492] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:59.894196 12689 tablet_replica.cc:333] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:49:59.894244 11755 ts_tablet_manager.cc:1403] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.241s user 0.009s sys 0.002s
I20260925 01:49:59.894378 12689 raft_consensus.cc:2243] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.894549 12689 raft_consensus.cc:2272] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.894711 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fef5840c829a432aaad089bb8b851e88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.895071 11755 raft_consensus.cc:359] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.895221 11755 raft_consensus.cc:385] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.895278 11755 raft_consensus.cc:740] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
W20260925 01:49:59.895479 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fef5840c829a432aaad089bb8b851e88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.895459 11755 consensus_queue.cc:260] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.895846 12689 ts_tablet_manager.cc:1916] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.895895 11755 ts_tablet_manager.cc:1434] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:59.896178 11755 tablet_bootstrap.cc:492] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:59.896875 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_888d29cf77974252be89bea321d7542b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.897374 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_888d29cf77974252be89bea321d7542b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.897567 11755 tablet_bootstrap.cc:654] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.900233 11238 raft_consensus.cc:2468] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:49:59.901913 11953 ts_tablet_manager.cc:1950] T 31fe174270f24ff780c212eaef90ef0d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:59.902806 11456 leader_election.cc:304] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:49:59.903173 12731 raft_consensus.cc:2804] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:49:59.903231 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 172) took 9451 ms. Trace:
I20260925 01:49:59.903285 12731 raft_consensus.cc:697] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:49:59.903306 11953 rpcz_store.cc:276] 0925 01:49:50.451612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.451682 (+ 70us) service_pool.cc:224] Handling call
0925 01:49:59.600834 (+9149152us) ts_tablet_manager.cc:1151] Deleting tablet 31fe174270f24ff780c212eaef90ef0d
0925 01:49:59.600847 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.816402 (+215555us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.824829 (+ 8427us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.903213 (+ 78384us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9148455}
I20260925 01:49:59.903535 12731 consensus_queue.cc:237] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.904067 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 31fe174270f24ff780c212eaef90ef0d (table default.Table_7f0be4abc90a407dbc377d4fbe092f08 [id=b92c44757e8d477197fb65f6429e3e7d]) successfully deleted
I20260925 01:49:59.907402 12640 leader_election.cc:290] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:49:59.907322 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_64a746d945ab40b899c12a9b70706079"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.908067 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64a746d945ab40b899c12a9b70706079 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.911392 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 173) took 9437 ms. Trace:
I20260925 01:49:59.911783 11953 rpcz_store.cc:276] 0925 01:49:50.473527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.473591 (+ 64us) service_pool.cc:224] Handling call
0925 01:49:59.903562 (+9429971us) ts_tablet_manager.cc:1151] Deleting tablet 73d9a26bbfd74a30a2ae0a61aacca4d1
0925 01:49:59.911231 (+ 7669us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.911370 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9429669}
I20260925 01:49:59.912389 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_74dbca67c17748289e4da7baa267fd53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.912820 11753 tablet_bootstrap.cc:492] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:49:59.913053 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74dbca67c17748289e4da7baa267fd53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.913936 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 174) took 9438 ms. Trace:
W20260925 01:49:59.914172 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 already in progress: creating tablet
W20260925 01:49:59.915151 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b97f703869d4471cb940ef654203ec2b consensus state has no leader
I20260925 01:49:59.916358 12689 ts_tablet_manager.cc:1929] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:49:59.916946 12689 log.cc:1199] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/f1b6ea676a1f4d99807029d8401251ef
I20260925 01:49:59.917478 12689 ts_tablet_manager.cc:1950] T f1b6ea676a1f4d99807029d8401251ef P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:49:59.918459 11753 ts_tablet_manager.cc:1403] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.000s
I20260925 01:49:59.918934 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet f1b6ea676a1f4d99807029d8401251ef (table default.Table_95ebdd9395354eba91e3babd76028061 [id=dba58bdd410a4b8986cf7e359a563628]) successfully deleted
I20260925 01:49:59.919685 11753 raft_consensus.cc:359] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.919941 11753 raft_consensus.cc:385] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.920028 11753 raft_consensus.cc:740] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.920262 11753 consensus_queue.cc:260] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.921131 11753 ts_tablet_manager.cc:1434] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:59.921206 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_290135088f3644b3b2f1bb06a39ab673"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:49:59.921442 11753 tablet_bootstrap.cc:492] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:49:59.922829 11753 tablet_bootstrap.cc:654] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.922955 11953 rpcz_store.cc:276] 0925 01:49:50.475576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.475700 (+ 124us) service_pool.cc:224] Handling call
0925 01:49:59.913798 (+9438098us) ts_tablet_manager.cc:1151] Deleting tablet 5b11c6526dbc4177b3a54b3c952bbd31
0925 01:49:59.913809 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.913904 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9437504}
W20260925 01:49:59.923261 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_290135088f3644b3b2f1bb06a39ab673 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:49:59.923537 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5b11c6526dbc4177b3a54b3c952bbd31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b11c6526dbc4177b3a54b3c952bbd31 already in progress: creating tablet
I20260925 01:49:59.923893 11953 tablet_replica.cc:333] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:49:59.924127 11953 raft_consensus.cc:2243] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:49:59.924410 11953 pending_rounds.cc:70] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:49:59.924502 11953 pending_rounds.cc:77] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072889413894144 op_type: NO_OP noop_request { }
I20260925 01:49:59.924636 11953 raft_consensus.cc:2889] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:49:59.936400 11755 tablet_bootstrap.cc:492] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:59.936731 11755 ts_tablet_manager.cc:1403] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.005s
I20260925 01:49:59.938022 11755 raft_consensus.cc:359] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.938321 11755 raft_consensus.cc:385] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.938405 11755 raft_consensus.cc:740] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.938727 11755 consensus_queue.cc:260] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.939323 11755 ts_tablet_manager.cc:1434] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:49:59.939620 11755 tablet_bootstrap.cc:492] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:59.941623 11755 tablet_bootstrap.cc:654] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.945379 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_192ad0421b7d4133831b8b433981f74f" } new_table_name: "default.Table_0b317291cb904b7f9bbf1b8d05022488" modify_external_catalogs: true
I20260925 01:49:59.947316 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b234dbd8701a48f9ac1db6517557eb62" } new_table_name: "default.Table_d3033e2cc4344abcabf1b52f454c2a82" modify_external_catalogs: true
I20260925 01:49:59.949272 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_627a87cf82bc46aaaaebd84352be4014" } new_table_name: "default.Table_f2a3bb55c7fc4681a8baf2b5416ed839" modify_external_catalogs: true
I20260925 01:49:59.953734 11953 raft_consensus.cc:2272] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.954491 11953 ts_tablet_manager.cc:1916] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.937652 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efaaf48f816640e4a36627275d3ce8c9" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:49:59.960753 11521 raft_consensus.cc:3060] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:49:59.958977 11946 tablet_replica.cc:333] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:49:59.961578 11946 raft_consensus.cc:2243] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:49:59.961764 11946 raft_consensus.cc:2272] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:49:59.962327 11946 ts_tablet_manager.cc:1916] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:49:59.962631 12445 raft_consensus.cc:493] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:49:59.962749 12445 raft_consensus.cc:515] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.963336 12445 leader_election.cc:290] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:49:59.963634 11521 raft_consensus.cc:2468] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:49:59.966974 11755 tablet_bootstrap.cc:492] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:49:59.967114 11755 ts_tablet_manager.cc:1403] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.003s
I20260925 01:49:59.967805 11755 raft_consensus.cc:359] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.967964 11755 raft_consensus.cc:385] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.968024 11755 raft_consensus.cc:740] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.968255 11755 consensus_queue.cc:260] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:49:59.968832 11755 ts_tablet_manager.cc:1434] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:49:59.969122 11755 tablet_bootstrap.cc:492] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:49:59.973646 11755 tablet_bootstrap.cc:654] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:49:59.983953 11753 tablet_bootstrap.cc:492] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:49:59.984375 11753 ts_tablet_manager.cc:1403] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.063s user 0.000s sys 0.003s
W20260925 01:49:59.984912 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64ce95e571524d6ea6c98087bc08d4b9 consensus state has no leader
I20260925 01:49:59.985402 11753 raft_consensus.cc:359] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:59.985507 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a7d1848c346a4268ace995c919f1be64" } new_table_name: "default.Table_c93323e771fe4ab1a5a77dd05caed954" modify_external_catalogs: true
W20260925 01:49:59.987404 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00345732f7314624831b4cfc59e981f4 has no consensus state
I20260925 01:49:59.987856 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7dad99b3f361482389400168bbd281d8" } modify_external_catalogs: true
I20260925 01:49:59.988112 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7dad99b3f361482389400168bbd281d8" } modify_external_catalogs: true
W20260925 01:49:59.989421 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e6b97d37704f4a0d88457d124bb4f259 consensus state has no leader
I20260925 01:49:59.989677 11953 ts_tablet_manager.cc:1929] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:49:59.989722 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 8152c9e0b0af4ab2a18c5a0080e22ffc from {username='slave'} at 127.0.0.1:60372
I20260925 01:49:59.989881 11953 log.cc:1199] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/23a6ec9b9b5d4f60a7e5f3edf0687b56
I20260925 01:49:59.990453 11953 ts_tablet_manager.cc:1950] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:49:59.990362 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_55c008dcf8a547958cd09786542da6db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:49:59.990897 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55c008dcf8a547958cd09786542da6db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:49:59.990981 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 175) took 9514 ms. Trace:
I20260925 01:49:59.994125 11753 raft_consensus.cc:385] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:49:59.994269 11753 raft_consensus.cc:740] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:49:59.997170 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
I20260925 01:49:59.997565 11674 catalog_manager.cc:5838] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } }
I20260925 01:49:59.997963 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:49:59.998200 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:49:59.998373 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 1 got 0
I20260925 01:49:59.998548 11753 consensus_queue.cc:260] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:49:59.999413 11753 ts_tablet_manager.cc:1434] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.015s user 0.000s sys 0.001s
I20260925 01:49:59.999766 11753 tablet_bootstrap.cc:492] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.001497 11753 tablet_bootstrap.cc:654] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.014678 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 8a24afdded004ee09368daea34ead50e (DEFAULT_TABLE table=default.Table_bb53a1f08ea54ba89eda67a179045293 [id=6184385b32304c01a27c3d72745ea0b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.015208 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a24afdded004ee09368daea34ead50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.018209 11946 ts_tablet_manager.cc:1929] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:00.018430 11953 rpcz_store.cc:276] 0925 01:49:50.477829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.477969 (+ 140us) service_pool.cc:224] Handling call
0925 01:49:59.923840 (+9445871us) ts_tablet_manager.cc:1151] Deleting tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56
0925 01:49:59.923849 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.986329 (+ 62480us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.989622 (+ 3293us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:59.990963 (+ 1341us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9444781}
I20260925 01:50:00.019155 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 (table default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b [id=4598ed1a6ec844ec8c3930fb1d54cf01]) successfully deleted
I20260925 01:50:00.016885 11755 tablet_bootstrap.cc:492] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.019556 11755 ts_tablet_manager.cc:1403] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.000s
I20260925 01:50:00.020361 11755 raft_consensus.cc:359] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.020601 11755 raft_consensus.cc:385] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.020979 11755 raft_consensus.cc:740] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.021260 11755 consensus_queue.cc:260] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.020902 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 177) took 9534 ms. Trace:
I20260925 01:50:00.021566 11953 rpcz_store.cc:276] 0925 01:49:50.487867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.487936 (+ 69us) service_pool.cc:224] Handling call
0925 01:50:00.020767 (+9532831us) ts_tablet_manager.cc:1151] Deleting tablet 784de8c6e6e1434a91106dd19cd9262a
0925 01:50:00.020778 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.020888 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9532295}
I20260925 01:50:00.022763 11953 tablet_replica.cc:333] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:00.022925 11946 log.cc:1199] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c4eb584e929c46f891d28ad01e6d78ae
I20260925 01:50:00.023345 11946 ts_tablet_manager.cc:1950] T c4eb584e929c46f891d28ad01e6d78ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:00.023559 11953 raft_consensus.cc:2243] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.023783 11953 raft_consensus.cc:2272] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.024642 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 384) took 3207 ms. Trace:
I20260925 01:50:00.025224 11953 ts_tablet_manager.cc:1916] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.022213 11755 ts_tablet_manager.cc:1434] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:50:00.030385 11755 tablet_bootstrap.cc:492] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.026206 11753 tablet_bootstrap.cc:492] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.030736 11753 ts_tablet_manager.cc:1403] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.003s
I20260925 01:50:00.030340 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 8a24afdded004ee09368daea34ead50e (DEFAULT_TABLE table=default.Table_bb53a1f08ea54ba89eda67a179045293 [id=6184385b32304c01a27c3d72745ea0b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.031129 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a24afdded004ee09368daea34ead50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.031409 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 8a24afdded004ee09368daea34ead50e (DEFAULT_TABLE table=default.Table_bb53a1f08ea54ba89eda67a179045293 [id=6184385b32304c01a27c3d72745ea0b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.032974 11314 leader_election.cc:304] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:00.033947 12704 raft_consensus.cc:2804] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:00.034080 12704 raft_consensus.cc:697] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:00.034325 12704 consensus_queue.cc:237] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.035228 11753 raft_consensus.cc:359] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.035444 11753 raft_consensus.cc:385] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.035548 11753 raft_consensus.cc:740] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.035868 11753 consensus_queue.cc:260] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.036528 11753 ts_tablet_manager.cc:1434] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:00.040030 11753 tablet_bootstrap.cc:492] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.042596 11753 tablet_bootstrap.cc:654] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.045186 11946 rpcz_store.cc:276] 0925 01:49:56.816998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.817569 (+ 571us) service_pool.cc:224] Handling call
0925 01:49:59.958911 (+3141342us) ts_tablet_manager.cc:1151] Deleting tablet c4eb584e929c46f891d28ad01e6d78ae
0925 01:49:59.958925 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:49:59.991956 (+ 33031us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.018144 (+ 26188us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.024621 (+ 6477us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3133188}
I20260925 01:50:00.046048 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]) successfully deleted
I20260925 01:50:00.046630 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 385) took 3229 ms. Trace:
I20260925 01:50:00.046780 11946 rpcz_store.cc:276] 0925 01:49:56.817152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.817649 (+ 497us) service_pool.cc:224] Handling call
0925 01:50:00.046462 (+3228813us) ts_tablet_manager.cc:1151] Deleting tablet b4e5d28d466741a0a085a4f9938fffd1
0925 01:50:00.046474 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.046601 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3219265}
W20260925 01:50:00.047572 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b4e5d28d466741a0a085a4f9938fffd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4e5d28d466741a0a085a4f9938fffd1 already in progress: creating tablet
I20260925 01:50:00.049731 11946 tablet_replica.cc:333] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:00.050014 11946 raft_consensus.cc:2243] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.050362 11946 raft_consensus.cc:2272] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.050976 11946 ts_tablet_manager.cc:1916] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.053211 12745 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:00.056288 11753 tablet_bootstrap.cc:492] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.056547 11753 ts_tablet_manager.cc:1403] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.001s
I20260925 01:50:00.057569 11753 raft_consensus.cc:359] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.057857 11753 raft_consensus.cc:385] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.058000 11753 raft_consensus.cc:740] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.058256 11211 tablet_service.cc:1511] Processing CreateTablet for tablet f0aecb232c2a478f9749a950441cede5 (DEFAULT_TABLE table=default.Table_9f461e15eec54624815b8077dbde7098 [id=5b5b48ae6d9c4af991c12321e46e2ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.058459 11753 consensus_queue.cc:260] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.059319 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aecb232c2a478f9749a950441cede5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.061892 11753 ts_tablet_manager.cc:1434] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
W20260925 01:50:00.061554 11314 consensus_peers.cc:597] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba19192502634f8599407d923114a627. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:00.064805 11753 tablet_bootstrap.cc:492] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.069535 11502 tablet_service.cc:1511] Processing CreateTablet for tablet f0aecb232c2a478f9749a950441cede5 (DEFAULT_TABLE table=default.Table_9f461e15eec54624815b8077dbde7098 [id=5b5b48ae6d9c4af991c12321e46e2ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.069710 11754 tablet_bootstrap.cc:492] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.069844 11754 ts_tablet_manager.cc:1403] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.215s user 0.014s sys 0.025s
I20260925 01:50:00.070029 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aecb232c2a478f9749a950441cede5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.070611 11754 raft_consensus.cc:359] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.070778 11754 raft_consensus.cc:385] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.070823 11754 raft_consensus.cc:740] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.071043 11754 consensus_queue.cc:260] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.071520 11754 ts_tablet_manager.cc:1434] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:00.071799 11754 tablet_bootstrap.cc:492] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.075330 11754 tablet_bootstrap.cc:654] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:00.068497 11314 leader_election.cc:343] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260925 01:50:00.088359 11314 leader_election.cc:304] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:00.090700 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a24afdded004ee09368daea34ead50e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.093219 12747 tablet.cc:1751] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:00.093773 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 6e644bfe06ff4ca89066b1ded01f2b90
I20260925 01:50:00.094413 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 11a0a886d73442bd9753df870acf63f7
I20260925 01:50:00.095181 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f1d2d998d834c21ab83694daae37520 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:00.096288 11755 tablet_bootstrap.cc:654] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.097411 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 11a0a886d73442bd9753df870acf63f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.097872 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e644bfe06ff4ca89066b1ded01f2b90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.097981 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 11a0a886d73442bd9753df870acf63f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.098918 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c544bdd60f9f4b30ac00700239f9f0fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.099532 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c544bdd60f9f4b30ac00700239f9f0fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.101205 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e644bfe06ff4ca89066b1ded01f2b90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.106279 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2a37a6deaeb24c99824b62fbb2d603b1
W20260925 01:50:00.107285 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 11a0a886d73442bd9753df870acf63f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11a0a886d73442bd9753df870acf63f7 already in progress: creating tablet
I20260925 01:50:00.108151 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e40083a885974e3595ec2fb5b16d4a5d
I20260925 01:50:00.108187 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.108456 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.108749 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.108985 12689 tablet_replica.cc:333] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.109174 12689 raft_consensus.cc:2243] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.109326 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet e40083a885974e3595ec2fb5b16d4a5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.109362 12689 raft_consensus.cc:2272] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.110213 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet e40083a885974e3595ec2fb5b16d4a5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.110952 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.111159 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet e40083a885974e3595ec2fb5b16d4a5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.112531 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 11a0a886d73442bd9753df870acf63f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:00.113190 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab09d980c0814a2f8babc83222f2bc17 consensus state has no leader
I20260925 01:50:00.118892 11753 tablet_bootstrap.cc:654] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.123075 11755 tablet_bootstrap.cc:492] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.123333 11755 ts_tablet_manager.cc:1403] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.093s user 0.005s sys 0.002s
I20260925 01:50:00.124524 11755 raft_consensus.cc:359] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.124778 11755 raft_consensus.cc:385] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.125224 11755 raft_consensus.cc:740] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.125524 11755 consensus_queue.cc:260] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.128717 12745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40776 (request call id 479) took 1167 ms. Trace:
I20260925 01:50:00.129042 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7b35a535e73d457fa656be9ee5291649"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.129169 11755 ts_tablet_manager.cc:1434] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260925 01:50:00.129829 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b35a535e73d457fa656be9ee5291649 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.131713 12696 raft_consensus.cc:493] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.131870 12696 raft_consensus.cc:515] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.132098 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d830470740bc47ae97621cd325b9ef73" } new_table_name: "default.Table_27561da3e76c4d8286ab6090d93c7684" modify_external_catalogs: true
I20260925 01:50:00.132550 12696 leader_election.cc:290] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.133879 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 1 got 0
I20260925 01:50:00.134116 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:00.134183 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e95fb28febd94a26ba9682fb9a462872" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:00.134371 11521 raft_consensus.cc:2468] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:00.135456 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_65d991e4d853418794cdc5969c263ba2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.135728 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:00.136269 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65d991e4d853418794cdc5969c263ba2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.136408 11176 leader_election.cc:304] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:00.137518 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e4155c334ef147f5ba69e879f6cfb9d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.138046 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4155c334ef147f5ba69e879f6cfb9d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.139407 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_25bbdb6b8b6047d890e3355231bd7975"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.123368 11953 ts_tablet_manager.cc:1929] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:00.139865 11953 log.cc:1199] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a3358b78a1da48388d1f72536b1ed0a2
W20260925 01:50:00.139945 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25bbdb6b8b6047d890e3355231bd7975 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.140327 11953 ts_tablet_manager.cc:1950] T a3358b78a1da48388d1f72536b1ed0a2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:00.141619 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_12112ab3522a4098be2d43c7a7d99987"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.142191 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 644b28192e3b45e7b5370d55804cb043 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.142609 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fe947074863044c1a8640092735a51fc
I20260925 01:50:00.144176 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet fe947074863044c1a8640092735a51fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.144752 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8152c9e0b0af4ab2a18c5a0080e22ffc
I20260925 01:50:00.144528 11675 catalog_manager.cc:5838] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:00.145324 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:00.145691 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc with delete_type TABLET_DATA_DELETED (replaced by tablet b8f82aa815bd42bdbf70a673e3a4c9da) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.145985 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet fe947074863044c1a8640092735a51fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.146258 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc with delete_type TABLET_DATA_DELETED (replaced by tablet b8f82aa815bd42bdbf70a673e3a4c9da) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.146543 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc with delete_type TABLET_DATA_DELETED (replaced by tablet b8f82aa815bd42bdbf70a673e3a4c9da) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.146710 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]). Expected version 2 got 0
W20260925 01:50:00.147011 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12112ab3522a4098be2d43c7a7d99987 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.147176 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:50:00.147604 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:50:00.148038 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
I20260925 01:50:00.146428 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 8152c9e0b0af4ab2a18c5a0080e22ffc deleted and replaced by tablet b8f82aa815bd42bdbf70a673e3a4c9da
I20260925 01:50:00.149487 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet fe947074863044c1a8640092735a51fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:00.149539 10879 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 10958: Timed out: CheckLeaks RPC to 127.10.159.253:42889 timed out after 1.000s (SENT)
I20260925 01:50:00.149878 10879 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAIg11R/build/asan/bin/kudu with pid 10958
I20260925 01:50:00.151518 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e644bfe06ff4ca89066b1ded01f2b90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.129000 12745 rpcz_store.cc:276] 0925 01:49:58.985329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.122447 (+137118us) service_pool.cc:224] Handling call
0925 01:50:00.128694 (+1006247us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:49:59.298984 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:49:59.299125 (+ 141us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:49:59.299133 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0925 01:49:59.299141 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:49:59.299184 (+ 43us) alter_schema_op.cc:128] START. Timestamp: 1790300999299142
0925 01:49:59.299186 (+ 2us) op_driver.cc:348] REPLICATION: starting
0925 01:49:59.299404 (+ 218us) log.cc:844] Serialized 173 byte log entry
0925 01:50:00.035340 (+735936us) op_driver.cc:464] REPLICATION: finished
0925 01:50:00.053183 (+ 17843us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:50:00.100114 (+ 46931us) log.cc:844] Serialized 5 byte log entry
0925 01:50:00.104287 (+ 4173us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.128333 (+ 24046us) log.cc:844] Serialized 14 byte log entry
0925 01:50:00.128637 (+ 304us) alter_schema_op.cc:73] Released schema lock
0925 01:50:00.128645 (+ 8us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":17777,"prepare.queue_time_us":92470,"prepare.run_cpu_time_us":35083,"prepare.run_wall_time_us":213878,"raft.queue_time_us":82,"raft.run_cpu_time_us":849,"raft.run_wall_time_us":11192,"replication_time_us":736125,"spinlock_wait_cycles":1255808,"thread_start_us":305517,"threads_started":3,"wal-append.queue_time_us":209661}]]}
I20260925 01:50:00.154094 11753 tablet_bootstrap.cc:492] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.154235 11753 ts_tablet_manager.cc:1403] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.090s user 0.003s sys 0.001s
I20260925 01:50:00.154325 12689 ts_tablet_manager.cc:1916] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.155045 11753 raft_consensus.cc:359] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.155198 11753 raft_consensus.cc:385] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.155243 11753 raft_consensus.cc:740] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.155522 11946 ts_tablet_manager.cc:1929] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:00.155638 11946 log.cc:1199] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/3c5021ab79dc4eaf9ed612f7125a6dca
I20260925 01:50:00.156015 11946 ts_tablet_manager.cc:1950] T 3c5021ab79dc4eaf9ed612f7125a6dca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:00.156823 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 382) took 3406 ms. Trace:
I20260925 01:50:00.156932 11946 rpcz_store.cc:276] 0925 01:49:56.750231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.753869 (+ 3638us) service_pool.cc:224] Handling call
0925 01:50:00.049682 (+3295813us) ts_tablet_manager.cc:1151] Deleting tablet 3c5021ab79dc4eaf9ed612f7125a6dca
0925 01:50:00.049693 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.108398 (+ 58705us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.155457 (+ 47059us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.156802 (+ 1345us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3220180}
I20260925 01:50:00.157470 12752 raft_consensus.cc:2804] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.157564 12752 raft_consensus.cc:493] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.157644 12752 raft_consensus.cc:3060] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.158527 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_17cf387aca9e4b949195e91a5101157e [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]) successfully deleted
I20260925 01:50:00.160696 12752 raft_consensus.cc:515] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.161381 11753 consensus_queue.cc:260] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.162228 11753 ts_tablet_manager.cc:1434] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:50:00.163203 12689 ts_tablet_manager.cc:1929] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.163350 12689 log.cc:1199] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/9cd2e1bf7d3e4459a84235b9c3f5383c
I20260925 01:50:00.163703 12689 ts_tablet_manager.cc:1950] T 9cd2e1bf7d3e4459a84235b9c3f5383c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:00.164780 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 9cd2e1bf7d3e4459a84235b9c3f5383c (table default.Table_962d7117724d4e5aa1b45a6fab966667 [id=768d79ef588e46be97ceffa64db19940]) successfully deleted
W20260925 01:50:00.165508 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2a37a6deaeb24c99824b62fbb2d603b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a37a6deaeb24c99824b62fbb2d603b1 already in progress: creating tablet
W20260925 01:50:00.166160 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e40083a885974e3595ec2fb5b16d4a5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e40083a885974e3595ec2fb5b16d4a5d already in progress: creating tablet
W20260925 01:50:00.166759 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet fe947074863044c1a8640092735a51fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe947074863044c1a8640092735a51fc already in progress: creating tablet
W20260925 01:50:00.167354 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8152c9e0b0af4ab2a18c5a0080e22ffc already in progress: creating tablet
W20260925 01:50:00.167951 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 6e644bfe06ff4ca89066b1ded01f2b90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e644bfe06ff4ca89066b1ded01f2b90 already in progress: creating tablet
I20260925 01:50:00.170846 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a30fe60bacc84cf5805f7b80eb570f11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.171445 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a30fe60bacc84cf5805f7b80eb570f11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.173763 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cee543ab798e45a8b000515354a8ce3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.174379 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cee543ab798e45a8b000515354a8ce3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.178625 11753 tablet_bootstrap.cc:492] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.179164 11360 tablet_service.cc:1511] Processing CreateTablet for tablet f0aecb232c2a478f9749a950441cede5 (DEFAULT_TABLE table=default.Table_9f461e15eec54624815b8077dbde7098 [id=5b5b48ae6d9c4af991c12321e46e2ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.180769 11753 tablet_bootstrap.cc:654] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.181228 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 679cbe0cc09b47938f60959d845d1767 (DEFAULT_TABLE table=default.Table_1a952a0b0caf4fec81d7f1cecb5eb9c5 [id=24989110daae40f4a393119c90f3e15f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.181594 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679cbe0cc09b47938f60959d845d1767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.185770 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 383) took 3364 ms. Trace:
I20260925 01:50:00.186827 11946 rpcz_store.cc:276] 0925 01:49:56.814381 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.814504 (+ 123us) service_pool.cc:224] Handling call
0925 01:50:00.157227 (+3342723us) ts_tablet_manager.cc:1151] Deleting tablet a86ac7e553854304ba7b3b1d38c86c53
0925 01:50:00.157237 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.179269 (+ 22032us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3323240}
I20260925 01:50:00.188563 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 679cbe0cc09b47938f60959d845d1767 (DEFAULT_TABLE table=default.Table_1a952a0b0caf4fec81d7f1cecb5eb9c5 [id=24989110daae40f4a393119c90f3e15f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.188956 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679cbe0cc09b47938f60959d845d1767. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:00.189560 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a86ac7e553854304ba7b3b1d38c86c53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a86ac7e553854304ba7b3b1d38c86c53 already in progress: creating tablet
I20260925 01:50:00.192705 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 393) took 3089 ms. Trace:
I20260925 01:50:00.194149 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e95fb28febd94a26ba9682fb9a462872" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:00.194341 11521 raft_consensus.cc:3060] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.194635 12487 raft_consensus.cc:2749] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:00.194701 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 126207us
I20260925 01:50:00.194197 11946 rpcz_store.cc:276] 0925 01:49:57.102983 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.103051 (+ 68us) service_pool.cc:224] Handling call
0925 01:50:00.191012 (+3087961us) ts_tablet_manager.cc:1151] Deleting tablet 9e112a4ce48f40a196f655379c758c9c
0925 01:50:00.191280 (+ 268us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.192681 (+ 1401us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3087217}
I20260925 01:50:00.197619 11521 raft_consensus.cc:2468] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:00.198392 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9e112a4ce48f40a196f655379c758c9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e112a4ce48f40a196f655379c758c9c already in progress: creating tablet
I20260925 01:50:00.198650 11176 leader_election.cc:304] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:00.199020 12696 raft_consensus.cc:2804] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:00.197477 12752 leader_election.cc:290] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.203002 11754 tablet_bootstrap.cc:492] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.203159 11754 ts_tablet_manager.cc:1403] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.004s
I20260925 01:50:00.204272 11754 raft_consensus.cc:359] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.204507 11754 raft_consensus.cc:385] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.204583 11754 raft_consensus.cc:740] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.204833 11754 consensus_queue.cc:260] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:00.206261 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60b99f56bd6b49f7998f51c49df4f58e consensus state has no leader
I20260925 01:50:00.211156 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_528651c000214450855f6b0e0a816d7a" } new_table_name: "default.Table_7b67291b25a14a5a99c0ad3f31c667e7" modify_external_catalogs: true
I20260925 01:50:00.212747 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_81a22cdbb608445c9146c6b95401bffc" } new_table_name: "default.Table_a6b67f9415ae41dbaf3903dbbaec308f" modify_external_catalogs: true
I20260925 01:50:00.214459 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e4f96795b3f4431982381d0b4c300ce6" } new_table_name: "default.Table_bc3a5e48fbb543aa9ca4c1401a5699c8" modify_external_catalogs: true
I20260925 01:50:00.217455 12731 raft_consensus.cc:493] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.217613 12731 raft_consensus.cc:515] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.217701 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 394) took 3114 ms. Trace:
I20260925 01:50:00.217794 11946 rpcz_store.cc:276] 0925 01:49:57.103162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.103382 (+ 220us) service_pool.cc:224] Handling call
0925 01:50:00.213473 (+3110091us) ts_tablet_manager.cc:1151] Deleting tablet 4930edeb2edd4e7494dbf1761b5d20c0
0925 01:50:00.214154 (+ 681us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.217678 (+ 3524us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3090861}
I20260925 01:50:00.218411 12731 leader_election.cc:290] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.219403 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad9d992f7ed4021a7e472dd38ad2c2e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:00.219615 11238 raft_consensus.cc:2468] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.220289 11456 leader_election.cc:304] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:00.220602 12731 raft_consensus.cc:2804] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.220685 12731 raft_consensus.cc:493] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.220755 12731 raft_consensus.cc:3060] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.224107 12731 raft_consensus.cc:515] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.225533 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad9d992f7ed4021a7e472dd38ad2c2e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:00.225803 11238 raft_consensus.cc:3060] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.225883 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e95fb28febd94a26ba9682fb9a462872" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.226106 11380 raft_consensus.cc:2468] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:00.226570 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca17585cd523440ca1e9b754f3aedf8a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:00.226758 11376 raft_consensus.cc:3060] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.229143 11238 raft_consensus.cc:2468] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:00.230093 11456 leader_election.cc:304] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:00.230436 12640 raft_consensus.cc:2804] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:00.230558 12640 raft_consensus.cc:697] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:00.229700 11376 raft_consensus.cc:2468] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:00.230798 12640 consensus_queue.cc:237] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.232875 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:00.233089 11374 raft_consensus.cc:3060] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.233011 12731 leader_election.cc:290] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.236048 11374 raft_consensus.cc:2468] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:00.236562 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e95fb28febd94a26ba9682fb9a462872" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:00.236720 11378 raft_consensus.cc:3060] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.239492 11378 raft_consensus.cc:2468] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:00.239739 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.239960 11377 raft_consensus.cc:2376] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1. Re-sending same reply.
I20260925 01:50:00.242110 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0aecb232c2a478f9749a950441cede5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.252331 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 679cbe0cc09b47938f60959d845d1767 (DEFAULT_TABLE table=default.Table_1a952a0b0caf4fec81d7f1cecb5eb9c5 [id=24989110daae40f4a393119c90f3e15f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.252848 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 679cbe0cc09b47938f60959d845d1767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.253002 11754 ts_tablet_manager.cc:1434] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.050s user 0.000s sys 0.009s
I20260925 01:50:00.257378 11754 tablet_bootstrap.cc:492] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.257683 11755 tablet_bootstrap.cc:492] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.258261 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad9d992f7ed4021a7e472dd38ad2c2e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.258494 11370 raft_consensus.cc:2468] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.259234 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 396) took 3149 ms. Trace:
I20260925 01:50:00.259421 11755 tablet_bootstrap.cc:654] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.260501 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 176) took 9775 ms. Trace:
I20260925 01:50:00.260613 11953 rpcz_store.cc:276] 0925 01:49:50.485621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.490402 (+ 4781us) service_pool.cc:224] Handling call
0925 01:50:00.022720 (+9532318us) ts_tablet_manager.cc:1151] Deleting tablet a3358b78a1da48388d1f72536b1ed0a2
0925 01:50:00.022729 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.093699 (+ 70970us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.123308 (+ 29609us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.260480 (+137172us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9531916}
I20260925 01:50:00.261094 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 179) took 9770 ms. Trace:
I20260925 01:50:00.261195 11953 rpcz_store.cc:276] 0925 01:49:50.490825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.490930 (+ 105us) service_pool.cc:224] Handling call
0925 01:50:00.260949 (+9770019us) ts_tablet_manager.cc:1151] Deleting tablet 257e6f224f99427eb68fd61fa1aadae0
0925 01:50:00.260961 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.261075 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9769630}
I20260925 01:50:00.261536 11953 tablet_replica.cc:333] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:00.261792 11953 raft_consensus.cc:2243] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.261982 11953 raft_consensus.cc:2272] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.262290 11753 tablet_bootstrap.cc:492] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.261957 11946 rpcz_store.cc:276] 0925 01:49:57.110251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.110371 (+ 120us) service_pool.cc:224] Handling call
0925 01:50:00.259072 (+3148701us) ts_tablet_manager.cc:1151] Deleting tablet b306496f992f45a9b64b05b73712cb5b
0925 01:50:00.259083 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.259203 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3145827}
I20260925 01:50:00.262668 11953 ts_tablet_manager.cc:1916] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.263612 11753 ts_tablet_manager.cc:1403] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.007s
I20260925 01:50:00.263260 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 397) took 3151 ms. Trace:
I20260925 01:50:00.264447 11753 raft_consensus.cc:359] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.276082 11953 ts_tablet_manager.cc:1929] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.276219 11953 log.cc:1199] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8dd27c6d835948ba859b4c11d8ebf783
I20260925 01:50:00.267305 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:00.265007 11946 rpcz_store.cc:276] 0925 01:49:57.111499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.112125 (+ 626us) service_pool.cc:224] Handling call
0925 01:50:00.263110 (+3150985us) ts_tablet_manager.cc:1151] Deleting tablet 3e3a033c9e7545479130c7a3c48ac254
0925 01:50:00.263123 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.263241 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3148017}
I20260925 01:50:00.277019 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 416) took 2688 ms. Trace:
I20260925 01:50:00.277179 11946 rpcz_store.cc:276] 0925 01:49:57.588292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.588367 (+ 75us) service_pool.cc:224] Handling call
0925 01:50:00.276887 (+2688520us) ts_tablet_manager.cc:1151] Deleting tablet 49b110516abb45d1880d0e0e33e20174
0925 01:50:00.276898 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.277003 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2648856}
I20260925 01:50:00.277697 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 417) took 2689 ms. Trace:
I20260925 01:50:00.258863 12696 raft_consensus.cc:697] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:00.266499 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2feaab143fae4312915579fdb2ff1e40" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:00.277989 11238 raft_consensus.cc:2393] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:50:00.278148 12696 consensus_queue.cc:237] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.279419 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_208b9dab76244e869ba2e5f8ff865204"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.280063 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_208b9dab76244e869ba2e5f8ff865204 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.281073 11946 rpcz_store.cc:276] 0925 01:49:57.588519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.588582 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:00.277600 (+2689018us) ts_tablet_manager.cc:1151] Deleting tablet 5e6715233be44b9aad5210d17500f59d
0925 01:50:00.277609 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.277683 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2648505}
I20260925 01:50:00.280205 11753 raft_consensus.cc:385] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.281401 11753 raft_consensus.cc:740] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:00.281517 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 4930edeb2edd4e7494dbf1761b5d20c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4930edeb2edd4e7494dbf1761b5d20c0 already in progress: creating tablet
W20260925 01:50:00.281683 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 63305.4us
I20260925 01:50:00.281697 11753 consensus_queue.cc:260] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.282316 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 420) took 2692 ms. Trace:
I20260925 01:50:00.282406 11946 rpcz_store.cc:276] 0925 01:49:57.589423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.589738 (+ 315us) service_pool.cc:224] Handling call
0925 01:50:00.282170 (+2692432us) ts_tablet_manager.cc:1151] Deleting tablet 811b957c4e6647ccaa688d7273ec9eeb
0925 01:50:00.282184 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.282295 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2652890}
I20260925 01:50:00.282650 11946 tablet_replica.cc:333] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:00.282828 11946 raft_consensus.cc:2243] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:00.283417 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 716ad6cdf9864fc3b09d88753d45f45f (DEFAULT_TABLE table=default.Table_af512ab1da7a45759866fe1ded30cc15 [id=85f9e36e698e4170b4104c627300c724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.283829 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716ad6cdf9864fc3b09d88753d45f45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.286329 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 00345732f7314624831b4cfc59e981f4 (DEFAULT_TABLE table=default.Table_0b317291cb904b7f9bbf1b8d05022488 [id=3dcfa6bc280f4cc6bbe834b9d866113f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.286676 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00345732f7314624831b4cfc59e981f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.295284 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 716ad6cdf9864fc3b09d88753d45f45f (DEFAULT_TABLE table=default.Table_af512ab1da7a45759866fe1ded30cc15 [id=85f9e36e698e4170b4104c627300c724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.295765 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716ad6cdf9864fc3b09d88753d45f45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.313239 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad9d992f7ed4021a7e472dd38ad2c2e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:00.313547 11375 raft_consensus.cc:3060] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.317703 11754 tablet_bootstrap.cc:654] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.317902 11375 raft_consensus.cc:2468] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:00.319036 11953 ts_tablet_manager.cc:1950] T 8dd27c6d835948ba859b4c11d8ebf783 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:00.319382 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 178) took 9829 ms. Trace:
I20260925 01:50:00.319486 11953 rpcz_store.cc:276] 0925 01:49:50.489703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.489777 (+ 74us) service_pool.cc:224] Handling call
0925 01:50:00.261484 (+9771707us) ts_tablet_manager.cc:1151] Deleting tablet 8dd27c6d835948ba859b4c11d8ebf783
0925 01:50:00.261496 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.269447 (+ 7951us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.276013 (+ 6566us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.319365 (+ 43352us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9761556}
I20260925 01:50:00.319875 12704 raft_consensus.cc:493] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.320029 12704 raft_consensus.cc:515] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.320688 12704 leader_election.cc:290] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:00.321717 11953 tablet_replica.cc:333] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:00.321934 11953 raft_consensus.cc:2243] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:00.322326 11953 raft_consensus.cc:2272] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.324805 12762 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:00.325611 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a3358b78a1da48388d1f72536b1ed0a2 (table default.Table_5f4b4ce122da40e4b0960e58bf811412 [id=ffb823f8ca1948faaf21d345a1643605]) successfully deleted
I20260925 01:50:00.326874 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 00345732f7314624831b4cfc59e981f4 (DEFAULT_TABLE table=default.Table_0b317291cb904b7f9bbf1b8d05022488 [id=3dcfa6bc280f4cc6bbe834b9d866113f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.327391 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00345732f7314624831b4cfc59e981f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:00.328052 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b306496f992f45a9b64b05b73712cb5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b306496f992f45a9b64b05b73712cb5b already in progress: creating tablet
W20260925 01:50:00.328245 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 45432.8us
W20260925 01:50:00.328544 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3e3a033c9e7545479130c7a3c48ac254 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e3a033c9e7545479130c7a3c48ac254 already in progress: creating tablet
W20260925 01:50:00.328738 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 49b110516abb45d1880d0e0e33e20174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49b110516abb45d1880d0e0e33e20174 already in progress: creating tablet
W20260925 01:50:00.328930 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5e6715233be44b9aad5210d17500f59d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e6715233be44b9aad5210d17500f59d already in progress: creating tablet
W20260925 01:50:00.329108 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 811b957c4e6647ccaa688d7273ec9eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 811b957c4e6647ccaa688d7273ec9eeb already in progress: creating tablet
I20260925 01:50:00.330554 11753 ts_tablet_manager.cc:1434] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.067s user 0.001s sys 0.001s
I20260925 01:50:00.330768 11496 tablet_service.cc:1511] Processing CreateTablet for tablet cea3ad181ffa42d694a609bf99001c75 (DEFAULT_TABLE table=default.Table_c60e42eaec624765b51e956e32a4619c [id=ea22bfefbb864719963f9584970bf5f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.330880 11753 tablet_bootstrap.cc:492] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.331156 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea3ad181ffa42d694a609bf99001c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.331346 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 00345732f7314624831b4cfc59e981f4 (DEFAULT_TABLE table=default.Table_0b317291cb904b7f9bbf1b8d05022488 [id=3dcfa6bc280f4cc6bbe834b9d866113f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.331689 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00345732f7314624831b4cfc59e981f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.332619 11753 tablet_bootstrap.cc:654] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:00.334254 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 257e6f224f99427eb68fd61fa1aadae0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 257e6f224f99427eb68fd61fa1aadae0 already in progress: creating tablet
I20260925 01:50:00.334584 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 8dd27c6d835948ba859b4c11d8ebf783 (table default.Table_7eb435d3e2ec4209bdd1f04597fcadd8 [id=e93d9881c42d4a51a90c1ffb5fe17930]) successfully deleted
W20260925 01:50:00.343240 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 57338.2us
I20260925 01:50:00.343852 11457 leader_election.cc:304] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:00.344293 12508 raft_consensus.cc:2804] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:00.346473 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 716ad6cdf9864fc3b09d88753d45f45f (DEFAULT_TABLE table=default.Table_af512ab1da7a45759866fe1ded30cc15 [id=85f9e36e698e4170b4104c627300c724]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.347074 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716ad6cdf9864fc3b09d88753d45f45f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.349186 12704 raft_consensus.cc:493] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.349545 12704 raft_consensus.cc:515] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.350243 12704 leader_election.cc:290] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:00.350291 11946 pending_rounds.cc:70] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:00.350353 11946 pending_rounds.cc:77] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072889257906176 op_type: NO_OP noop_request { }
I20260925 01:50:00.350986 11946 raft_consensus.cc:2889] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:00.351402 11946 raft_consensus.cc:2272] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.352551 11946 ts_tablet_manager.cc:1916] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.355618 11352 tablet_service.cc:1511] Processing CreateTablet for tablet cea3ad181ffa42d694a609bf99001c75 (DEFAULT_TABLE table=default.Table_c60e42eaec624765b51e956e32a4619c [id=ea22bfefbb864719963f9584970bf5f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.357120 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea3ad181ffa42d694a609bf99001c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.358866 11314 leader_election.cc:304] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:00.359160 12445 raft_consensus.cc:2749] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:00.362156 12766 tablet.cc:1751] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:00.363850 12765 tablet.cc:1751] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:00.370359 12508 raft_consensus.cc:697] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:00.370746 12508 consensus_queue.cc:237] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.354969 11208 tablet_service.cc:1511] Processing CreateTablet for tablet a0eb84a118aa43b5b82b12c454fdf0e7 (DEFAULT_TABLE table=default.Table_5652bb3084d3458c95041da9ffa64c8b [id=5c9b7bb394bd4f7aa5f571c6604d4d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.391232 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ee607bb78c5e460d97313b3352e1e93f" } modify_external_catalogs: true
I20260925 01:50:00.391490 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ee607bb78c5e460d97313b3352e1e93f" } modify_external_catalogs: true
I20260925 01:50:00.391706 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c5ab983011a64d018825a79f53480036" } modify_external_catalogs: true
I20260925 01:50:00.391938 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c5ab983011a64d018825a79f53480036" } modify_external_catalogs: true
I20260925 01:50:00.393164 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b548583918934673acadda748a1d2aff" } modify_external_catalogs: true
I20260925 01:50:00.393365 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b548583918934673acadda748a1d2aff" } modify_external_catalogs: true
I20260925 01:50:00.394603 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f8b12242c3e44c009dd3fd05771e971f" } modify_external_catalogs: true
I20260925 01:50:00.394744 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f8b12242c3e44c009dd3fd05771e971f" } modify_external_catalogs: true
I20260925 01:50:00.395346 11753 tablet_bootstrap.cc:492] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.395506 11753 ts_tablet_manager.cc:1403] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.002s
I20260925 01:50:00.395731 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eb84a118aa43b5b82b12c454fdf0e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:00.395991 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d55dc17217347138e912b48381f01c7 consensus state has no leader
I20260925 01:50:00.396310 11753 raft_consensus.cc:359] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.396382 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9def776d49c345a6b0a348773a6c5128" } new_table_name: "default.Table_7f7dafdc6f97469b84dfb97f6ae1ceb5" modify_external_catalogs: true
I20260925 01:50:00.396484 11753 raft_consensus.cc:385] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.396538 11753 raft_consensus.cc:740] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.396744 11753 consensus_queue.cc:260] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.397245 11753 ts_tablet_manager.cc:1434] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:00.397536 11753 tablet_bootstrap.cc:492] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.397993 11674 catalog_manager.cc:5838] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:00.365124 12764 tablet.cc:1751] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:00.398535 11674 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:50:00.402175 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet e2b9df8d98e5414186ef23b8b7f9cb61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.406538 12731 raft_consensus.cc:493] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.406829 12731 raft_consensus.cc:515] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.407552 12731 leader_election.cc:290] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.410302 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 596f8ddbcd16458aa4f287f4f11282a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.410764 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 19c718c83cfe49b9a745e06314e24409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.411054 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d9a26bbfd74a30a2ae0a61aacca4d1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:00.411391 11217 tablet_service.cc:1511] Processing CreateTablet for tablet cea3ad181ffa42d694a609bf99001c75 (DEFAULT_TABLE table=default.Table_c60e42eaec624765b51e956e32a4619c [id=ea22bfefbb864719963f9584970bf5f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:00.411682 11456 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:00.412130 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea3ad181ffa42d694a609bf99001c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.414680 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d9a26bbfd74a30a2ae0a61aacca4d1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:00.415512 11502 tablet_service.cc:1511] Processing CreateTablet for tablet a0eb84a118aa43b5b82b12c454fdf0e7 (DEFAULT_TABLE table=default.Table_5652bb3084d3458c95041da9ffa64c8b [id=5c9b7bb394bd4f7aa5f571c6604d4d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.416160 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eb84a118aa43b5b82b12c454fdf0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.416631 11346 tablet_service.cc:1511] Processing CreateTablet for tablet a0eb84a118aa43b5b82b12c454fdf0e7 (DEFAULT_TABLE table=default.Table_5652bb3084d3458c95041da9ffa64c8b [id=5c9b7bb394bd4f7aa5f571c6604d4d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.416851 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d9a26bbfd74a30a2ae0a61aacca4d1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:00.417060 11522 raft_consensus.cc:2468] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:00.417790 11755 tablet_bootstrap.cc:492] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.418038 11755 ts_tablet_manager.cc:1403] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.160s user 0.011s sys 0.001s
I20260925 01:50:00.418267 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "644b28192e3b45e7b5370d55804cb043" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:00.418543 11521 raft_consensus.cc:2468] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:00.419667 11953 ts_tablet_manager.cc:1916] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.422257 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eb84a118aa43b5b82b12c454fdf0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.431241 11496 tablet_service.cc:1511] Processing CreateTablet for tablet d0edb8007afa42c6af8b289ff9cea830 (DEFAULT_TABLE table=default.Table_75c3e0255c9a431f82d32a7ab3a2a76e [id=66bff894fb4c4c8aae0780741c01d1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.432847 11346 tablet_service.cc:1511] Processing CreateTablet for tablet d0edb8007afa42c6af8b289ff9cea830 (DEFAULT_TABLE table=default.Table_75c3e0255c9a431f82d32a7ab3a2a76e [id=66bff894fb4c4c8aae0780741c01d1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.433337 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0edb8007afa42c6af8b289ff9cea830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.438097 11753 tablet_bootstrap.cc:654] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.440367 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 501f41a3ee1d440bb07033e29c38bc7a (DEFAULT_TABLE table=default.Table_ca6dba60babb4961bfc10a76b8cec13d [id=322335ff6f12469b91cb8af100a7f1f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:00.442420 11314 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
I20260925 01:50:00.442809 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 501f41a3ee1d440bb07033e29c38bc7a (DEFAULT_TABLE table=default.Table_ca6dba60babb4961bfc10a76b8cec13d [id=322335ff6f12469b91cb8af100a7f1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.443269 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501f41a3ee1d440bb07033e29c38bc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.443434 11497 tablet_service.cc:1511] Processing CreateTablet for tablet d6b0a7ae71724ba385371d3b772b067c (DEFAULT_TABLE table=default.Table_13eaf05cb87449d98c6212a88e7147e7 [id=4e540aa216454a26a34a02c8ac5f2624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.443490 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d9a26bbfd74a30a2ae0a61aacca4d1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.443689 11379 raft_consensus.cc:2468] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.445070 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0edb8007afa42c6af8b289ff9cea830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.445600 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b0a7ae71724ba385371d3b772b067c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.446184 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501f41a3ee1d440bb07033e29c38bc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.446383 12704 raft_consensus.cc:493] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:00.447651 11342 tablet_service.cc:1511] Processing CreateTablet for tablet d6b0a7ae71724ba385371d3b772b067c (DEFAULT_TABLE table=default.Table_13eaf05cb87449d98c6212a88e7147e7 [id=4e540aa216454a26a34a02c8ac5f2624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.448742 11207 tablet_service.cc:1511] Processing CreateTablet for tablet d6b0a7ae71724ba385371d3b772b067c (DEFAULT_TABLE table=default.Table_13eaf05cb87449d98c6212a88e7147e7 [id=4e540aa216454a26a34a02c8ac5f2624]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.449123 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b0a7ae71724ba385371d3b772b067c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.449576 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 501f41a3ee1d440bb07033e29c38bc7a (DEFAULT_TABLE table=default.Table_ca6dba60babb4961bfc10a76b8cec13d [id=322335ff6f12469b91cb8af100a7f1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.449875 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501f41a3ee1d440bb07033e29c38bc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.456454 11211 tablet_service.cc:1511] Processing CreateTablet for tablet d0edb8007afa42c6af8b289ff9cea830 (DEFAULT_TABLE table=default.Table_75c3e0255c9a431f82d32a7ab3a2a76e [id=66bff894fb4c4c8aae0780741c01d1ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:00.457114 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0edb8007afa42c6af8b289ff9cea830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.457844 11946 ts_tablet_manager.cc:1929] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:00.458029 11946 log.cc:1199] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:50:00.458235 11753 tablet_bootstrap.cc:492] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.458390 11753 ts_tablet_manager.cc:1403] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20260925 01:50:00.458635 11946 ts_tablet_manager.cc:1950] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:00.459183 11753 raft_consensus.cc:359] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.459367 11753 raft_consensus.cc:385] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.459439 11753 raft_consensus.cc:740] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.459587 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 421) took 2870 ms. Trace:
I20260925 01:50:00.459702 11946 rpcz_store.cc:276] 0925 01:49:57.589580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.589812 (+ 232us) service_pool.cc:224] Handling call
0925 01:50:00.282608 (+2692796us) ts_tablet_manager.cc:1151] Deleting tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c
0925 01:50:00.282615 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.389384 (+106769us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.457781 (+ 68397us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.459564 (+ 1783us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60116,"tablet-delete.queue_time_us":2653182}
I20260925 01:50:00.460518 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c (table default.Table_5853dcaed91a4f87b5d7b36db7a61965 [id=1b2a20dc907c4e3ca2a5c4a41fd46378]) successfully deleted
I20260925 01:50:00.461057 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 419) took 2872 ms. Trace:
I20260925 01:50:00.461185 11946 rpcz_store.cc:276] 0925 01:49:57.588759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.588830 (+ 71us) service_pool.cc:224] Handling call
0925 01:50:00.460900 (+2872070us) ts_tablet_manager.cc:1151] Deleting tablet fce91b00d3a14e6398abacad61ff5b0f
0925 01:50:00.460909 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.461039 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2831344}
W20260925 01:50:00.461838 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet fce91b00d3a14e6398abacad61ff5b0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fce91b00d3a14e6398abacad61ff5b0f already in progress: creating tablet
I20260925 01:50:00.459704 11753 consensus_queue.cc:260] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.462392 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 418) took 2873 ms. Trace:
I20260925 01:50:00.462697 11753 ts_tablet_manager.cc:1434] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:00.463974 11753 tablet_bootstrap.cc:492] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:00.464999 11456 consensus_peers.cc:597] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 331380a2be9a4893927c9b94a2c3e08b. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:00.465891 11753 tablet_bootstrap.cc:654] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.480427 11753 tablet_bootstrap.cc:492] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.480597 11753 ts_tablet_manager.cc:1403] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20260925 01:50:00.481349 11753 raft_consensus.cc:359] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.481658 11753 raft_consensus.cc:385] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.481734 11753 raft_consensus.cc:740] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.481973 11753 consensus_queue.cc:260] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.482507 11753 ts_tablet_manager.cc:1434] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260925 01:50:00.500597 11667 connection.cc:573] client connection to 127.10.159.253:42889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:00.500787 11667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 6 similar messages]
W20260925 01:50:00.507072 11458 connection.cc:573] client connection to 127.10.159.253:42889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:00.507359 11178 connection.cc:573] client connection to 127.10.159.253:42889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 01:50:00.526144 12770 raft_consensus.cc:493] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.526351 12770 raft_consensus.cc:515] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.527245 12770 leader_election.cc:290] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:00.536106 11667 consensus_peers.cc:597] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 -> Peer ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889): Couldn't send request to peer ec2f98d6295c4f8ead68b46f01e73d37. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:00.541587 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347a144e18ab4f6e834551044a2ac4ae" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:00.541814 11238 raft_consensus.cc:2468] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.542532 11456 leader_election.cc:304] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:00.542969 12770 raft_consensus.cc:2804] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.543059 12770 raft_consensus.cc:493] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.543131 12770 raft_consensus.cc:3060] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.546671 11754 tablet_bootstrap.cc:492] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.546846 11754 ts_tablet_manager.cc:1403] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.290s user 0.003s sys 0.001s
I20260925 01:50:00.546728 12770 raft_consensus.cc:515] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.547593 11754 raft_consensus.cc:359] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.547773 11754 raft_consensus.cc:385] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.547834 11754 raft_consensus.cc:740] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.548086 12770 leader_election.cc:290] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.548054 11754 consensus_queue.cc:260] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.548852 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347a144e18ab4f6e834551044a2ac4ae" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:00.548998 11238 raft_consensus.cc:3060] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.552081 11238 raft_consensus.cc:2468] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:00.553287 11456 leader_election.cc:304] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:00.553653 12770 raft_consensus.cc:2804] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:00.553809 12770 raft_consensus.cc:697] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:00.554250 12770 consensus_queue.cc:237] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:00.554762 11314 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:00.555009 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b0a7ae71724ba385371d3b772b067c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:00.557099 12445 raft_consensus.cc:493] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.557230 12445 raft_consensus.cc:515] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.557319 12704 raft_consensus.cc:515] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:00.556365 11753 tablet_bootstrap.cc:492] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.561982 11754 ts_tablet_manager.cc:1434] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260925 01:50:00.563025 11753 tablet_bootstrap.cc:654] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.564324 11754 tablet_bootstrap.cc:492] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.566744 11754 tablet_bootstrap.cc:654] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.567895 11946 rpcz_store.cc:276] 0925 01:49:57.588651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.588709 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:00.462225 (+2873516us) ts_tablet_manager.cc:1151] Deleting tablet 8909181e04be451aa8aeb219c9da8b89
0925 01:50:00.462234 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.462375 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2832523}
I20260925 01:50:00.568427 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 435) took 2374 ms. Trace:
I20260925 01:50:00.568511 11946 rpcz_store.cc:276] 0925 01:49:58.194033 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.203226 (+ 9193us) service_pool.cc:224] Handling call
0925 01:50:00.568295 (+2365069us) ts_tablet_manager.cc:1151] Deleting tablet 09a79f0bd7374dabb2edc5ddf5fc8e41
0925 01:50:00.568308 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.568409 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2364656}
W20260925 01:50:00.568636 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8909181e04be451aa8aeb219c9da8b89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8909181e04be451aa8aeb219c9da8b89 already in progress: creating tablet
I20260925 01:50:00.568838 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 436) took 2340 ms. Trace:
I20260925 01:50:00.568912 11946 rpcz_store.cc:276] 0925 01:49:58.228225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.229673 (+ 1448us) service_pool.cc:224] Handling call
0925 01:50:00.568738 (+2339065us) ts_tablet_manager.cc:1151] Deleting tablet e2ba874cb6a34ccd9e59cc9146280c17
0925 01:50:00.568747 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.568824 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2338824}
I20260925 01:50:00.569250 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 438) took 2318 ms. Trace:
I20260925 01:50:00.569320 11946 rpcz_store.cc:276] 0925 01:49:58.251111 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.251360 (+ 249us) service_pool.cc:224] Handling call
0925 01:50:00.569145 (+2317785us) ts_tablet_manager.cc:1151] Deleting tablet c8944feb988d4509b8601689ac02b11b
0925 01:50:00.569153 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.569236 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2317273}
W20260925 01:50:00.569402 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 already in progress: creating tablet
I20260925 01:50:00.569615 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 439) took 2318 ms. Trace:
W20260925 01:50:00.569681 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e2ba874cb6a34ccd9e59cc9146280c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ba874cb6a34ccd9e59cc9146280c17 already in progress: creating tablet
I20260925 01:50:00.569689 11946 rpcz_store.cc:276] 0925 01:49:58.251296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.251350 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:00.569524 (+2318174us) ts_tablet_manager.cc:1151] Deleting tablet 9663d7f4008e4ee0a3ba4373258242eb
0925 01:50:00.569532 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.569600 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2317146}
I20260925 01:50:00.569983 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 437) took 2319 ms. Trace:
I20260925 01:50:00.570050 11946 rpcz_store.cc:276] 0925 01:49:58.250945 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.252659 (+ 1714us) service_pool.cc:224] Handling call
0925 01:50:00.569885 (+2317226us) ts_tablet_manager.cc:1151] Deleting tablet 6a773feeb51349a084efedfd338eafe0
0925 01:50:00.569892 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.569968 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2282572}
I20260925 01:50:00.570348 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 440) took 2266 ms. Trace:
I20260925 01:50:00.570425 11946 rpcz_store.cc:276] 0925 01:49:58.303819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.304222 (+ 403us) service_pool.cc:224] Handling call
0925 01:50:00.570276 (+2266054us) ts_tablet_manager.cc:1151] Deleting tablet 8bf42293dd5d452aa7ed9e0eaa78f54d
0925 01:50:00.570284 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.570335 (+ 51us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2257666}
W20260925 01:50:00.570595 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c8944feb988d4509b8601689ac02b11b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8944feb988d4509b8601689ac02b11b already in progress: creating tablet
I20260925 01:50:00.570755 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 460) took 1696 ms. Trace:
W20260925 01:50:00.570847 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9663d7f4008e4ee0a3ba4373258242eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9663d7f4008e4ee0a3ba4373258242eb already in progress: creating tablet
I20260925 01:50:00.570817 11946 rpcz_store.cc:276] 0925 01:49:58.874293 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.874382 (+ 89us) service_pool.cc:224] Handling call
0925 01:50:00.570663 (+1696281us) ts_tablet_manager.cc:1151] Deleting tablet 45c06bf5641542f5aa36b160b31d797f
0925 01:50:00.570671 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.570739 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1695778}
W20260925 01:50:00.571082 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 6a773feeb51349a084efedfd338eafe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a773feeb51349a084efedfd338eafe0 already in progress: creating tablet
I20260925 01:50:00.571205 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 461) took 1685 ms. Trace:
I20260925 01:50:00.571271 11946 rpcz_store.cc:276] 0925 01:49:58.885924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.885989 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:00.571089 (+1685100us) ts_tablet_manager.cc:1151] Deleting tablet 67c5e0fdc70243e8ba59e5e1faeecfc0
0925 01:50:00.571099 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.571190 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1684677}
I20260925 01:50:00.571518 11946 tablet_replica.cc:333] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:00.571715 11946 raft_consensus.cc:2243] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:00.571978 11946 pending_rounds.cc:70] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:00.572024 11946 pending_rounds.cc:77] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072894235594752 op_type: NO_OP noop_request { }
I20260925 01:50:00.572109 11946 raft_consensus.cc:2889] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:00.572187 11946 raft_consensus.cc:2272] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:00.572494 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8bf42293dd5d452aa7ed9e0eaa78f54d because the tablet was not found. No further retry: Not found: Tablet not found: 8bf42293dd5d452aa7ed9e0eaa78f54d
W20260925 01:50:00.572696 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 45c06bf5641542f5aa36b160b31d797f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45c06bf5641542f5aa36b160b31d797f already in progress: creating tablet
W20260925 01:50:00.507014 11316 connection.cc:573] client connection to 127.10.159.253:42889 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:00.574323 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 already in progress: creating tablet
I20260925 01:50:00.575321 12704 leader_election.cc:290] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:00.577569 12445 leader_election.cc:290] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:00.579418 11753 tablet_bootstrap.cc:492] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.579564 11753 ts_tablet_manager.cc:1403] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.000s
I20260925 01:50:00.582489 11753 raft_consensus.cc:359] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.582675 11753 raft_consensus.cc:385] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.582813 11753 raft_consensus.cc:740] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.583020 11753 consensus_queue.cc:260] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.583454 11753 ts_tablet_manager.cc:1434] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:00.583730 11753 tablet_bootstrap.cc:492] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.585412 11753 tablet_bootstrap.cc:654] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:00.605746 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a9ccd099cba4b92909bb17c45dfce8a consensus state has no leader
I20260925 01:50:00.606177 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d7b95bb1d61b4d5cac9713b3ee125e24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.606830 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7b95bb1d61b4d5cac9713b3ee125e24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.607154 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3702f09e45a14c80af716d642d30cdfa
I20260925 01:50:00.607993 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_695a13c8a1d34501a3974088cc356262" } modify_external_catalogs: true
W20260925 01:50:00.608100 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2f9bcd81d474b4d9b550f0f4e901198 has no consensus state
I20260925 01:50:00.608171 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_695a13c8a1d34501a3974088cc356262" } modify_external_catalogs: true
I20260925 01:50:00.608515 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_33457c10d7ea4f4f83faf8baf837b73d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.609010 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33457c10d7ea4f4f83faf8baf837b73d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.610339 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5695f3af46974cb6a662f8788f9543e0
I20260925 01:50:00.613098 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 5695f3af46974cb6a662f8788f9543e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.613480 11946 ts_tablet_manager.cc:1916] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.614699 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 5695f3af46974cb6a662f8788f9543e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.615249 11754 tablet_bootstrap.cc:492] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.615180 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fd035701fcd04644b86876963e515e35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.615558 11754 ts_tablet_manager.cc:1403] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.051s user 0.000s sys 0.004s
W20260925 01:50:00.615779 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd035701fcd04644b86876963e515e35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.616345 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 47b62644673447239feb0f8f851012ef
I20260925 01:50:00.616410 11754 raft_consensus.cc:359] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.616590 11754 raft_consensus.cc:385] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.616644 11754 raft_consensus.cc:740] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.617122 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_926b0c54f75341d4adb363f2d234edfb" } new_table_name: "default.Table_1a4908e115b54320999343cc2a52f8b7" modify_external_catalogs: true
W20260925 01:50:00.618032 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5695f3af46974cb6a662f8788f9543e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5695f3af46974cb6a662f8788f9543e0 already in progress: creating tablet
I20260925 01:50:00.618522 11753 tablet_bootstrap.cc:492] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.618552 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b62644673447239feb0f8f851012ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.618660 11753 ts_tablet_manager.cc:1403] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260925 01:50:00.619058 11754 consensus_queue.cc:260] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.619379 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b62644673447239feb0f8f851012ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.620021 11753 raft_consensus.cc:359] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:00.620147 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 47b62644673447239feb0f8f851012ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b62644673447239feb0f8f851012ef already in progress: creating tablet
I20260925 01:50:00.620247 11753 raft_consensus.cc:385] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.620317 11753 raft_consensus.cc:740] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.620546 11753 consensus_queue.cc:260] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.621158 11753 ts_tablet_manager.cc:1434] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:00.621841 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 3702f09e45a14c80af716d642d30cdfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:00.622576 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 3702f09e45a14c80af716d642d30cdfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3702f09e45a14c80af716d642d30cdfa already in progress: creating tablet
I20260925 01:50:00.623514 11754 ts_tablet_manager.cc:1434] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 01:50:00.624953 11754 tablet_bootstrap.cc:492] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.624420 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 3702f09e45a14c80af716d642d30cdfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.625619 11755 raft_consensus.cc:359] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.625813 11755 raft_consensus.cc:385] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.625895 11755 raft_consensus.cc:740] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.627537 11753 tablet_bootstrap.cc:492] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:00.628883 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c9364671fcc42dba51569d14979f030 consensus state has no leader
I20260925 01:50:00.630714 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 774d14d5c7884f4e96662779b3100056
I20260925 01:50:00.631322 11754 tablet_bootstrap.cc:654] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.632262 11671 catalog_manager.cc:5838] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d reported cstate change: term changed from 0 to 1, leader changed from <none> to aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194). New cstate: current_term: 1 leader_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: HEALTHY } } }
I20260925 01:50:00.632730 11671 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 1 got 0
I20260925 01:50:00.633253 11671 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:00.633445 11671 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
I20260925 01:50:00.633744 11671 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:50:00.635456 11753 tablet_bootstrap.cc:654] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.636648 11946 ts_tablet_manager.cc:1929] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:00.636752 11946 log.cc:1199] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/331380a2be9a4893927c9b94a2c3e08b
I20260925 01:50:00.637238 11946 ts_tablet_manager.cc:1950] T 331380a2be9a4893927c9b94a2c3e08b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:00.638202 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 463) took 1709 ms. Trace:
I20260925 01:50:00.638990 11946 rpcz_store.cc:276] 0925 01:49:58.928733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.929834 (+ 1101us) service_pool.cc:224] Handling call
0925 01:50:00.571476 (+1641642us) ts_tablet_manager.cc:1151] Deleting tablet 331380a2be9a4893927c9b94a2c3e08b
0925 01:50:00.571484 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.632348 (+ 60864us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.636590 (+ 4242us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.638184 (+ 1594us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1641239}
I20260925 01:50:00.639894 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 464) took 1711 ms. Trace:
I20260925 01:50:00.640100 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 774d14d5c7884f4e96662779b3100056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.640292 11946 rpcz_store.cc:276] 0925 01:49:58.928815 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.930282 (+ 1467us) service_pool.cc:224] Handling call
0925 01:50:00.639792 (+1709510us) ts_tablet_manager.cc:1151] Deleting tablet ea0fa393abfe4c5cb5a7f821ffdfaea7
0925 01:50:00.639801 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.639876 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1709201}
I20260925 01:50:00.640831 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 331380a2be9a4893927c9b94a2c3e08b (table default.Table_695a3148371f44738e7ed17a0f5d2ba1 [id=e59a426273844acdbd1ce81acc4132b5]) successfully deleted
I20260925 01:50:00.640928 11946 tablet_replica.cc:333] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:00.641189 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 because the tablet was not found. No further retry: Not found: Tablet not found: ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:50:00.641492 11946 raft_consensus.cc:2243] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:50:00.641796 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 774d14d5c7884f4e96662779b3100056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 774d14d5c7884f4e96662779b3100056 already in progress: creating tablet
I20260925 01:50:00.642076 11946 raft_consensus.cc:2272] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.642123 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 347a144e18ab4f6e834551044a2ac4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.642376 12689 tablet_replica.cc:333] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.642607 12689 raft_consensus.cc:2243] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.642774 12689 raft_consensus.cc:2272] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.643563 12689 ts_tablet_manager.cc:1916] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.644690 11946 ts_tablet_manager.cc:1916] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.651072 12689 ts_tablet_manager.cc:1929] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.651240 12689 log.cc:1199] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/347a144e18ab4f6e834551044a2ac4ae
I20260925 01:50:00.651607 12689 ts_tablet_manager.cc:1950] T 347a144e18ab4f6e834551044a2ac4ae P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:00.653795 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 774d14d5c7884f4e96662779b3100056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.626122 11755 consensus_queue.cc:260] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.653834 11753 tablet_bootstrap.cc:492] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.655206 11753 ts_tablet_manager.cc:1403] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20260925 01:50:00.656044 11753 raft_consensus.cc:359] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.656230 11753 raft_consensus.cc:385] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.656296 11753 raft_consensus.cc:740] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.656502 11753 consensus_queue.cc:260] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.657034 11753 ts_tablet_manager.cc:1434] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:00.657294 11753 tablet_bootstrap.cc:492] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.658331 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 347a144e18ab4f6e834551044a2ac4ae (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]) successfully deleted
I20260925 01:50:00.666743 11754 tablet_bootstrap.cc:492] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.666905 11754 ts_tablet_manager.cc:1403] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.001s
I20260925 01:50:00.667977 11753 tablet_bootstrap.cc:654] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.667876 11754 raft_consensus.cc:359] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.668077 11754 raft_consensus.cc:385] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.668164 11754 raft_consensus.cc:740] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.668473 11754 consensus_queue.cc:260] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.668756 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet 5695f3af46974cb6a662f8788f9543e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.670097 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b7368994d6964edf87f8ed676a790ca0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.670784 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7368994d6964edf87f8ed676a790ca0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.671249 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b62644673447239feb0f8f851012ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.671788 11754 ts_tablet_manager.cc:1434] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260925 01:50:00.672183 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_09785932e2864af7afe4554f30909290"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.672403 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet 3702f09e45a14c80af716d642d30cdfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:00.672729 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09785932e2864af7afe4554f30909290 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.673081 11754 tablet_bootstrap.cc:492] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.674917 11754 tablet_bootstrap.cc:654] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.675184 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 774d14d5c7884f4e96662779b3100056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.677454 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7af8acc141c7463baecaf9e462f76558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.677991 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7af8acc141c7463baecaf9e462f76558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.680132 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_71415b17dd35411f85245718ad9b25fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.680617 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71415b17dd35411f85245718ad9b25fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.685410 11755 ts_tablet_manager.cc:1434] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.267s user 0.000s sys 0.002s
I20260925 01:50:00.685709 11946 ts_tablet_manager.cc:1929] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:00.686600 11754 tablet_bootstrap.cc:492] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.686820 11754 ts_tablet_manager.cc:1403] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260925 01:50:00.687680 11754 raft_consensus.cc:359] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.687999 11754 raft_consensus.cc:385] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.688118 11754 raft_consensus.cc:740] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.688513 11754 consensus_queue.cc:260] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.689726 11755 tablet_bootstrap.cc:492] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.690655 11754 ts_tablet_manager.cc:1434] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:00.692139 11754 tablet_bootstrap.cc:492] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.693954 11754 tablet_bootstrap.cc:654] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.694154 11946 log.cc:1199] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/039ee80a2822417898c1d1d779f52867
W20260925 01:50:00.694445 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c4f1e725fe84552943563aa95687842 consensus state has no leader
I20260925 01:50:00.694672 11946 ts_tablet_manager.cc:1950] T 039ee80a2822417898c1d1d779f52867 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:00.694898 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b7432598d6f1496e8093cd785184a09b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.695519 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7432598d6f1496e8093cd785184a09b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.695675 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 465) took 1766 ms. Trace:
I20260925 01:50:00.695751 11946 rpcz_store.cc:276] 0925 01:49:58.928995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.930635 (+ 1640us) service_pool.cc:224] Handling call
0925 01:50:00.640882 (+1710247us) ts_tablet_manager.cc:1151] Deleting tablet 039ee80a2822417898c1d1d779f52867
0925 01:50:00.640891 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.648581 (+ 7690us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.685625 (+ 37044us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.695655 (+ 10030us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1710103}
I20260925 01:50:00.695971 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8aa8c36ce7d045509f360f2d180be25d" } new_table_name: "default.Table_6f3f81eb3bad47feb571e26253057f54" modify_external_catalogs: true
I20260925 01:50:00.696261 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 039ee80a2822417898c1d1d779f52867 (table default.Table_de50999ba7d245feb33ce6cd4a90bc03 [id=b011ff7009fc4e419f245e75f8fec10d]) successfully deleted
I20260925 01:50:00.697460 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8176372e797c4778a5761c5da6336218"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.697420 11676 catalog_manager.cc:5838] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:00.697808 11676 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
W20260925 01:50:00.697975 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8176372e797c4778a5761c5da6336218 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.699924 11753 tablet_bootstrap.cc:492] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.700044 11753 ts_tablet_manager.cc:1403] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260925 01:50:00.700838 11753 raft_consensus.cc:359] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.701023 11753 raft_consensus.cc:385] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.701072 11753 raft_consensus.cc:740] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.701282 11753 consensus_queue.cc:260] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.701771 11753 ts_tablet_manager.cc:1434] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:00.702123 11753 tablet_bootstrap.cc:492] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.705480 11671 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12] alter complete (version 2)
I20260925 01:50:00.712271 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 347a144e18ab4f6e834551044a2ac4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:00.712378 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cd34fa172904e51ade794892c580248 has no consensus state
I20260925 01:50:00.712627 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 38082c23d99148bb916b0ae74fd474b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:00.713953 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 158749us
I20260925 01:50:00.717022 11680 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_c4b146df79f340bf9b1dc7663cdbbcaf [id=f8317c3550b14fe3abf468ea0d755b88] alter complete (version 4)
I20260925 01:50:00.718351 12705 raft_consensus.cc:493] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.718511 12705 raft_consensus.cc:515] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.720574 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.720808 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 19c718c83cfe49b9a745e06314e24409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.721808 12689 tablet_replica.cc:333] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.722081 12689 raft_consensus.cc:2243] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.722318 12689 raft_consensus.cc:2272] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.723109 12689 ts_tablet_manager.cc:1916] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.724520 11753 tablet_bootstrap.cc:654] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.727581 12656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:50:00.727797 12656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
I20260925 01:50:00.729249 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.732278 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 30a5240093dd442a93bff006a965bc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.733664 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.734331 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 462) took 1805 ms. Trace:
I20260925 01:50:00.734424 11946 rpcz_store.cc:276] 0925 01:49:58.928615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.932318 (+ 3703us) service_pool.cc:224] Handling call
0925 01:50:00.707019 (+1774701us) ts_tablet_manager.cc:1151] Deleting tablet d3aadd649e4b4f489bfe4b0eea13ede8
0925 01:50:00.734176 (+ 27157us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.734308 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1774504}
I20260925 01:50:00.734815 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 466) took 1723 ms. Trace:
I20260925 01:50:00.734882 11946 rpcz_store.cc:276] 0925 01:49:59.011546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.011904 (+ 358us) service_pool.cc:224] Handling call
0925 01:50:00.734701 (+1722797us) ts_tablet_manager.cc:1151] Deleting tablet 70f4777a789a48a18cfadbfb9d49a708
0925 01:50:00.734710 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.734799 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1722634}
I20260925 01:50:00.735257 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 467) took 1723 ms. Trace:
I20260925 01:50:00.735343 11946 rpcz_store.cc:276] 0925 01:49:59.011703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.012101 (+ 398us) service_pool.cc:224] Handling call
0925 01:50:00.735126 (+1723025us) ts_tablet_manager.cc:1151] Deleting tablet be89c0911dfa4b9d83d6bd88755be2b2
0925 01:50:00.735138 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.735238 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1722867}
I20260925 01:50:00.735620 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 468) took 1721 ms. Trace:
I20260925 01:50:00.735673 11946 rpcz_store.cc:276] 0925 01:49:59.014506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.014813 (+ 307us) service_pool.cc:224] Handling call
0925 01:50:00.735537 (+1720724us) ts_tablet_manager.cc:1151] Deleting tablet 85ae2fbcec1d41dda3e0b32ce09a32f2
0925 01:50:00.735544 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.735608 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720536}
I20260925 01:50:00.736042 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 469) took 1720 ms. Trace:
I20260925 01:50:00.736120 11946 rpcz_store.cc:276] 0925 01:49:59.015146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.015191 (+ 45us) service_pool.cc:224] Handling call
0925 01:50:00.735912 (+1720721us) ts_tablet_manager.cc:1151] Deleting tablet d401574e89014d2aaa5f98d0d9a2729f
0925 01:50:00.735922 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.736024 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1720571}
I20260925 01:50:00.736439 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 475) took 1631 ms. Trace:
I20260925 01:50:00.736514 11946 rpcz_store.cc:276] 0925 01:49:59.105450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.105583 (+ 133us) service_pool.cc:224] Handling call
0925 01:50:00.736326 (+1630743us) ts_tablet_manager.cc:1151] Deleting tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3
0925 01:50:00.736337 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.736422 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1630439}
I20260925 01:50:00.736917 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 476) took 1631 ms. Trace:
I20260925 01:50:00.737004 11946 rpcz_store.cc:276] 0925 01:49:59.105545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.105779 (+ 234us) service_pool.cc:224] Handling call
0925 01:50:00.736787 (+1631008us) ts_tablet_manager.cc:1151] Deleting tablet f385af75e11c4643b4e7c2d899ee99a4
0925 01:50:00.736797 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.736901 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1630793}
I20260925 01:50:00.737341 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 478) took 1627 ms. Trace:
I20260925 01:50:00.737399 11946 rpcz_store.cc:276] 0925 01:49:59.109659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.109708 (+ 49us) service_pool.cc:224] Handling call
0925 01:50:00.737262 (+1627554us) ts_tablet_manager.cc:1151] Deleting tablet 982b2a3dcdcb44bd8ad8562f30c38f13
0925 01:50:00.737271 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.737329 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1627275}
I20260925 01:50:00.737681 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 481) took 1627 ms. Trace:
I20260925 01:50:00.737746 11946 rpcz_store.cc:276] 0925 01:49:59.110201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.126313 (+ 16112us) service_pool.cc:224] Handling call
0925 01:50:00.737592 (+1611279us) ts_tablet_manager.cc:1151] Deleting tablet c2fe086048c04e0db797272e50f21c91
0925 01:50:00.737600 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.737665 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1611091}
I20260925 01:50:00.737985 11946 tablet_replica.cc:333] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:00.739717 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d3aadd649e4b4f489bfe4b0eea13ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3aadd649e4b4f489bfe4b0eea13ede8 already in progress: creating tablet
W20260925 01:50:00.740013 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 70f4777a789a48a18cfadbfb9d49a708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f4777a789a48a18cfadbfb9d49a708 already in progress: creating tablet
W20260925 01:50:00.740216 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet be89c0911dfa4b9d83d6bd88755be2b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be89c0911dfa4b9d83d6bd88755be2b2 already in progress: creating tablet
W20260925 01:50:00.740490 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 already in progress: creating tablet
I20260925 01:50:00.741143 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:00.741425 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d401574e89014d2aaa5f98d0d9a2729f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d401574e89014d2aaa5f98d0d9a2729f already in progress: creating tablet
W20260925 01:50:00.714330 11314 consensus_peers.cc:597] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c5021ab79dc4eaf9ed612f7125a6dca. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:00.741675 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 already in progress: creating tablet
W20260925 01:50:00.741873 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f385af75e11c4643b4e7c2d899ee99a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f385af75e11c4643b4e7c2d899ee99a4 already in progress: creating tablet
W20260925 01:50:00.742165 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 982b2a3dcdcb44bd8ad8562f30c38f13 already in progress: creating tablet
W20260925 01:50:00.742347 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c2fe086048c04e0db797272e50f21c91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2fe086048c04e0db797272e50f21c91 already in progress: creating tablet
I20260925 01:50:00.743564 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.743731 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet f1b6ea676a1f4d99807029d8401251ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.743849 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d859207bbc4aefb26c726dce404c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.743968 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.744097 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.744447 12689 ts_tablet_manager.cc:1929] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.744459 11946 raft_consensus.cc:2243] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:00.744580 12689 log.cc:1199] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:50:00.744827 11946 pending_rounds.cc:70] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:00.744913 12689 ts_tablet_manager.cc:1950] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:00.744922 11946 pending_rounds.cc:77] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072897521586176 op_type: NO_OP noop_request { }
I20260925 01:50:00.745146 11946 raft_consensus.cc:2889] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:00.745291 11946 raft_consensus.cc:2272] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.746255 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.746522 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 (table default.Table_62819e2601e6498796cbf6ba500c43de [id=091267034b9049728ddece813abe0fed]) successfully deleted
I20260925 01:50:00.746327 11946 ts_tablet_manager.cc:1916] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.746971 12705 leader_election.cc:290] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:00.746531 11753 tablet_bootstrap.cc:492] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.747323 11753 ts_tablet_manager.cc:1403] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.001s
I20260925 01:50:00.747644 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet 38082c23d99148bb916b0ae74fd474b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:46 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.748091 11753 raft_consensus.cc:359] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.748253 11753 raft_consensus.cc:385] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.748304 11753 raft_consensus.cc:740] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.748517 11753 consensus_queue.cc:260] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.749119 11753 ts_tablet_manager.cc:1434] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:00.750130 11753 tablet_bootstrap.cc:492] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.752290 11753 tablet_bootstrap.cc:654] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.754194 11953 ts_tablet_manager.cc:1929] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:00.754299 11953 log.cc:1199] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c28c9e51d80a442486b78be32c74a94f
I20260925 01:50:00.754343 12689 tablet_replica.cc:333] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.754570 12689 raft_consensus.cc:2243] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.754729 12689 raft_consensus.cc:2272] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.755931 11953 ts_tablet_manager.cc:1950] T c28c9e51d80a442486b78be32c74a94f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:00.756891 11946 ts_tablet_manager.cc:1929] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:00.757057 11946 log.cc:1199] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:50:00.758601 12689 ts_tablet_manager.cc:1916] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.760193 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 180) took 10248 ms. Trace:
I20260925 01:50:00.760286 11953 rpcz_store.cc:276] 0925 01:49:50.512222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.512444 (+ 222us) service_pool.cc:224] Handling call
0925 01:50:00.321666 (+9809222us) ts_tablet_manager.cc:1151] Deleting tablet c28c9e51d80a442486b78be32c74a94f
0925 01:50:00.321677 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.592685 (+271008us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.754138 (+161453us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.760172 (+ 6034us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9808846}
I20260925 01:50:00.760638 11953 tablet_replica.cc:333] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:00.760602 12508 raft_consensus.cc:493] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.760726 12508 raft_consensus.cc:515] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.761312 12508 leader_election.cc:290] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.761765 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c28c9e51d80a442486b78be32c74a94f (table default.Table_f7f257d6361c41b08685b0f8cdeac396 [id=0a1d84812c534d6cacdd19ce2f3a0727]) successfully deleted
W20260925 01:50:00.762655 11456 leader_election.cc:343] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 9cd2e1bf7d3e4459a84235b9c3f5383c
I20260925 01:50:00.762835 12508 consensus_queue.cc:1048] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:00.763195 12770 raft_consensus.cc:493] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.763314 12770 raft_consensus.cc:515] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.763900 12770 leader_election.cc:290] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.764678 11953 raft_consensus.cc:2243] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: Raft consensus shutting down.
I20260925 01:50:00.765235 11953 raft_consensus.cc:2272] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:00.767289 11456 leader_election.cc:343] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 596f8ddbcd16458aa4f287f4f11282a1
I20260925 01:50:00.767992 11953 ts_tablet_manager.cc:1916] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.768479 11754 tablet_bootstrap.cc:492] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.768632 11754 ts_tablet_manager.cc:1403] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.077s user 0.012s sys 0.001s
I20260925 01:50:00.769516 11755 tablet_bootstrap.cc:654] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.771194 11754 raft_consensus.cc:359] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.771363 11754 raft_consensus.cc:385] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.771406 11754 raft_consensus.cc:740] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.771606 11754 consensus_queue.cc:260] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.775352 11754 ts_tablet_manager.cc:1434] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260925 01:50:00.775887 12689 ts_tablet_manager.cc:1929] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.775993 12689 log.cc:1199] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/19c718c83cfe49b9a745e06314e24409
I20260925 01:50:00.776319 12689 ts_tablet_manager.cc:1950] T 19c718c83cfe49b9a745e06314e24409 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:00.777119 11754 tablet_bootstrap.cc:492] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.777302 11753 tablet_bootstrap.cc:492] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.777372 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 19c718c83cfe49b9a745e06314e24409 (table default.Table_3134677312f34800bda02393eeaacbc1 [id=a1465ccb37624e9aa2abb95f1bbd1abd]) successfully deleted
I20260925 01:50:00.777448 11753 ts_tablet_manager.cc:1403] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260925 01:50:00.778255 11753 raft_consensus.cc:359] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.778434 11753 raft_consensus.cc:385] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.778505 11753 raft_consensus.cc:740] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.778731 11753 consensus_queue.cc:260] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.779271 11753 ts_tablet_manager.cc:1434] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:00.779534 11753 tablet_bootstrap.cc:492] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.781243 11753 tablet_bootstrap.cc:654] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.782490 11754 tablet_bootstrap.cc:654] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.783485 11946 ts_tablet_manager.cc:1950] T ca17585cd523440ca1e9b754f3aedf8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:00.784510 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 473) took 1679 ms. Trace:
I20260925 01:50:00.785271 11755 tablet_bootstrap.cc:492] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.785431 11755 ts_tablet_manager.cc:1403] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.003s
I20260925 01:50:00.786226 11755 raft_consensus.cc:359] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.782793 12689 tablet_replica.cc:333] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.786423 11755 raft_consensus.cc:385] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.786476 11755 raft_consensus.cc:740] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.786623 12689 raft_consensus.cc:2243] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.786669 11755 consensus_queue.cc:260] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.786813 12689 raft_consensus.cc:2272] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.787350 11755 ts_tablet_manager.cc:1434] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:00.787544 12689 ts_tablet_manager.cc:1916] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.790501 11755 tablet_bootstrap.cc:492] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.786615 11946 rpcz_store.cc:276] 0925 01:49:59.105143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.136307 (+ 31164us) service_pool.cc:224] Handling call
0925 01:50:00.737930 (+1601623us) ts_tablet_manager.cc:1151] Deleting tablet ca17585cd523440ca1e9b754f3aedf8a
0925 01:50:00.737941 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.753326 (+ 15385us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.756821 (+ 3495us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.784492 (+ 27671us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1595765}
I20260925 01:50:00.791464 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ca17585cd523440ca1e9b754f3aedf8a (table default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]) successfully deleted
I20260925 01:50:00.792044 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 486) took 1487 ms. Trace:
I20260925 01:50:00.792340 11753 tablet_bootstrap.cc:492] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.793156 11753 ts_tablet_manager.cc:1403] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.006s
I20260925 01:50:00.794116 11753 raft_consensus.cc:359] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.794380 11753 raft_consensus.cc:385] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.794468 11753 raft_consensus.cc:740] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.794634 11755 tablet_bootstrap.cc:654] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.794803 11753 consensus_queue.cc:260] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.796451 11753 ts_tablet_manager.cc:1434] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:00.797652 11753 tablet_bootstrap.cc:492] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.799504 11753 tablet_bootstrap.cc:654] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.800448 11946 rpcz_store.cc:276] 0925 01:49:59.304948 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.305012 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:00.791912 (+1486900us) ts_tablet_manager.cc:1151] Deleting tablet 7eee30b35eb94fa196e9ccd1de37175a
0925 01:50:00.791922 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.792027 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1486680}
W20260925 01:50:00.801373 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7eee30b35eb94fa196e9ccd1de37175a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eee30b35eb94fa196e9ccd1de37175a already in progress: creating tablet
I20260925 01:50:00.801489 11946 tablet_replica.cc:333] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:00.801664 11946 raft_consensus.cc:2243] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.741801 11314 leader_election.cc:304] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:00.801810 11946 raft_consensus.cc:2272] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.803972 11946 ts_tablet_manager.cc:1916] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:00.804433 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 9c4f1e725fe84552943563aa95687842 (table default.Table_1a4908e115b54320999343cc2a52f8b7 [id=564bdd9ee3404040b32798c6890aff6e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9c4f1e725fe84552943563aa95687842 consensus state has no leader
I20260925 01:50:00.805481 12705 raft_consensus.cc:2804] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.805594 12705 raft_consensus.cc:493] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.805670 12705 raft_consensus.cc:3060] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.808676 12705 raft_consensus.cc:515] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.809154 12770 raft_consensus.cc:493] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.809172 12689 ts_tablet_manager.cc:1929] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.809284 12689 log.cc:1199] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/3e3a033c9e7545479130c7a3c48ac254
I20260925 01:50:00.809290 12770 raft_consensus.cc:515] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.809444 12705 leader_election.cc:290] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:00.809609 12689 ts_tablet_manager.cc:1950] T 3e3a033c9e7545479130c7a3c48ac254 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:50:00.809751 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 67989.2us
I20260925 01:50:00.809959 12770 leader_election.cc:290] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.813987 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_af512ab1da7a45759866fe1ded30cc15" } modify_external_catalogs: true
I20260925 01:50:00.814240 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_af512ab1da7a45759866fe1ded30cc15" } modify_external_catalogs: true
I20260925 01:50:00.814723 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_920b4b17a516441f8cb76a72f44453b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.815459 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_920b4b17a516441f8cb76a72f44453b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.815860 11953 ts_tablet_manager.cc:1929] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260925 01:50:00.815979 11953 log.cc:1199] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:50:00.816273 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e2734747e1e44e7badcbbe01c9b4b040" } new_table_name: "default.Table_cc887a2446344d2f9b0c94685ff91a4f" modify_external_catalogs: true
I20260925 01:50:00.816391 11953 ts_tablet_manager.cc:1950] T ea0fa393abfe4c5cb5a7f821ffdfaea7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:00.816753 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 185) took 10088 ms. Trace:
I20260925 01:50:00.816728 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_280affebcd9b4f96ab322b25e3b854f8" } new_table_name: "default.Table_f4b0958b4dfd4611a1e8c622ddc7fb28" modify_external_catalogs: true
I20260925 01:50:00.816835 11953 rpcz_store.cc:276] 0925 01:49:50.728797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.728857 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:00.760592 (+10031735us) ts_tablet_manager.cc:1151] Deleting tablet ea0fa393abfe4c5cb5a7f821ffdfaea7
0925 01:50:00.760601 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.764942 (+ 4341us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x6160000d2a54. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74f24a70 00007f1c762ad583 00007f1c78e7a8b7 00007f1c78eada64 00007f1c78e8e3a0 00007f1c78e8e12d 0000000000aaef9c 00007f1c68e76aef 00007f1c68e79deb 00007f1c68e79c68
0925 01:50:00.812488 (+ 47546us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.815806 (+ 3318us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.816733 (+ 927us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2132,"spinlock_wait_cycles":8846208,"tablet-delete.queue_time_us":10031469}
I20260925 01:50:00.817358 11953 tablet_replica.cc:333] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:00.817544 11953 raft_consensus.cc:2243] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.817534 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 (table default.Table_334a2d580acd443b905330d4680eec76 [id=0de9ef459939479ea3e5ffe993ecde2a]) successfully deleted
I20260925 01:50:00.821013 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_89979b06d2f04faa8b7f18b057afdbf1" } modify_external_catalogs: true
I20260925 01:50:00.821410 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f4d283936a5f426f85bb58068bf1ba85" } modify_external_catalogs: true
I20260925 01:50:00.821547 11754 tablet_bootstrap.cc:492] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.821646 12770 raft_consensus.cc:493] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.821694 11754 ts_tablet_manager.cc:1403] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.002s
I20260925 01:50:00.821810 12770 raft_consensus.cc:515] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.822579 11754 raft_consensus.cc:359] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.822755 11754 raft_consensus.cc:385] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.822805 11754 raft_consensus.cc:740] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.823019 11754 consensus_queue.cc:260] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.823199 11314 leader_election.cc:304] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:00.823413 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f4d283936a5f426f85bb58068bf1ba85" } modify_external_catalogs: true
I20260925 01:50:00.825647 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_89979b06d2f04faa8b7f18b057afdbf1" } modify_external_catalogs: true
I20260925 01:50:00.827796 12508 raft_consensus.cc:493] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.827924 12508 raft_consensus.cc:515] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.828540 12508 leader_election.cc:290] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.831050 11457 leader_election.cc:304] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:00.831804 12781 raft_consensus.cc:2804] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.831885 12781 raft_consensus.cc:493] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.831892 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b9df8d98e5414186ef23b8b7f9cb61" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:00.831981 12781 raft_consensus.cc:3060] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.832060 11519 raft_consensus.cc:2468] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:00.832481 12769 raft_consensus.cc:2804] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.832556 12769 raft_consensus.cc:493] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.832631 12769 raft_consensus.cc:3060] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.836004 12781 raft_consensus.cc:515] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:00.836575 12781 leader_election.cc:290] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:00.838233 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_af74504d5f9b4581a2d263665d820c48" } modify_external_catalogs: true
I20260925 01:50:00.838438 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_af74504d5f9b4581a2d263665d820c48" } modify_external_catalogs: true
I20260925 01:50:00.840938 12770 leader_election.cc:290] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.843178 11755 tablet_bootstrap.cc:492] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.843309 11755 ts_tablet_manager.cc:1403] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.053s user 0.006s sys 0.002s
I20260925 01:50:00.843987 11755 raft_consensus.cc:359] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.844141 11755 raft_consensus.cc:385] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.844182 11755 raft_consensus.cc:740] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.844339 11755 consensus_queue.cc:260] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.845082 11755 ts_tablet_manager.cc:1434] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:00.845372 11755 tablet_bootstrap.cc:492] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.846115 12769 raft_consensus.cc:515] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.846735 12769 leader_election.cc:290] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.847319 11755 tablet_bootstrap.cc:654] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:00.847949 11456 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:50:00.848182 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 80fe96946b294785b8d76564e0f5fa12 with delete_type TABLET_DATA_DELETED (replaced by tablet 246aafd66334407895ce235e4b2ca7f4) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.849252 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d9a26bbfd74a30a2ae0a61aacca4d1" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:00.849215 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38082c23d99148bb916b0ae74fd474b8" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:00.849400 11523 raft_consensus.cc:2468] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:00.849439 11519 raft_consensus.cc:2393] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:50:00.852959 12769 raft_consensus.cc:493] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.853112 12769 raft_consensus.cc:515] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.853773 12769 leader_election.cc:290] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.856328 11753 tablet_bootstrap.cc:492] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:00.856477 11753 ts_tablet_manager.cc:1403] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.000s
I20260925 01:50:00.857434 11753 raft_consensus.cc:359] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.857616 11753 raft_consensus.cc:385] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.857671 11753 raft_consensus.cc:740] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.858191 11754 ts_tablet_manager.cc:1434] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260925 01:50:00.858244 11953 raft_consensus.cc:2272] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.858505 11754 tablet_bootstrap.cc:492] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.858788 11953 ts_tablet_manager.cc:1916] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.860227 11754 tablet_bootstrap.cc:654] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:00.861186 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db1339652d744cda9215d84e846d1e8e consensus state has no leader
I20260925 01:50:00.861668 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e5d15c656fd848df95d75a664d3e7f32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.862859 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f5eac56d95549e5a2f33d03f4b258de consensus state has no leader
I20260925 01:50:00.863133 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 5c1c05b5a87e43d38a24f63242415fd7 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:00.863903 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7ee95aba7a8f4d8db4ed0b8a862dab63
I20260925 01:50:00.864567 11753 consensus_queue.cc:260] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.864742 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:00.865128 11753 ts_tablet_manager.cc:1434] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260925 01:50:00.866117 11755 tablet_bootstrap.cc:492] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.866261 11755 ts_tablet_manager.cc:1403] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260925 01:50:00.866516 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 3e3a033c9e7545479130c7a3c48ac254 (table default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c [id=603d80ba3d934fc69b60ff151671e75d]) successfully deleted
I20260925 01:50:00.866828 12689 tablet_replica.cc:333] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.867020 12689 raft_consensus.cc:2243] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.867000 11755 raft_consensus.cc:359] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.867161 11755 raft_consensus.cc:385] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.867187 12689 raft_consensus.cc:2272] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.867206 11755 raft_consensus.cc:740] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.867427 11755 consensus_queue.cc:260] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.869346 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:00.870245 12689 ts_tablet_manager.cc:1916] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:00.873725 11456 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 38082c23d99148bb916b0ae74fd474b8
W20260925 01:50:00.873909 11456 leader_election.cc:343] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 4d7b3c65d8a64734b2c432790dae07e1
W20260925 01:50:00.874112 11456 leader_election.cc:343] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 3e3a033c9e7545479130c7a3c48ac254
I20260925 01:50:00.878574 11755 ts_tablet_manager.cc:1434] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260925 01:50:00.878577 12508 raft_consensus.cc:493] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.878719 12508 raft_consensus.cc:515] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.878883 11755 tablet_bootstrap.cc:492] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.879354 12508 leader_election.cc:290] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.880446 12704 raft_consensus.cc:493] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:00.880569 12704 raft_consensus.cc:515] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:00.880822 11755 tablet_bootstrap.cc:654] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.881203 12704 leader_election.cc:290] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:00.881875 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347a144e18ab4f6e834551044a2ac4ae" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.882083 11370 raft_consensus.cc:2468] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.882793 11946 ts_tablet_manager.cc:1929] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.885075 11946 log.cc:1199] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/644b28192e3b45e7b5370d55804cb043
I20260925 01:50:00.885818 11946 ts_tablet_manager.cc:1950] T 644b28192e3b45e7b5370d55804cb043 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:00.886235 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "347a144e18ab4f6e834551044a2ac4ae" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:00.886430 11375 raft_consensus.cc:3060] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.889350 11375 raft_consensus.cc:2468] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:00.889628 12781 raft_consensus.cc:493] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
W20260925 01:50:00.889717 11456 leader_election.cc:343] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 19c718c83cfe49b9a745e06314e24409
I20260925 01:50:00.889755 12781 raft_consensus.cc:515] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:00.890344 12781 leader_election.cc:290] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:50:00.890610 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5d15c656fd848df95d75a664d3e7f32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.890844 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd2e1bf7d3e4459a84235b9c3f5383c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.891059 11375 raft_consensus.cc:2468] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.891610 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596f8ddbcd16458aa4f287f4f11282a1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.892341 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:00.891736 11375 raft_consensus.cc:2468] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.892875 12689 ts_tablet_manager.cc:1929] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.892980 12689 log.cc:1199] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:50:00.893224 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b9df8d98e5414186ef23b8b7f9cb61" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.893296 12689 ts_tablet_manager.cc:1950] T 17352fd6ea4e4ed9a178f1510edf4f6d P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:00.893402 11375 raft_consensus.cc:2468] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.894191 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38082c23d99148bb916b0ae74fd474b8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.894447 11375 raft_consensus.cc:2468] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.894997 11754 tablet_bootstrap.cc:492] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.895210 11754 ts_tablet_manager.cc:1403] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.000s
I20260925 01:50:00.896095 11754 raft_consensus.cc:359] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.896381 11754 raft_consensus.cc:385] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.896492 11754 raft_consensus.cc:740] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.896733 11754 consensus_queue.cc:260] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.897655 11754 ts_tablet_manager.cc:1434] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:00.897984 11753 tablet_bootstrap.cc:492] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:00.899597 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 487) took 1507 ms. Trace:
I20260925 01:50:00.899744 11946 rpcz_store.cc:276] 0925 01:49:59.392006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.392361 (+ 355us) service_pool.cc:224] Handling call
0925 01:50:00.801436 (+1409075us) ts_tablet_manager.cc:1151] Deleting tablet 644b28192e3b45e7b5370d55804cb043
0925 01:50:00.801445 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.824998 (+ 23553us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.882730 (+ 57732us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.899576 (+ 16846us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408867}
I20260925 01:50:00.899876 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3a033c9e7545479130c7a3c48ac254" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.900182 11755 tablet_bootstrap.cc:492] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.900274 11946 tablet_replica.cc:333] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:00.900327 11755 ts_tablet_manager.cc:1403] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.001s
I20260925 01:50:00.900471 11946 raft_consensus.cc:2243] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.900619 11946 pending_rounds.cc:70] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:00.900671 11946 pending_rounds.cc:77] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072889413894144 op_type: NO_OP noop_request { }
I20260925 01:50:00.900748 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1a5fa8d4c6294c46a36a515b0e0505df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.900978 11946 raft_consensus.cc:2889] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:00.901084 11946 raft_consensus.cc:2272] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.901095 11755 raft_consensus.cc:359] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.901245 11755 raft_consensus.cc:385] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.901297 11755 raft_consensus.cc:740] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
W20260925 01:50:00.901417 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a5fa8d4c6294c46a36a515b0e0505df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.901563 11755 consensus_queue.cc:260] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.901681 11946 ts_tablet_manager.cc:1916] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.902547 11755 ts_tablet_manager.cc:1434] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:00.902627 11754 tablet_bootstrap.cc:492] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.902840 11755 tablet_bootstrap.cc:492] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.903069 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73d9a26bbfd74a30a2ae0a61aacca4d1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:00.899406 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 30a5240093dd442a93bff006a965bc41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.900177 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.904006 11375 raft_consensus.cc:2393] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:50:00.904184 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7b3c65d8a64734b2c432790dae07e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.904312 11754 tablet_bootstrap.cc:654] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.904353 11370 raft_consensus.cc:2468] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.905138 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c718c83cfe49b9a745e06314e24409" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:00.905289 11372 raft_consensus.cc:2468] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:00.905490 11755 tablet_bootstrap.cc:654] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:00.909780 11456 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:50:00.913082 12508 raft_consensus.cc:493] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.913249 12508 raft_consensus.cc:515] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.913882 12508 leader_election.cc:290] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:00.905391 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 644b28192e3b45e7b5370d55804cb043 (table default.Table_58fdde0b3e6a47b79d42646ec2ed37ef [id=70a49de4b7e04789bb0a1afaf2df1900]) successfully deleted
I20260925 01:50:00.923696 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d859207bbc4aefb26c726dce404c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:00.924610 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_eb97db398056479f9ae0f2c03b05d706"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.925408 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb97db398056479f9ae0f2c03b05d706 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.927088 12508 raft_consensus.cc:493] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:00.927281 12508 raft_consensus.cc:515] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.927713 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_33457c10d7ea4f4f83faf8baf837b73d" } new_table_name: "default.Table_12bac6f78c7944d9bb5310a1c312abe3" modify_external_catalogs: true
I20260925 01:50:00.928020 12508 leader_election.cc:290] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:00.931118 11456 leader_election.cc:343] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: f1b6ea676a1f4d99807029d8401251ef
I20260925 01:50:00.931447 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe96946b294785b8d76564e0f5fa12" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:00.933436 11456 leader_election.cc:343] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:00.899681 11753 tablet_bootstrap.cc:654] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.946987 12689 tablet_replica.cc:333] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.946949 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 17352fd6ea4e4ed9a178f1510edf4f6d (table default.Table_ca88ffeaae4a4f1999cf9834715b791b [id=9389812769844f279c1e0c5fa9707dc0]) successfully deleted
I20260925 01:50:00.947204 12689 raft_consensus.cc:2243] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.947382 12689 raft_consensus.cc:2272] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.951025 11754 tablet_bootstrap.cc:492] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.951260 11754 ts_tablet_manager.cc:1403] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
I20260925 01:50:00.952113 11754 raft_consensus.cc:359] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.952476 11754 raft_consensus.cc:385] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.952580 11754 raft_consensus.cc:740] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.952895 11754 consensus_queue.cc:260] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.953801 11754 ts_tablet_manager.cc:1434] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:00.954186 11754 tablet_bootstrap.cc:492] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:00.958494 12689 ts_tablet_manager.cc:1916] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:00.968815 11755 tablet_bootstrap.cc:492] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:00.968983 11755 ts_tablet_manager.cc:1403] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.066s user 0.012s sys 0.016s
I20260925 01:50:00.969817 11755 raft_consensus.cc:359] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.970013 11755 raft_consensus.cc:385] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.970103 11755 raft_consensus.cc:740] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.970789 11755 consensus_queue.cc:260] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.975227 11755 ts_tablet_manager.cc:1434] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260925 01:50:00.975750 11755 tablet_bootstrap.cc:492] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:00.960395 11754 tablet_bootstrap.cc:654] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.977733 11755 tablet_bootstrap.cc:654] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:00.981158 12689 ts_tablet_manager.cc:1929] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:00.981840 12689 log.cc:1199] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/30a5240093dd442a93bff006a965bc41
I20260925 01:50:00.982327 12689 ts_tablet_manager.cc:1950] T 30a5240093dd442a93bff006a965bc41 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:00.984921 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 30a5240093dd442a93bff006a965bc41 (table default.Table_1ffecf54f1b3464eae523b831ac20bc0 [id=61d8ea1b10c44d6eb92474186b70df53]) successfully deleted
I20260925 01:50:00.985430 12689 tablet_replica.cc:333] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:00.985889 12689 raft_consensus.cc:2243] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:00.986415 12689 raft_consensus.cc:2272] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:00.988029 11754 tablet_bootstrap.cc:492] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:00.988224 11754 ts_tablet_manager.cc:1403] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.001s
I20260925 01:50:00.989782 11754 raft_consensus.cc:359] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:00.990029 11754 raft_consensus.cc:385] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:00.990167 11754 raft_consensus.cc:740] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:00.990461 11754 consensus_queue.cc:260] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:00.991303 11314 leader_election.cc:343] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 8bf42293dd5d452aa7ed9e0eaa78f54d
I20260925 01:50:00.991894 11754 ts_tablet_manager.cc:1434] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:00.993626 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_635b952a4e8b4c5b9b99fdf275576e31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:00.994594 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e1addda8d0d543b7be2ee34ace5d76c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.995144 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1addda8d0d543b7be2ee34ace5d76c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.995244 11314 leader_election.cc:304] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:50:00.995505 12781 raft_consensus.cc:2804] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.995589 12781 raft_consensus.cc:493] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.995661 12781 raft_consensus.cc:3060] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:00.996057 11314 leader_election.cc:304] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:50:00.996937 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c8efaeef1cd64670bcbf63eb0b401737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:00.997398 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8efaeef1cd64670bcbf63eb0b401737 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:00.998504 12781 raft_consensus.cc:515] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:00.998661 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52c716eb26d04a33b4c3b3c56a7fbac6 has no consensus state
I20260925 01:50:00.998998 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5652bb3084d3458c95041da9ffa64c8b" } new_table_name: "default.Table_1f22492a7ffa4aa0864327f84a7e7acc" modify_external_catalogs: true
I20260925 01:50:00.999106 12781 leader_election.cc:290] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:00.999464 12704 raft_consensus.cc:2804] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:00.999559 12704 raft_consensus.cc:493] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:00.999639 12704 raft_consensus.cc:3060] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.003516 12704 raft_consensus.cc:515] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.004362 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 784de8c6e6e1434a91106dd19cd9262a with delete_type TABLET_DATA_DELETED (replaced by tablet 35b123ac1e894239875404438ed19927) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.004413 12704 leader_election.cc:290] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:01.004869 11314 consensus_peers.cc:597] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4eb584e929c46f891d28ad01e6d78ae. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:01.006692 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_635b952a4e8b4c5b9b99fdf275576e31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:01.010272 11314 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
I20260925 01:50:01.022651 12689 ts_tablet_manager.cc:1916] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.024695 11754 tablet_bootstrap.cc:492] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:01.037015 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0eb84a118aa43b5b82b12c454fdf0e7 consensus state has no leader
I20260925 01:50:01.039327 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9f053c2667d241f3b0349162a44be758"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:01.039558 12689 ts_tablet_manager.cc:1929] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:01.039662 12689 log.cc:1199] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/7ee95aba7a8f4d8db4ed0b8a862dab63
W20260925 01:50:01.039904 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f053c2667d241f3b0349162a44be758 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.040009 12689 ts_tablet_manager.cc:1950] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:01.042380 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dd5e778c67f542cd8cdfdac93b91875b" } new_table_name: "default.Table_e0b01afdaa9e428eb5543cd3ce359877" modify_external_catalogs: true
I20260925 01:50:01.042675 11457 leader_election.cc:304] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.043395 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030]) successfully deleted
I20260925 01:50:01.044768 11946 ts_tablet_manager.cc:1929] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:01.045367 12689 tablet_replica.cc:333] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:01.045722 12689 raft_consensus.cc:2243] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.046126 12508 raft_consensus.cc:2804] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.046370 11946 log.cc:1199] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/23a6ec9b9b5d4f60a7e5f3edf0687b56
I20260925 01:50:01.046617 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1176be62cef345efa7604f2003a7fe7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:01.046799 11946 ts_tablet_manager.cc:1950] T 23a6ec9b9b5d4f60a7e5f3edf0687b56 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:01.047096 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1176be62cef345efa7604f2003a7fe7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.054205 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
I20260925 01:50:01.054566 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:01.056825 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7948cfa6f9c44365859c26d788fbd1d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.057530 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7948cfa6f9c44365859c26d788fbd1d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.058254 11677 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:50:01.059298 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 1575d0eb9ed64653b317edefd24f7dfd (DEFAULT_TABLE table=default.Table_a30fe60bacc84cf5805f7b80eb570f11 [id=1428e49cf63a48b9bc1132aafc513619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.059855 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575d0eb9ed64653b317edefd24f7dfd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:01.062173 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 51268.8us
I20260925 01:50:01.067417 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 488) took 1654 ms. Trace:
I20260925 01:50:01.067560 11946 rpcz_store.cc:276] 0925 01:49:59.392769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.392817 (+ 48us) service_pool.cc:224] Handling call
0925 01:50:00.900214 (+1507397us) ts_tablet_manager.cc:1151] Deleting tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56
0925 01:50:00.900224 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.921199 (+ 20975us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:00.956949 (+ 35750us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.047613 (+ 90664us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1507222}
W20260925 01:50:01.069155 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 54883.6us
I20260925 01:50:01.069347 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 489) took 1665 ms. Trace:
W20260925 01:50:01.069475 11314 leader_election.cc:343] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8bf42293dd5d452aa7ed9e0eaa78f54d
I20260925 01:50:01.069459 11946 rpcz_store.cc:276] 0925 01:49:59.402588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.402682 (+ 94us) service_pool.cc:224] Handling call
0925 01:50:01.067992 (+1665310us) ts_tablet_manager.cc:1151] Deleting tablet cb7bac6e89b8405e8bd541eba6278a0b
0925 01:50:01.068003 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.068105 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1665089}
I20260925 01:50:01.069605 11314 leader_election.cc:304] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.069811 12781 raft_consensus.cc:2749] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:01.069841 11457 leader_election.cc:304] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:01.070221 11314 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:50:01.070904 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 490) took 1658 ms. Trace:
W20260925 01:50:01.070899 11314 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 38082c23d99148bb916b0ae74fd474b8
I20260925 01:50:01.070998 11946 rpcz_store.cc:276] 0925 01:49:59.411180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.411237 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:01.069699 (+1658462us) ts_tablet_manager.cc:1151] Deleting tablet c3e2709b3b0f4157938d8d8bca8a7b10
0925 01:50:01.069710 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.069795 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1658276}
W20260925 01:50:01.071143 11314 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:50:01.071208 11314 leader_election.cc:304] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.071412 12782 raft_consensus.cc:2749] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:01.046075 12689 raft_consensus.cc:2272] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:01.071822 11314 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
I20260925 01:50:01.071904 11314 leader_election.cc:304] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.072247 12782 raft_consensus.cc:2749] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:01.072633 12781 consensus_queue.cc:1048] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:01.072728 11457 leader_election.cc:304] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.073151 12689 ts_tablet_manager.cc:1916] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.073176 12640 raft_consensus.cc:2804] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260925 01:50:01.073321 11314 leader_election.cc:343] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 99913eb35197442880a27b3c288237f4
W20260925 01:50:01.073539 11314 leader_election.cc:343] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 67921f86c4f6422e97d7f306262569f8
I20260925 01:50:01.074594 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 1575d0eb9ed64653b317edefd24f7dfd (DEFAULT_TABLE table=default.Table_a30fe60bacc84cf5805f7b80eb570f11 [id=1428e49cf63a48b9bc1132aafc513619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.074939 11755 tablet_bootstrap.cc:492] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:01.075075 11755 ts_tablet_manager.cc:1403] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.099s user 0.017s sys 0.024s
I20260925 01:50:01.075112 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575d0eb9ed64653b317edefd24f7dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.075845 11755 raft_consensus.cc:359] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.076007 11755 raft_consensus.cc:385] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.076056 11755 raft_consensus.cc:740] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.076293 11755 consensus_queue.cc:260] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.078980 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.081444 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b6ea676a1f4d99807029d8401251ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:01.081635 11372 raft_consensus.cc:2468] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:01.082857 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe96946b294785b8d76564e0f5fa12" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:01.083691 12782 consensus_queue.cc:1048] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:01.084019 11677 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 1 got 0
W20260925 01:50:01.084270 11314 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:50:01.084455 11677 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
W20260925 01:50:01.084699 11314 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 38082c23d99148bb916b0ae74fd474b8
I20260925 01:50:01.086403 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 1575d0eb9ed64653b317edefd24f7dfd (DEFAULT_TABLE table=default.Table_a30fe60bacc84cf5805f7b80eb570f11 [id=1428e49cf63a48b9bc1132aafc513619]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.087637 12508 raft_consensus.cc:493] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.087949 12508 raft_consensus.cc:3060] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.091209 12508 raft_consensus.cc:515] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.091886 12508 leader_election.cc:290] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.089556 11755 ts_tablet_manager.cc:1434] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260925 01:50:01.092229 11755 tablet_bootstrap.cc:492] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:01.092222 11457 leader_election.cc:304] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:01.092739 11457 leader_election.cc:343] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:01.092865 11457 leader_election.cc:304] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.093236 11457 leader_election.cc:304] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.093588 11457 leader_election.cc:304] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.093809 11755 tablet_bootstrap.cc:654] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.093926 12770 raft_consensus.cc:2804] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.094018 12770 raft_consensus.cc:493] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.094127 12770 raft_consensus.cc:3060] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.097232 12770 raft_consensus.cc:515] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.097775 12770 leader_election.cc:290] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.097988 12770 raft_consensus.cc:2749] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:01.098146 12769 raft_consensus.cc:2749] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:01.098294 12769 raft_consensus.cc:2804] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.098367 12769 raft_consensus.cc:493] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.098434 12769 raft_consensus.cc:3060] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.101202 12769 raft_consensus.cc:515] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.101918 12769 leader_election.cc:290] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.102164 12640 raft_consensus.cc:493] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.102288 12640 raft_consensus.cc:3060] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.105150 12640 raft_consensus.cc:515] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.105782 12640 leader_election.cc:290] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.107091 12731 raft_consensus.cc:2804] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.107208 12731 raft_consensus.cc:493] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.107298 12731 raft_consensus.cc:3060] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.109864 12731 raft_consensus.cc:515] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.110595 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1575d0eb9ed64653b317edefd24f7dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.113571 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 90647937eb364a7a973d04ea69cbc9aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3e12ffab16844f50be47dadcfbb3793f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.114219 12696 raft_consensus.cc:493] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.114389 12696 raft_consensus.cc:515] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.115187 12696 leader_election.cc:290] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:01.116091 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc1194884470e9fc977ca870f1b0c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:01.116789 11177 leader_election.cc:343] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:01.117133 11755 tablet_bootstrap.cc:492] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:01.117270 11755 ts_tablet_manager.cc:1403] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s
I20260925 01:50:01.117974 11755 raft_consensus.cc:359] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.118178 11755 raft_consensus.cc:385] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.118240 11755 raft_consensus.cc:740] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.118525 11755 consensus_queue.cc:260] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:01.123674 11456 leader_election.cc:343] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 596f8ddbcd16458aa4f287f4f11282a1
W20260925 01:50:01.123946 11456 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 38082c23d99148bb916b0ae74fd474b8
I20260925 01:50:01.126132 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 506) took 1483 ms. Trace:
I20260925 01:50:01.126256 11946 rpcz_store.cc:276] 0925 01:49:59.588314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.625691 (+ 37377us) service_pool.cc:224] Handling call
0925 01:50:01.071217 (+1445526us) ts_tablet_manager.cc:1151] Deleting tablet e457c4ab4e814fc4be11ced6ca69284f
0925 01:50:01.071226 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.071317 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1445168}
I20260925 01:50:01.126663 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 504) took 1545 ms. Trace:
I20260925 01:50:01.126737 11946 rpcz_store.cc:276] 0925 01:49:59.581170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.630436 (+ 49266us) service_pool.cc:224] Handling call
0925 01:50:01.126546 (+1496110us) ts_tablet_manager.cc:1151] Deleting tablet 5c1c05b5a87e43d38a24f63242415fd7
0925 01:50:01.126557 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.126647 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1495834}
I20260925 01:50:01.127020 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 505) took 1545 ms. Trace:
I20260925 01:50:01.127084 11946 rpcz_store.cc:276] 0925 01:49:59.581384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.631039 (+ 49655us) service_pool.cc:224] Handling call
0925 01:50:01.126935 (+1495896us) ts_tablet_manager.cc:1151] Deleting tablet 9f7639fd1f1149a7973eba0c77bd7065
0925 01:50:01.126942 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.127008 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1495554}
I20260925 01:50:01.127323 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 507) took 1382 ms. Trace:
I20260925 01:50:01.127384 11946 rpcz_store.cc:276] 0925 01:49:59.745051 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.745105 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:01.127247 (+1382142us) ts_tablet_manager.cc:1151] Deleting tablet 941fd8333f6d45878677e55ff6948bbf
0925 01:50:01.127253 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.127312 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381863}
I20260925 01:50:01.127631 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 510) took 1030 ms. Trace:
I20260925 01:50:01.127697 11946 rpcz_store.cc:276] 0925 01:50:00.097563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.097815 (+ 252us) service_pool.cc:224] Handling call
0925 01:50:01.127554 (+1029739us) ts_tablet_manager.cc:1151] Deleting tablet 6e644bfe06ff4ca89066b1ded01f2b90
0925 01:50:01.127561 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.127619 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029537}
I20260925 01:50:01.127997 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 511) took 1030 ms. Trace:
I20260925 01:50:01.128473 11946 rpcz_store.cc:276] 0925 01:50:00.097756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.097902 (+ 146us) service_pool.cc:224] Handling call
0925 01:50:01.127911 (+1030009us) ts_tablet_manager.cc:1151] Deleting tablet 11a0a886d73442bd9753df870acf63f7
0925 01:50:01.127919 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.127983 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029843}
I20260925 01:50:01.128791 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 512) took 1018 ms. Trace:
I20260925 01:50:01.128885 11946 rpcz_store.cc:276] 0925 01:50:00.110552 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.110846 (+ 294us) service_pool.cc:224] Handling call
0925 01:50:01.128688 (+1017842us) ts_tablet_manager.cc:1151] Deleting tablet 2a37a6deaeb24c99824b62fbb2d603b1
0925 01:50:01.128696 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.128775 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1017602}
I20260925 01:50:01.128995 12689 ts_tablet_manager.cc:1929] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:01.129177 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 513) took 1018 ms. Trace:
I20260925 01:50:01.129258 11755 ts_tablet_manager.cc:1434] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260925 01:50:01.129238 11946 rpcz_store.cc:276] 0925 01:50:00.110703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.111125 (+ 422us) service_pool.cc:224] Handling call
0925 01:50:01.129082 (+1017957us) ts_tablet_manager.cc:1151] Deleting tablet e40083a885974e3595ec2fb5b16d4a5d
0925 01:50:01.129092 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.129162 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1017833}
I20260925 01:50:01.129837 11946 tablet_replica.cc:333] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:01.130523 11755 tablet_bootstrap.cc:492] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:01.131237 12731 leader_election.cc:290] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.132058 11755 tablet_bootstrap.cc:654] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.138286 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc1194884470e9fc977ca870f1b0c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:01.138561 11522 raft_consensus.cc:2468] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:01.140807 11946 raft_consensus.cc:2243] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.141198 11946 raft_consensus.cc:2272] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.141793 11946 ts_tablet_manager.cc:1916] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.143311 11755 tablet_bootstrap.cc:492] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:01.143555 11755 ts_tablet_manager.cc:1403] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.002s
I20260925 01:50:01.144269 11755 raft_consensus.cc:359] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.144462 11755 raft_consensus.cc:385] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.144515 11755 raft_consensus.cc:740] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.144747 11755 consensus_queue.cc:260] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.149278 11755 ts_tablet_manager.cc:1434] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 01:50:01.150180 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 23a6ec9b9b5d4f60a7e5f3edf0687b56 (table default.Table_2ef33e01a75b45a2a6b50777e4bd3e1b [id=4598ed1a6ec844ec8c3930fb1d54cf01]) successfully deleted
I20260925 01:50:01.150632 11755 tablet_bootstrap.cc:492] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:50:01.150846 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 76307.4us
W20260925 01:50:01.151106 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet cb7bac6e89b8405e8bd541eba6278a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb7bac6e89b8405e8bd541eba6278a0b already in progress: creating tablet
I20260925 01:50:01.150617 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:01.152168 11755 tablet_bootstrap.cc:654] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.139117 11176 leader_election.cc:304] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:01.154393 12696 raft_consensus.cc:2804] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.154510 12696 raft_consensus.cc:493] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.154588 12696 raft_consensus.cc:3060] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:01.156991 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c3e2709b3b0f4157938d8d8bca8a7b10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3e2709b3b0f4157938d8d8bca8a7b10 already in progress: creating tablet
I20260925 01:50:01.157498 12696 raft_consensus.cc:515] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.158752 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 927bc1194884470e9fc977ca870f1b0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.158901 12696 leader_election.cc:290] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:01.158973 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc1194884470e9fc977ca870f1b0c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:01.159139 11372 raft_consensus.cc:3060] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.159147 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 90647937eb364a7a973d04ea69cbc9aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3e12ffab16844f50be47dadcfbb3793f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.159339 12689 log.cc:1199] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/85d859207bbc4aefb26c726dce404c44
I20260925 01:50:01.159682 12689 ts_tablet_manager.cc:1950] T 85d859207bbc4aefb26c726dce404c44 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:01.160145 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 406d31139e1e441aa6fe204168486e28 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:01.161885 11372 raft_consensus.cc:2468] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:01.162460 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:45 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.162626 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.164258 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:01.166338 12689 tablet_replica.cc:333] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:01.166317 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 85d859207bbc4aefb26c726dce404c44 (table default.Table_b294b68c22864c009d79e9fb833ba9f1 [id=547a29a570064420aa9eaaec9543cdb3]) successfully deleted
I20260925 01:50:01.166525 12689 raft_consensus.cc:2243] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.166585 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet 4d9558462332400d92f7d61858bdeca2 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:01.166678 12689 raft_consensus.cc:2272] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.167814 11177 leader_election.cc:304] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:01.169486 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927bc1194884470e9fc977ca870f1b0c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:01.169771 11522 raft_consensus.cc:3060] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.170310 12696 raft_consensus.cc:2804] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:01.170625 12696 raft_consensus.cc:697] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:01.171005 12696 consensus_queue.cc:237] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.172724 12689 ts_tablet_manager.cc:1916] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.174901 11953 ts_tablet_manager.cc:1929] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:01.175045 11953 log.cc:1199] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ca76f6f710d841fd8999b40e5a48693f
I20260925 01:50:01.175379 11953 ts_tablet_manager.cc:1950] T ca76f6f710d841fd8999b40e5a48693f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:01.175702 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 186) took 10445 ms. Trace:
I20260925 01:50:01.175794 11953 rpcz_store.cc:276] 0925 01:49:50.729756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.730594 (+ 838us) service_pool.cc:224] Handling call
0925 01:50:00.817286 (+10086692us) ts_tablet_manager.cc:1151] Deleting tablet ca76f6f710d841fd8999b40e5a48693f
0925 01:50:00.817296 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:00.922471 (+105175us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.174840 (+252369us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.175686 (+ 846us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40509,"tablet-delete.queue_time_us":10086484}
I20260925 01:50:01.178189 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 192) took 10357 ms. Trace:
I20260925 01:50:01.178282 11953 rpcz_store.cc:276] 0925 01:49:50.820384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.820991 (+ 607us) service_pool.cc:224] Handling call
0925 01:50:01.178030 (+10357039us) ts_tablet_manager.cc:1151] Deleting tablet 01d50e428bfc46caa130f96ccc7e8f40
0925 01:50:01.178041 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.178170 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10356807}
W20260925 01:50:01.178398 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a82e0251ebb4500b628924c89bfe1b2 consensus state has no leader
I20260925 01:50:01.178750 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet 128be07ff230461ca7f998de7a02468f from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:01.180375 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9bf94decad1c489da81b701f88fe1b44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.181071 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bf94decad1c489da81b701f88fe1b44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.182250 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 193) took 10361 ms. Trace:
I20260925 01:50:01.182341 11953 rpcz_store.cc:276] 0925 01:49:50.820512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.821265 (+ 753us) service_pool.cc:224] Handling call
0925 01:50:01.182122 (+10360857us) ts_tablet_manager.cc:1151] Deleting tablet 15376374d9f2401fb9bb83d2f0acf7b3
0925 01:50:01.182132 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.182231 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10360658}
I20260925 01:50:01.182569 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ca76f6f710d841fd8999b40e5a48693f (table default.Table_46b43d62b822482c8a723d9e33935c02 [id=13f7c6e59b4243cc933249bb1009ba87]) successfully deleted
W20260925 01:50:01.182900 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 01d50e428bfc46caa130f96ccc7e8f40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d50e428bfc46caa130f96ccc7e8f40 already in progress: creating tablet
W20260925 01:50:01.183171 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 15376374d9f2401fb9bb83d2f0acf7b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15376374d9f2401fb9bb83d2f0acf7b3 already in progress: creating tablet
I20260925 01:50:01.184340 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 194) took 10363 ms. Trace:
I20260925 01:50:01.184429 11953 rpcz_store.cc:276] 0925 01:49:50.820644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.821495 (+ 851us) service_pool.cc:224] Handling call
0925 01:50:01.184134 (+10362639us) ts_tablet_manager.cc:1151] Deleting tablet 06fca09010f841c5a7b58678560065f3
0925 01:50:01.184230 (+ 96us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.184320 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10362436}
I20260925 01:50:01.184710 11754 tablet_bootstrap.cc:654] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:01.186640 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 06fca09010f841c5a7b58678560065f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06fca09010f841c5a7b58678560065f3 already in progress: creating tablet
I20260925 01:50:01.186650 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet f6e9bc6f6c7346bfadbd79b8d494641e (table default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668]). Expected version 1 got 0
I20260925 01:50:01.188262 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 1 got 0
I20260925 01:50:01.191344 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 19c718c83cfe49b9a745e06314e24409 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.192992 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 784de8c6e6e1434a91106dd19cd9262a with delete_type TABLET_DATA_DELETED (replaced by tablet 35b123ac1e894239875404438ed19927) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.193972 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 85d859207bbc4aefb26c726dce404c44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.194986 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cd2e1bf7d3e4459a84235b9c3f5383c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.196700 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 347a144e18ab4f6e834551044a2ac4ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.198289 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1ea85f72e10443229f5f927bcaf31cb3
I20260925 01:50:01.199095 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0b0ce5f884684db28023373c46961746" } new_table_name: "default.Table_2f4382db373943b6bc9420f53b562dd6" modify_external_catalogs: true
I20260925 01:50:01.199443 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8036963ed28c4e0aae2c4a0bd8e9c99b
I20260925 01:50:01.200080 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_868285a9866c47e5a5eb6932b93a6fbc" } new_table_name: "default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8" modify_external_catalogs: true
I20260925 01:50:01.200380 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.200412 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 716ad6cdf9864fc3b09d88753d45f45f
I20260925 01:50:01.200753 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 252415635b5e4b3286948e91d421d6f1
I20260925 01:50:01.201097 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f181f1f48a334b48aeda73e37c8c7a61" } modify_external_catalogs: true
I20260925 01:50:01.201282 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f181f1f48a334b48aeda73e37c8c7a61" } modify_external_catalogs: true
I20260925 01:50:01.201397 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet bc99f3613c354d68bfde33e04dc1e9ab from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:01.202839 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea85f72e10443229f5f927bcaf31cb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.203279 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 716ad6cdf9864fc3b09d88753d45f45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.204039 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 252415635b5e4b3286948e91d421d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.204088 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet 716ad6cdf9864fc3b09d88753d45f45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.204265 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 252415635b5e4b3286948e91d421d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.204406 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.204558 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea85f72e10443229f5f927bcaf31cb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.209026 10879 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskAIg11R/build/asan/bin/kudu
/tmp/dist-test-taskAIg11R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.253:42889
--webserver_interface=127.10.159.253
--webserver_port=34593
--builtin_ntp_servers=127.10.159.212:39403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260925 01:50:01.212754 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c98e3154b1c4405abb6aa97166f8c330"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.213500 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c98e3154b1c4405abb6aa97166f8c330 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.214052 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 406d31139e1e441aa6fe204168486e28
I20260925 01:50:01.215106 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 406d31139e1e441aa6fe204168486e28 deleted and replaced by tablet 4480d3b5671a4f2aaf98941cc8d58433
I20260925 01:50:01.215071 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 406d31139e1e441aa6fe204168486e28 with delete_type TABLET_DATA_DELETED (replaced by tablet 4480d3b5671a4f2aaf98941cc8d58433) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.215219 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 406d31139e1e441aa6fe204168486e28 with delete_type TABLET_DATA_DELETED (replaced by tablet 4480d3b5671a4f2aaf98941cc8d58433) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.216467 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4d9558462332400d92f7d61858bdeca2
I20260925 01:50:01.217269 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9558462332400d92f7d61858bdeca2 with delete_type TABLET_DATA_DELETED (replaced by tablet 043ec86a5af048ab81f1450856d5a85f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.218391 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9558462332400d92f7d61858bdeca2 with delete_type TABLET_DATA_DELETED (replaced by tablet 043ec86a5af048ab81f1450856d5a85f) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.218742 11673 catalog_manager.cc:6934] ReplaceTablet: tablet 4d9558462332400d92f7d61858bdeca2 deleted and replaced by tablet 043ec86a5af048ab81f1450856d5a85f
I20260925 01:50:01.220196 12754 consensus_queue.cc:1048] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:01.220317 11953 tablet_replica.cc:333] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:01.220597 11953 raft_consensus.cc:2243] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.223734 11953 raft_consensus.cc:2272] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.224316 11953 ts_tablet_manager.cc:1916] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.233642 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5075112388444f988f39f42818fc8c36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.234578 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5075112388444f988f39f42818fc8c36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.236160 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_41b6b9f73f9141d1ae49115efb41aa8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.236886 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b6b9f73f9141d1ae49115efb41aa8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.237262 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_208b9dab76244e869ba2e5f8ff865204" } new_table_name: "default.Table_e92a27627ba1487594f1190c011575b6" modify_external_catalogs: true
I20260925 01:50:01.240115 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 128be07ff230461ca7f998de7a02468f
I20260925 01:50:01.240618 11754 tablet_bootstrap.cc:492] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:01.240686 11679 catalog_manager.cc:6934] ReplaceTablet: tablet 128be07ff230461ca7f998de7a02468f deleted and replaced by tablet 7131531641464bba9ada4b5655dd0e47
I20260925 01:50:01.240787 11754 ts_tablet_manager.cc:1403] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.216s user 0.023s sys 0.000s
I20260925 01:50:01.241159 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 128be07ff230461ca7f998de7a02468f with delete_type TABLET_DATA_DELETED (replaced by tablet 7131531641464bba9ada4b5655dd0e47) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.241516 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 128be07ff230461ca7f998de7a02468f with delete_type TABLET_DATA_DELETED (replaced by tablet 7131531641464bba9ada4b5655dd0e47) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.241559 11754 raft_consensus.cc:359] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.241737 11754 raft_consensus.cc:385] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.241802 11754 raft_consensus.cc:740] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.242149 11754 consensus_queue.cc:260] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.242906 11522 raft_consensus.cc:2468] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:01.251192 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 638ccb15c1ac4c52ad88715c54b63eef (DEFAULT_TABLE table=default.Table_e4155c334ef147f5ba69e879f6cfb9d8 [id=8d3639f46860496a86b7c69616dc230a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.251722 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638ccb15c1ac4c52ad88715c54b63eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.253813 12704 raft_consensus.cc:493] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.253993 12704 raft_consensus.cc:515] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.255113 12704 leader_election.cc:290] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:01.257091 11314 leader_election.cc:343] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 85d859207bbc4aefb26c726dce404c44
I20260925 01:50:01.189134 12689 ts_tablet_manager.cc:1929] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:01.262079 12689 log.cc:1199] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/784de8c6e6e1434a91106dd19cd9262a
I20260925 01:50:01.262212 11953 ts_tablet_manager.cc:1929] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:01.262347 11953 log.cc:1199] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/bb98d5a38f43450c80d057d9eb2f92d1
I20260925 01:50:01.262655 12689 ts_tablet_manager.cc:1950] T 784de8c6e6e1434a91106dd19cd9262a P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:01.262691 11953 ts_tablet_manager.cc:1950] T bb98d5a38f43450c80d057d9eb2f92d1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:01.263480 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 191) took 10465 ms. Trace:
I20260925 01:50:01.263582 11953 rpcz_store.cc:276] 0925 01:49:50.798512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.798577 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:01.220227 (+10421650us) ts_tablet_manager.cc:1151] Deleting tablet bb98d5a38f43450c80d057d9eb2f92d1
0925 01:50:01.220244 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.228085 (+ 7841us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.262127 (+ 34042us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.263460 (+ 1333us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10376104}
I20260925 01:50:01.263947 12689 tablet_replica.cc:333] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:01.264132 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet bb98d5a38f43450c80d057d9eb2f92d1 (table default.Table_59d4c86ec501405bac429442b634b429 [id=b8e12892b27e40d197f292fd72d9a69d]) successfully deleted
I20260925 01:50:01.264219 12689 raft_consensus.cc:2243] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:01.264498 12689 pending_rounds.cc:70] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:01.264667 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 195) took 10375 ms. Trace:
I20260925 01:50:01.264742 11953 rpcz_store.cc:276] 0925 01:49:50.888817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.889005 (+ 188us) service_pool.cc:224] Handling call
0925 01:50:01.264523 (+10375518us) ts_tablet_manager.cc:1151] Deleting tablet 45a794ad0d87475a88efc02f5ae080f4
0925 01:50:01.264532 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.264649 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10374683}
I20260925 01:50:01.264806 12689 pending_rounds.cc:77] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072900800196608 op_type: NO_OP noop_request { }
I20260925 01:50:01.265048 12689 raft_consensus.cc:2889] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:01.265201 12689 raft_consensus.cc:2272] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:01.265241 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 45a794ad0d87475a88efc02f5ae080f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45a794ad0d87475a88efc02f5ae080f4 already in progress: creating tablet
I20260925 01:50:01.265756 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 196) took 10334 ms. Trace:
I20260925 01:50:01.266498 11754 ts_tablet_manager.cc:1434] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260925 01:50:01.266644 11953 rpcz_store.cc:276] 0925 01:49:50.931407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.938186 (+ 6779us) service_pool.cc:224] Handling call
0925 01:50:01.265629 (+10327443us) ts_tablet_manager.cc:1151] Deleting tablet 95ac080782664fca8661c188ab822e89
0925 01:50:01.265641 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.265736 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10312597}
I20260925 01:50:01.267134 11754 tablet_bootstrap.cc:492] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:01.267320 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 95ac080782664fca8661c188ab822e89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95ac080782664fca8661c188ab822e89 already in progress: creating tablet
I20260925 01:50:01.267736 11953 tablet_replica.cc:333] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:01.268028 11953 raft_consensus.cc:2243] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: Raft consensus shutting down.
I20260925 01:50:01.269057 11754 tablet_bootstrap.cc:654] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.269469 11953 pending_rounds.cc:70] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:50:01.269600 11953 pending_rounds.cc:77] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7333072879515586560 op_type: NO_OP noop_request { }
I20260925 01:50:01.269776 11953 raft_consensus.cc:2889] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:01.269933 11953 raft_consensus.cc:2272] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.273687 11953 ts_tablet_manager.cc:1916] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.274233 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 638ccb15c1ac4c52ad88715c54b63eef (DEFAULT_TABLE table=default.Table_e4155c334ef147f5ba69e879f6cfb9d8 [id=8d3639f46860496a86b7c69616dc230a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.274653 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638ccb15c1ac4c52ad88715c54b63eef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.281347 12689 ts_tablet_manager.cc:1916] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.281935 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 784de8c6e6e1434a91106dd19cd9262a (table default.Table_3bcedabba6c244178b5f3479e7996282 [id=5405c0f51c3b4db8a58b97b60ea65777]) successfully deleted
W20260925 01:50:01.282191 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 53272.2us
I20260925 01:50:01.287761 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet ba378e9d37c64a8ebd56894b2101ed8f from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:01.300184 11217 tablet_service.cc:1511] Processing CreateTablet for tablet bc27b9e9a30346ee8ee3adea80415d06 (DEFAULT_TABLE table=default.Table_65d991e4d853418794cdc5969c263ba2 [id=c3c5a1e4ef0a4178ba5c7b480c2be617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.300735 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc27b9e9a30346ee8ee3adea80415d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.301820 12696 consensus_queue.cc:1048] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:01.309162 11360 tablet_service.cc:1511] Processing CreateTablet for tablet bc27b9e9a30346ee8ee3adea80415d06 (DEFAULT_TABLE table=default.Table_65d991e4d853418794cdc5969c263ba2 [id=c3c5a1e4ef0a4178ba5c7b480c2be617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.309724 11953 ts_tablet_manager.cc:1929] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20260925 01:50:01.309777 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc27b9e9a30346ee8ee3adea80415d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.309849 11953 log.cc:1199] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8b16a38a30ff44fb8d7eb01498f9b9c7
I20260925 01:50:01.313802 11953 ts_tablet_manager.cc:1950] T 8b16a38a30ff44fb8d7eb01498f9b9c7 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:01.315312 11754 tablet_bootstrap.cc:492] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:01.315485 11754 ts_tablet_manager.cc:1403] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20260925 01:50:01.316145 11754 raft_consensus.cc:359] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.316334 11754 raft_consensus.cc:385] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.316409 11754 raft_consensus.cc:740] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.320878 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 197) took 10325 ms. Trace:
I20260925 01:50:01.320994 11953 rpcz_store.cc:276] 0925 01:49:50.995934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:50.995993 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:01.267682 (+10271689us) ts_tablet_manager.cc:1151] Deleting tablet 8b16a38a30ff44fb8d7eb01498f9b9c7
0925 01:50:01.267692 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.290779 (+ 23087us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.309662 (+ 18883us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.320850 (+ 11188us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10271456}
I20260925 01:50:01.321712 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:50:01.321960 12689 ts_tablet_manager.cc:1929] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:01.322041 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_86edaad42a944526bfcf613cf67660dc [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 1 got 0
I20260925 01:50:01.324920 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 198) took 10096 ms. Trace:
I20260925 01:50:01.325059 11953 rpcz_store.cc:276] 0925 01:49:51.228531 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.229098 (+ 567us) service_pool.cc:224] Handling call
0925 01:50:01.324738 (+10095640us) ts_tablet_manager.cc:1151] Deleting tablet a07f37b8469a497ba3fe504cb21105d2
0925 01:50:01.324753 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.324892 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10078440}
I20260925 01:50:01.325188 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
W20260925 01:50:01.325655 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a07f37b8469a497ba3fe504cb21105d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a07f37b8469a497ba3fe504cb21105d2 already in progress: creating tablet
I20260925 01:50:01.326627 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 204) took 10074 ms. Trace:
I20260925 01:50:01.326704 11953 rpcz_store.cc:276] 0925 01:49:51.251718 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.252590 (+ 872us) service_pool.cc:224] Handling call
0925 01:50:01.326524 (+10073934us) ts_tablet_manager.cc:1151] Deleting tablet ae948bf42ae34a7ab72112d5f1f02585
0925 01:50:01.326534 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.326611 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10066698}
W20260925 01:50:01.327157 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ae948bf42ae34a7ab72112d5f1f02585 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae948bf42ae34a7ab72112d5f1f02585 already in progress: creating tablet
I20260925 01:50:01.327423 11953 tablet_replica.cc:333] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:01.327601 11953 raft_consensus.cc:2243] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.327725 11953 raft_consensus.cc:2272] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.330785 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:50:01.333039 11953 ts_tablet_manager.cc:1916] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.333348 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:50:01.333583 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:50:01.334297 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:01.335132 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a727d3e849e3447caa7689dbdf276ed1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:01.322204 11754 consensus_queue.cc:260] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:01.335916 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a727d3e849e3447caa7689dbdf276ed1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.337536 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 7496a9eaa1714e9fa83d8c88bf1070fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.338400 11754 ts_tablet_manager.cc:1434] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
W20260925 01:50:01.338683 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 602af3d6e7bb44f8a316691019f85c25 consensus state has no leader
I20260925 01:50:01.338737 11754 tablet_bootstrap.cc:492] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:01.339113 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_11b951ff79f74904a9e676cdd1c8cd12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:01.339387 11953 ts_tablet_manager.cc:1929] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:01.339486 11953 log.cc:1199] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/927bc1194884470e9fc977ca870f1b0c
W20260925 01:50:01.339656 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11b951ff79f74904a9e676cdd1c8cd12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.339828 11953 ts_tablet_manager.cc:1950] T 927bc1194884470e9fc977ca870f1b0c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:01.342191 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 7496a9eaa1714e9fa83d8c88bf1070fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.343561 11754 tablet_bootstrap.cc:654] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.347028 12689 log.cc:1199] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/927bc1194884470e9fc977ca870f1b0c
I20260925 01:50:01.347589 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d8cc810ec8854fec9b0d3ddb25985f8f" } new_table_name: "default.Table_be5cbec8322f47fda428924e891c53cc" modify_external_catalogs: true
I20260925 01:50:01.349136 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 80fe96946b294785b8d76564e0f5fa12 with delete_type TABLET_DATA_DELETED (replaced by tablet 246aafd66334407895ce235e4b2ca7f4) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.349725 12689 ts_tablet_manager.cc:1950] T 927bc1194884470e9fc977ca870f1b0c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:01.351572 12689 tablet_replica.cc:333] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:01.355304 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 927bc1194884470e9fc977ca870f1b0c (table default.Table_260512e222a64aae83a308a6de0b4843 [id=876adf51567e47859196d02efc6f89ce]) successfully deleted
I20260925 01:50:01.357861 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.358251 12689 raft_consensus.cc:2243] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.359187 12689 raft_consensus.cc:2272] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.359335 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 218) took 9950 ms. Trace:
I20260925 01:50:01.359473 11953 rpcz_store.cc:276] 0925 01:49:51.408700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.408760 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:01.327379 (+9918619us) ts_tablet_manager.cc:1151] Deleting tablet 927bc1194884470e9fc977ca870f1b0c
0925 01:50:01.327388 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.336311 (+ 8923us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.339333 (+ 3022us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.359305 (+ 19972us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9916607}
I20260925 01:50:01.360103 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 927bc1194884470e9fc977ca870f1b0c (table default.Table_260512e222a64aae83a308a6de0b4843 [id=876adf51567e47859196d02efc6f89ce]) successfully deleted
I20260925 01:50:01.361459 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 220) took 9935 ms. Trace:
I20260925 01:50:01.361637 12689 ts_tablet_manager.cc:1916] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.363008 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 16ae228570e64ca3bb567623081c9293 (DEFAULT_TABLE table=default.Table_7b35a535e73d457fa656be9ee5291649 [id=a262cf228a2549d7bb8daecd108c1c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.363385 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ae228570e64ca3bb567623081c9293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.372200 11953 rpcz_store.cc:276] 0925 01:49:51.425553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.425613 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:01.361325 (+9935712us) ts_tablet_manager.cc:1151] Deleting tablet f2618c46630c4295949b36f3d0087941
0925 01:50:01.361337 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.361440 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9930615}
W20260925 01:50:01.372860 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f2618c46630c4295949b36f3d0087941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2618c46630c4295949b36f3d0087941 already in progress: creating tablet
I20260925 01:50:01.374042 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:50:01.375819 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 16ae228570e64ca3bb567623081c9293 (DEFAULT_TABLE table=default.Table_7b35a535e73d457fa656be9ee5291649 [id=a262cf228a2549d7bb8daecd108c1c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.376219 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ae228570e64ca3bb567623081c9293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.382897 12689 ts_tablet_manager.cc:1929] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:01.395262 12689 log.cc:1199] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/90647937eb364a7a973d04ea69cbc9aa
I20260925 01:50:01.397228 11953 tablet_replica.cc:333] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:01.397460 11953 raft_consensus.cc:2243] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.397660 11953 raft_consensus.cc:2272] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.398046 12689 ts_tablet_manager.cc:1950] T 90647937eb364a7a973d04ea69cbc9aa P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:01.398281 11953 ts_tablet_manager.cc:1916] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.398885 12704 raft_consensus.cc:493] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.399030 12704 raft_consensus.cc:515] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.399705 12704 leader_election.cc:290] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:01.400821 11314 leader_election.cc:343] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b98ad0f02eb74eba897040401a164f5c
I20260925 01:50:01.384840 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 7e85d77256b646a49771316bd791b3c4 (DEFAULT_TABLE table=default.Table_55c008dcf8a547958cd09786542da6db [id=8fe2f6f8b35f4ebca493beeef6555097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.401253 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e85d77256b646a49771316bd791b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.406987 12689 tablet_replica.cc:333] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:01.408376 11755 tablet_bootstrap.cc:492] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:01.408527 11755 ts_tablet_manager.cc:1403] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.258s user 0.027s sys 0.032s
I20260925 01:50:01.409152 12839 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:01.409181 11755 raft_consensus.cc:359] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.409348 11755 raft_consensus.cc:385] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.409402 11755 raft_consensus.cc:740] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.409622 11755 consensus_queue.cc:260] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.409889 12840 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:01.410665 11755 ts_tablet_manager.cc:1434] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:01.410925 11755 tablet_bootstrap.cc:492] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:01.412376 11754 tablet_bootstrap.cc:492] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:01.412520 11754 ts_tablet_manager.cc:1403] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.010s
I20260925 01:50:01.412549 11755 tablet_bootstrap.cc:654] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.413162 11754 raft_consensus.cc:359] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.417752 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 7e85d77256b646a49771316bd791b3c4 (DEFAULT_TABLE table=default.Table_55c008dcf8a547958cd09786542da6db [id=8fe2f6f8b35f4ebca493beeef6555097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.418174 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e85d77256b646a49771316bd791b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:01.420526 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 296568us
W20260925 01:50:01.420784 11456 leader_election.cc:343] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 4d7b3c65d8a64734b2c432790dae07e1
W20260925 01:50:01.420945 11456 leader_election.cc:343] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 9cd2e1bf7d3e4459a84235b9c3f5383c
I20260925 01:50:01.425305 11754 raft_consensus.cc:385] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.425410 11754 raft_consensus.cc:740] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.425602 11754 consensus_queue.cc:260] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.426337 11754 ts_tablet_manager.cc:1434] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260925 01:50:01.426605 11754 tablet_bootstrap.cc:492] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:01.427917 11754 tablet_bootstrap.cc:654] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.401875 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 90647937eb364a7a973d04ea69cbc9aa (table default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]) successfully deleted
W20260925 01:50:01.431143 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e457c4ab4e814fc4be11ced6ca69284f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e457c4ab4e814fc4be11ced6ca69284f already in progress: creating tablet
W20260925 01:50:01.431421 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5c1c05b5a87e43d38a24f63242415fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c1c05b5a87e43d38a24f63242415fd7 already in progress: creating tablet
W20260925 01:50:01.431612 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9f7639fd1f1149a7973eba0c77bd7065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7639fd1f1149a7973eba0c77bd7065 already in progress: creating tablet
W20260925 01:50:01.431841 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 941fd8333f6d45878677e55ff6948bbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 941fd8333f6d45878677e55ff6948bbf already in progress: creating tablet
W20260925 01:50:01.432024 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 6e644bfe06ff4ca89066b1ded01f2b90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e644bfe06ff4ca89066b1ded01f2b90 already in progress: creating tablet
W20260925 01:50:01.432205 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 11a0a886d73442bd9753df870acf63f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11a0a886d73442bd9753df870acf63f7 already in progress: creating tablet
W20260925 01:50:01.432372 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2a37a6deaeb24c99824b62fbb2d603b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a37a6deaeb24c99824b62fbb2d603b1 already in progress: creating tablet
W20260925 01:50:01.432549 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e40083a885974e3595ec2fb5b16d4a5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e40083a885974e3595ec2fb5b16d4a5d already in progress: creating tablet
W20260925 01:50:01.432737 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8152c9e0b0af4ab2a18c5a0080e22ffc already in progress: creating tablet
I20260925 01:50:01.436424 11953 ts_tablet_manager.cc:1929] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:01.436544 11953 log.cc:1199] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8bf42293dd5d452aa7ed9e0eaa78f54d
I20260925 01:50:01.436973 11953 ts_tablet_manager.cc:1950] T 8bf42293dd5d452aa7ed9e0eaa78f54d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:01.439395 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 7809737ca3d24bfe8829f17d5e3215f5 (DEFAULT_TABLE table=default.Table_290135088f3644b3b2f1bb06a39ab673 [id=63b16d1293ff4b2ebcb75e0ebf34b0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.439924 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.440361 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 716ad6cdf9864fc3b09d88753d45f45f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.440721 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 252415635b5e4b3286948e91d421d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:01.441181 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet fe947074863044c1a8640092735a51fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe947074863044c1a8640092735a51fc already in progress: creating tablet
W20260925 01:50:01.441543 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8036963ed28c4e0aae2c4a0bd8e9c99b already in progress: creating tablet
I20260925 01:50:01.443917 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7809737ca3d24bfe8829f17d5e3215f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.444402 11352 tablet_service.cc:1511] Processing CreateTablet for tablet d8b82e331a1e4a5fb3ff30c67e9c6092 (DEFAULT_TABLE table=default.Table_64a746d945ab40b899c12a9b70706079 [id=635f198f974b46f79248667528fc8e90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.444708 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b82e331a1e4a5fb3ff30c67e9c6092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.450371 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 90c2d8bee1e947c3843af73a00c9cced (DEFAULT_TABLE table=default.Table_74dbca67c17748289e4da7baa267fd53 [id=df2e36e75094499698b4b53c72f89bcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.450727 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c2d8bee1e947c3843af73a00c9cced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.452107 11342 tablet_service.cc:1511] Processing CreateTablet for tablet a0554adf2d9a4ce1a25586367cb7e66f (DEFAULT_TABLE table=default.Table_fef5840c829a432aaad089bb8b851e88 [id=61b831627f5944d6abc2cd92ee65ae0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.452418 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0554adf2d9a4ce1a25586367cb7e66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.454777 11754 tablet_bootstrap.cc:492] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:01.454931 11754 ts_tablet_manager.cc:1403] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.005s
I20260925 01:50:01.455688 11754 raft_consensus.cc:359] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.455865 11754 raft_consensus.cc:385] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.455916 11754 raft_consensus.cc:740] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.456117 11754 consensus_queue.cc:260] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.456630 11754 ts_tablet_manager.cc:1434] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:01.456946 11754 tablet_bootstrap.cc:492] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:01.458446 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 219) took 10047 ms. Trace:
I20260925 01:50:01.458551 11953 rpcz_store.cc:276] 0925 01:49:51.411428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.411581 (+ 153us) service_pool.cc:224] Handling call
0925 01:50:01.397163 (+9985582us) ts_tablet_manager.cc:1151] Deleting tablet 8bf42293dd5d452aa7ed9e0eaa78f54d
0925 01:50:01.397175 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.433366 (+ 36191us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.436364 (+ 2998us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.458421 (+ 22057us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9962393}
I20260925 01:50:01.459381 11754 tablet_bootstrap.cc:654] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.459781 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 221) took 10023 ms. Trace:
I20260925 01:50:01.459877 11953 rpcz_store.cc:276] 0925 01:49:51.438879 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.445158 (+ 6279us) service_pool.cc:224] Handling call
0925 01:50:01.459654 (+10014496us) ts_tablet_manager.cc:1151] Deleting tablet d7f97ead49634bf6b03e292544af4d07
0925 01:50:01.459664 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.459760 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10011160}
I20260925 01:50:01.460405 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 225) took 9862 ms. Trace:
I20260925 01:50:01.460505 11953 rpcz_store.cc:276] 0925 01:49:51.597807 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.598575 (+ 768us) service_pool.cc:224] Handling call
0925 01:50:01.460287 (+9861712us) ts_tablet_manager.cc:1151] Deleting tablet 96b68399843a422b8da3ddfab2c522e6
0925 01:50:01.460297 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.460386 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9861494}
I20260925 01:50:01.459031 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 8bf42293dd5d452aa7ed9e0eaa78f54d (table default.Table_8b1c0d4e229f41dfa2c87392267a114d [id=37bc53f74b2a4f618298bde3281e0ecf]) successfully deleted
W20260925 01:50:01.466405 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d7f97ead49634bf6b03e292544af4d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d7f97ead49634bf6b03e292544af4d07 already in progress: creating tablet
I20260925 01:50:01.466444 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 227) took 9868 ms. Trace:
I20260925 01:50:01.466557 11953 rpcz_store.cc:276] 0925 01:49:51.598500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.600391 (+ 1891us) service_pool.cc:224] Handling call
0925 01:50:01.466289 (+9865898us) ts_tablet_manager.cc:1151] Deleting tablet 86c8c3bba9614539bfe3018461ad21f8
0925 01:50:01.466325 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.466423 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9865556}
W20260925 01:50:01.466682 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 96b68399843a422b8da3ddfab2c522e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b68399843a422b8da3ddfab2c522e6 already in progress: creating tablet
I20260925 01:50:01.466912 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 224) took 9873 ms. Trace:
I20260925 01:50:01.466984 11953 rpcz_store.cc:276] 0925 01:49:51.597641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.604287 (+ 6646us) service_pool.cc:224] Handling call
0925 01:50:01.466800 (+9862513us) ts_tablet_manager.cc:1151] Deleting tablet 98ffeb9d70374afdb72a728d7b211d33
0925 01:50:01.466810 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.466894 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9857209}
I20260925 01:50:01.467278 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 223) took 9896 ms. Trace:
I20260925 01:50:01.467341 11953 rpcz_store.cc:276] 0925 01:49:51.570334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.573017 (+ 2683us) service_pool.cc:224] Handling call
0925 01:50:01.467183 (+9894166us) ts_tablet_manager.cc:1151] Deleting tablet 31353cc95e014e5bb24e5e5cefab1503
0925 01:50:01.467191 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.467258 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9852575}
I20260925 01:50:01.467742 11355 tablet_service.cc:1511] Processing CreateTablet for tablet b2eaaa305f9648ab9accc287da1907ec (DEFAULT_TABLE table=default.Table_53c0e47ee34948e7a0a677a6b4db8e74 [id=b883e95b588949d6a0fa108a6e5b35a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.467825 11354 tablet_service.cc:1511] Processing CreateTablet for tablet ba202fa3456642f8a12119a9a5ff0fb8 (DEFAULT_TABLE table=default.Table_d766662214594ba9afd39223d4838f35 [id=72c665d2040b42b3a0c817f2acbc5758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.468138 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2eaaa305f9648ab9accc287da1907ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.468106 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 6439ba0b0468416d9798a6ac1ee7fddd (DEFAULT_TABLE table=default.Table_888d29cf77974252be89bea321d7542b [id=1ac851b7c103443cbb666b907f339946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.468374 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6439ba0b0468416d9798a6ac1ee7fddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.468380 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 808348302777483cadd28b19b8c53f34 (DEFAULT_TABLE table=default.Table_34c06e31ff804bef91930ab2abeb95f9 [id=c788bb1def364ad29a4f76279b1ed4de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.468743 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808348302777483cadd28b19b8c53f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.474251 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba202fa3456642f8a12119a9a5ff0fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.474306 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 162a3ebad091460b9d424c83df6c54a0 (DEFAULT_TABLE table=default.Table_9ec319c6e6fc4eb99b24cd6c3108082b [id=ca6c10abd54746fab213426d631e2874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.474633 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162a3ebad091460b9d424c83df6c54a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.475150 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 226) took 9877 ms. Trace:
I20260925 01:50:01.475219 11953 rpcz_store.cc:276] 0925 01:49:51.597897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.605265 (+ 7368us) service_pool.cc:224] Handling call
0925 01:50:01.475043 (+9869778us) ts_tablet_manager.cc:1151] Deleting tablet 8c1abd3c2cb34915a595ea73a8d10743
0925 01:50:01.475052 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.475133 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9835901}
I20260925 01:50:01.478086 11953 tablet_replica.cc:333] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:01.478274 11953 raft_consensus.cc:2243] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.478422 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 057ee52b3d324d97b1deb4745336c486 (DEFAULT_TABLE table=default.Table_1aa079cf0846465c986619e062cfdadd [id=36fb0c01fcbb423d80f490dc932d955b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.478763 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057ee52b3d324d97b1deb4745336c486. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:01.484189 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 86c8c3bba9614539bfe3018461ad21f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86c8c3bba9614539bfe3018461ad21f8 already in progress: creating tablet
W20260925 01:50:01.484567 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 31353cc95e014e5bb24e5e5cefab1503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31353cc95e014e5bb24e5e5cefab1503 already in progress: creating tablet
W20260925 01:50:01.485034 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8c1abd3c2cb34915a595ea73a8d10743 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c1abd3c2cb34915a595ea73a8d10743 already in progress: creating tablet
I20260925 01:50:01.486114 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 61b7696fdfe44927a51347ced4ed6e31 (DEFAULT_TABLE table=default.Table_1880d96ed37f4485be6f8a12f050866e [id=55692fbf73e241c9af7b08d1ddeff40e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.486423 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd34fa172904e51ade794892c580248 (DEFAULT_TABLE table=default.Table_6f3f81eb3bad47feb571e26253057f54 [id=c48051c32ab14318a8cd7e719ba60076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.486630 11346 tablet_service.cc:1511] Processing CreateTablet for tablet b8f82aa815bd42bdbf70a673e3a4c9da (DEFAULT_TABLE table=default.Table_3f87fc14acdb4b89927b49c8fb09c83d [id=46f2129d44b04761bcacacc0cbe6e932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.486757 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd34fa172904e51ade794892c580248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.486776 11353 tablet_service.cc:1511] Processing CreateTablet for tablet d28dc51fc345487ba74c56b9b8f1ad42 (DEFAULT_TABLE table=default.Table_25bbdb6b8b6047d890e3355231bd7975 [id=8facf80e134043daa31f63310c08b3c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.486811 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 90b26aa8f149412d9a739882f7e3cd0d (DEFAULT_TABLE table=default.Table_c544bdd60f9f4b30ac00700239f9f0fa [id=983ef62b68a64b81bd120bf2e257d2a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.486931 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f82aa815bd42bdbf70a673e3a4c9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.487156 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b26aa8f149412d9a739882f7e3cd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.487260 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 769a53c2a79349dbad0bdc1f45a9c637 (DEFAULT_TABLE table=default.Table_04da09b466584f5086ee515c0c9bc634 [id=e67f9e992614454daeb17d33db89a0e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.487426 11342 tablet_service.cc:1511] Processing CreateTablet for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 (DEFAULT_TABLE table=default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24 [id=439f4724e13d458990e43b8a126c19c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.487581 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769a53c2a79349dbad0bdc1f45a9c637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.487699 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9ce40cb55d4f90b3c333b55bc5fe18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.490234 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28dc51fc345487ba74c56b9b8f1ad42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.490320 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 5204f01643654d3a9a5e6909f6601bb5 (DEFAULT_TABLE table=default.Table_d0fc550ce5ff4bdf9c47eaa60bc71b36 [id=dff5225b92b64dc2b19a02574760f088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.490768 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 98a94b6345ca427180e8f4e4b279efcf (DEFAULT_TABLE table=default.Table_cee543ab798e45a8b000515354a8ce3a [id=bb278532c6e849949f5e1e699a491254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.490386 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b7696fdfe44927a51347ced4ed6e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.494155 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a94b6345ca427180e8f4e4b279efcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.498827 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204f01643654d3a9a5e6909f6601bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.502851 11342 tablet_service.cc:1511] Processing CreateTablet for tablet ecff9e8f18954679896e5f8cd469a43c (DEFAULT_TABLE table=default.Table_fb1a77602ae243208b79f5f91292701e [id=2c09d7e7743f429ca1e1288b531639b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.503261 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecff9e8f18954679896e5f8cd469a43c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:01.503754 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 62202.5us
W20260925 01:50:01.504027 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1ea85f72e10443229f5f927bcaf31cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ea85f72e10443229f5f927bcaf31cb3 already in progress: creating tablet
W20260925 01:50:01.504293 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 716ad6cdf9864fc3b09d88753d45f45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 716ad6cdf9864fc3b09d88753d45f45f already in progress: creating tablet
W20260925 01:50:01.504510 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 252415635b5e4b3286948e91d421d6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 252415635b5e4b3286948e91d421d6f1 already in progress: creating tablet
W20260925 01:50:01.504727 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 406d31139e1e441aa6fe204168486e28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 406d31139e1e441aa6fe204168486e28 already in progress: creating tablet
I20260925 01:50:01.508733 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 406d31139e1e441aa6fe204168486e28 with delete_type TABLET_DATA_DELETED (replaced by tablet 4480d3b5671a4f2aaf98941cc8d58433) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.509500 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d9558462332400d92f7d61858bdeca2 with delete_type TABLET_DATA_DELETED (replaced by tablet 043ec86a5af048ab81f1450856d5a85f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.510039 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 128be07ff230461ca7f998de7a02468f with delete_type TABLET_DATA_DELETED (replaced by tablet 7131531641464bba9ada4b5655dd0e47) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.510676 11357 tablet_service.cc:1511] Processing CreateTablet for tablet e2f9bcd81d474b4d9b550f0f4e901198 (DEFAULT_TABLE table=default.Table_bc3a5e48fbb543aa9ca4c1401a5699c8 [id=f25dd530ba654428be0aa1d81357ef01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.511240 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f9bcd81d474b4d9b550f0f4e901198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.511341 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 638ccb15c1ac4c52ad88715c54b63eef (DEFAULT_TABLE table=default.Table_e4155c334ef147f5ba69e879f6cfb9d8 [id=8d3639f46860496a86b7c69616dc230a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.511694 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638ccb15c1ac4c52ad88715c54b63eef. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:01.514353 11456 consensus_peers.cc:597] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:01.519198 11358 tablet_service.cc:1511] Processing CreateTablet for tablet f0e110efc66444deba519581e21c7b18 (DEFAULT_TABLE table=default.Table_25e20db647ea459db860551fd250139b [id=b18450437d764caa9f6c3ccfbc1c2988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.519572 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e110efc66444deba519581e21c7b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.514572 12508 consensus_queue.cc:1048] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:01.523324 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 7809737ca3d24bfe8829f17d5e3215f5 (DEFAULT_TABLE table=default.Table_290135088f3644b3b2f1bb06a39ab673 [id=63b16d1293ff4b2ebcb75e0ebf34b0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.523789 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7809737ca3d24bfe8829f17d5e3215f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.525702 11207 tablet_service.cc:1511] Processing CreateTablet for tablet d8b82e331a1e4a5fb3ff30c67e9c6092 (DEFAULT_TABLE table=default.Table_64a746d945ab40b899c12a9b70706079 [id=635f198f974b46f79248667528fc8e90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.526096 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b82e331a1e4a5fb3ff30c67e9c6092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.530586 11211 tablet_service.cc:1511] Processing CreateTablet for tablet a0554adf2d9a4ce1a25586367cb7e66f (DEFAULT_TABLE table=default.Table_fef5840c829a432aaad089bb8b851e88 [id=61b831627f5944d6abc2cd92ee65ae0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.530790 11491 tablet_service.cc:1511] Processing CreateTablet for tablet d8b82e331a1e4a5fb3ff30c67e9c6092 (DEFAULT_TABLE table=default.Table_64a746d945ab40b899c12a9b70706079 [id=635f198f974b46f79248667528fc8e90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.530937 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0554adf2d9a4ce1a25586367cb7e66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.531186 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b82e331a1e4a5fb3ff30c67e9c6092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.532049 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 71b9b70296fc4c209b335f579210c111 (DEFAULT_TABLE table=default.Table_12112ab3522a4098be2d43c7a7d99987 [id=996ddc90deaf4a3ca90c141c83b21a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.532155 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 38603da7b4b14ce5835646c330b1f0ce (DEFAULT_TABLE table=default.Table_b18554efa4ef45df951e50be20d806b6 [id=0ac86942d4924587a9e1657b8bd71883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.532413 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b9b70296fc4c209b335f579210c111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.532763 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38603da7b4b14ce5835646c330b1f0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.534726 11486 tablet_service.cc:1511] Processing CreateTablet for tablet a0554adf2d9a4ce1a25586367cb7e66f (DEFAULT_TABLE table=default.Table_fef5840c829a432aaad089bb8b851e88 [id=61b831627f5944d6abc2cd92ee65ae0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.535369 12781 raft_consensus.cc:493] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.535490 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 6439ba0b0468416d9798a6ac1ee7fddd (DEFAULT_TABLE table=default.Table_888d29cf77974252be89bea321d7542b [id=1ac851b7c103443cbb666b907f339946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.535511 12781 raft_consensus.cc:515] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.535809 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6439ba0b0468416d9798a6ac1ee7fddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.536224 12781 leader_election.cc:290] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:01.536999 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe96946b294785b8d76564e0f5fa12" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:01.537174 11238 raft_consensus.cc:2468] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:01.537642 11314 leader_election.cc:304] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:01.537925 12781 raft_consensus.cc:2804] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.538004 12781 raft_consensus.cc:493] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.538082 12781 raft_consensus.cc:3060] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.542191 11206 tablet_service.cc:1511] Processing CreateTablet for tablet ba202fa3456642f8a12119a9a5ff0fb8 (DEFAULT_TABLE table=default.Table_d766662214594ba9afd39223d4838f35 [id=72c665d2040b42b3a0c817f2acbc5758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.542536 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba202fa3456642f8a12119a9a5ff0fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.542675 11754 tablet_bootstrap.cc:492] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:01.542886 11754 ts_tablet_manager.cc:1403] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.015s
I20260925 01:50:01.544528 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 90c2d8bee1e947c3843af73a00c9cced (DEFAULT_TABLE table=default.Table_74dbca67c17748289e4da7baa267fd53 [id=df2e36e75094499698b4b53c72f89bcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.544553 11754 raft_consensus.cc:359] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.544852 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c2d8bee1e947c3843af73a00c9cced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.544862 11754 raft_consensus.cc:385] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.545022 11754 raft_consensus.cc:740] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.545619 11754 consensus_queue.cc:260] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.542227 11208 tablet_service.cc:1511] Processing CreateTablet for tablet b2eaaa305f9648ab9accc287da1907ec (DEFAULT_TABLE table=default.Table_53c0e47ee34948e7a0a677a6b4db8e74 [id=b883e95b588949d6a0fa108a6e5b35a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.549264 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2eaaa305f9648ab9accc287da1907ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.550742 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 162a3ebad091460b9d424c83df6c54a0 (DEFAULT_TABLE table=default.Table_9ec319c6e6fc4eb99b24cd6c3108082b [id=ca6c10abd54746fab213426d631e2874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.549584 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 057ee52b3d324d97b1deb4745336c486 (DEFAULT_TABLE table=default.Table_1aa079cf0846465c986619e062cfdadd [id=36fb0c01fcbb423d80f490dc932d955b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.551082 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162a3ebad091460b9d424c83df6c54a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.549858 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 808348302777483cadd28b19b8c53f34 (DEFAULT_TABLE table=default.Table_34c06e31ff804bef91930ab2abeb95f9 [id=c788bb1def364ad29a4f76279b1ed4de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.551429 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808348302777483cadd28b19b8c53f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.554164 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057ee52b3d324d97b1deb4745336c486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.559672 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 61b7696fdfe44927a51347ced4ed6e31 (DEFAULT_TABLE table=default.Table_1880d96ed37f4485be6f8a12f050866e [id=55692fbf73e241c9af7b08d1ddeff40e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.559751 12696 raft_consensus.cc:493] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.559989 12696 raft_consensus.cc:515] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.560251 11754 ts_tablet_manager.cc:1434] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260925 01:50:01.560515 11754 tablet_bootstrap.cc:492] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:01.560601 12696 leader_election.cc:290] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.562027 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a8e09b8838443c9bfff440ff1f877d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:01.562304 11754 tablet_bootstrap.cc:654] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:01.562826 11177 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:01.563364 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b7696fdfe44927a51347ced4ed6e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.559672 11214 tablet_service.cc:1511] Processing CreateTablet for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 (DEFAULT_TABLE table=default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24 [id=439f4724e13d458990e43b8a126c19c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.478431 11953 raft_consensus.cc:2272] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.567261 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9ce40cb55d4f90b3c333b55bc5fe18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.567842 11953 ts_tablet_manager.cc:1916] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.569968 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 7496a9eaa1714e9fa83d8c88bf1070fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.570124 11212 tablet_service.cc:1511] Processing CreateTablet for tablet b8f82aa815bd42bdbf70a673e3a4c9da (DEFAULT_TABLE table=default.Table_3f87fc14acdb4b89927b49c8fb09c83d [id=46f2129d44b04761bcacacc0cbe6e932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.570439 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f82aa815bd42bdbf70a673e3a4c9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.570416 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 90c2d8bee1e947c3843af73a00c9cced (DEFAULT_TABLE table=default.Table_74dbca67c17748289e4da7baa267fd53 [id=df2e36e75094499698b4b53c72f89bcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.570842 11499 tablet_service.cc:1511] Processing CreateTablet for tablet b2eaaa305f9648ab9accc287da1907ec (DEFAULT_TABLE table=default.Table_53c0e47ee34948e7a0a677a6b4db8e74 [id=b883e95b588949d6a0fa108a6e5b35a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.571179 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2eaaa305f9648ab9accc287da1907ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.571789 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 057ee52b3d324d97b1deb4745336c486 (DEFAULT_TABLE table=default.Table_1aa079cf0846465c986619e062cfdadd [id=36fb0c01fcbb423d80f490dc932d955b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.572088 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 057ee52b3d324d97b1deb4745336c486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.572613 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 6439ba0b0468416d9798a6ac1ee7fddd (DEFAULT_TABLE table=default.Table_888d29cf77974252be89bea321d7542b [id=1ac851b7c103443cbb666b907f339946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.572883 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6439ba0b0468416d9798a6ac1ee7fddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.575124 11501 tablet_service.cc:1511] Processing CreateTablet for tablet bc27b9e9a30346ee8ee3adea80415d06 (DEFAULT_TABLE table=default.Table_65d991e4d853418794cdc5969c263ba2 [id=c3c5a1e4ef0a4178ba5c7b480c2be617]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.575923 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 7809737ca3d24bfe8829f17d5e3215f5 (DEFAULT_TABLE table=default.Table_290135088f3644b3b2f1bb06a39ab673 [id=63b16d1293ff4b2ebcb75e0ebf34b0c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.576630 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 16ae228570e64ca3bb567623081c9293 (DEFAULT_TABLE table=default.Table_7b35a535e73d457fa656be9ee5291649 [id=a262cf228a2549d7bb8daecd108c1c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.576751 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd34fa172904e51ade794892c580248 (DEFAULT_TABLE table=default.Table_6f3f81eb3bad47feb571e26253057f54 [id=c48051c32ab14318a8cd7e719ba60076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.576956 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ae228570e64ca3bb567623081c9293. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.577076 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd34fa172904e51ade794892c580248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.579844 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 7e85d77256b646a49771316bd791b3c4 (DEFAULT_TABLE table=default.Table_55c008dcf8a547958cd09786542da6db [id=8fe2f6f8b35f4ebca493beeef6555097]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.581100 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ea85f72e10443229f5f927bcaf31cb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.583329 11212 tablet_service.cc:1511] Processing CreateTablet for tablet d28dc51fc345487ba74c56b9b8f1ad42 (DEFAULT_TABLE table=default.Table_25bbdb6b8b6047d890e3355231bd7975 [id=8facf80e134043daa31f63310c08b3c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.583421 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 927bc1194884470e9fc977ca870f1b0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:01.583762 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28dc51fc345487ba74c56b9b8f1ad42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.584016 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 61b7696fdfe44927a51347ced4ed6e31 (DEFAULT_TABLE table=default.Table_1880d96ed37f4485be6f8a12f050866e [id=55692fbf73e241c9af7b08d1ddeff40e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.584216 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c2d8bee1e947c3843af73a00c9cced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.584549 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7809737ca3d24bfe8829f17d5e3215f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.584671 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e85d77256b646a49771316bd791b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.585716 12705 raft_consensus.cc:493] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.585855 12705 raft_consensus.cc:515] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.586535 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0554adf2d9a4ce1a25586367cb7e66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.586862 11490 tablet_service.cc:1511] Processing CreateTablet for tablet d28dc51fc345487ba74c56b9b8f1ad42 (DEFAULT_TABLE table=default.Table_25bbdb6b8b6047d890e3355231bd7975 [id=8facf80e134043daa31f63310c08b3c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.587167 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28dc51fc345487ba74c56b9b8f1ad42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.587981 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd34fa172904e51ade794892c580248 (DEFAULT_TABLE table=default.Table_6f3f81eb3bad47feb571e26253057f54 [id=c48051c32ab14318a8cd7e719ba60076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.588263 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd34fa172904e51ade794892c580248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.589913 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 98a94b6345ca427180e8f4e4b279efcf (DEFAULT_TABLE table=default.Table_cee543ab798e45a8b000515354a8ce3a [id=bb278532c6e849949f5e1e699a491254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.590266 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a94b6345ca427180e8f4e4b279efcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.590567 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc27b9e9a30346ee8ee3adea80415d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.589913 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 5204f01643654d3a9a5e6909f6601bb5 (DEFAULT_TABLE table=default.Table_d0fc550ce5ff4bdf9c47eaa60bc71b36 [id=dff5225b92b64dc2b19a02574760f088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.594527 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204f01643654d3a9a5e6909f6601bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.579044 12508 raft_consensus.cc:493] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.596082 11488 tablet_service.cc:1511] Processing CreateTablet for tablet ba202fa3456642f8a12119a9a5ff0fb8 (DEFAULT_TABLE table=default.Table_d766662214594ba9afd39223d4838f35 [id=72c665d2040b42b3a0c817f2acbc5758]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.600687 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 5204f01643654d3a9a5e6909f6601bb5 (DEFAULT_TABLE table=default.Table_d0fc550ce5ff4bdf9c47eaa60bc71b36 [id=dff5225b92b64dc2b19a02574760f088]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.601818 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 769a53c2a79349dbad0bdc1f45a9c637 (DEFAULT_TABLE table=default.Table_04da09b466584f5086ee515c0c9bc634 [id=e67f9e992614454daeb17d33db89a0e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.602214 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769a53c2a79349dbad0bdc1f45a9c637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.602201 11494 tablet_service.cc:1511] Processing CreateTablet for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 (DEFAULT_TABLE table=default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24 [id=439f4724e13d458990e43b8a126c19c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.602473 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 162a3ebad091460b9d424c83df6c54a0 (DEFAULT_TABLE table=default.Table_9ec319c6e6fc4eb99b24cd6c3108082b [id=ca6c10abd54746fab213426d631e2874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.602771 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 808348302777483cadd28b19b8c53f34 (DEFAULT_TABLE table=default.Table_34c06e31ff804bef91930ab2abeb95f9 [id=c788bb1def364ad29a4f76279b1ed4de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.603210 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba202fa3456642f8a12119a9a5ff0fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.603389 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb9ce40cb55d4f90b3c333b55bc5fe18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.603861 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808348302777483cadd28b19b8c53f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.604183 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162a3ebad091460b9d424c83df6c54a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.607057 12640 raft_consensus.cc:493] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.607177 12640 raft_consensus.cc:515] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.611004 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204f01643654d3a9a5e6909f6601bb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.611243 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b7696fdfe44927a51347ced4ed6e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.611320 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 90b26aa8f149412d9a739882f7e3cd0d (DEFAULT_TABLE table=default.Table_c544bdd60f9f4b30ac00700239f9f0fa [id=983ef62b68a64b81bd120bf2e257d2a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.612120 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b26aa8f149412d9a739882f7e3cd0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.624822 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 98a94b6345ca427180e8f4e4b279efcf (DEFAULT_TABLE table=default.Table_cee543ab798e45a8b000515354a8ce3a [id=bb278532c6e849949f5e1e699a491254]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.630730 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 71b9b70296fc4c209b335f579210c111 (DEFAULT_TABLE table=default.Table_12112ab3522a4098be2d43c7a7d99987 [id=996ddc90deaf4a3ca90c141c83b21a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.631242 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b9b70296fc4c209b335f579210c111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.638670 11210 tablet_service.cc:1511] Processing CreateTablet for tablet ecff9e8f18954679896e5f8cd469a43c (DEFAULT_TABLE table=default.Table_fb1a77602ae243208b79f5f91292701e [id=2c09d7e7743f429ca1e1288b531639b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.639111 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecff9e8f18954679896e5f8cd469a43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.640765 12705 leader_election.cc:290] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:01.642051 11314 leader_election.cc:343] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 784de8c6e6e1434a91106dd19cd9262a
I20260925 01:50:01.643514 12781 raft_consensus.cc:515] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.650884 11216 tablet_service.cc:1511] Processing CreateTablet for tablet f0e110efc66444deba519581e21c7b18 (DEFAULT_TABLE table=default.Table_25e20db647ea459db860551fd250139b [id=b18450437d764caa9f6c3ccfbc1c2988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.651301 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e110efc66444deba519581e21c7b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.666354 11210 tablet_service.cc:1511] Processing CreateTablet for tablet e2f9bcd81d474b4d9b550f0f4e901198 (DEFAULT_TABLE table=default.Table_bc3a5e48fbb543aa9ca4c1401a5699c8 [id=f25dd530ba654428be0aa1d81357ef01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.666850 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f9bcd81d474b4d9b550f0f4e901198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.673058 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe96946b294785b8d76564e0f5fa12" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:01.673266 11240 raft_consensus.cc:3060] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.676149 11240 raft_consensus.cc:2468] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:01.676700 11314 leader_election.cc:304] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:01.677167 12705 raft_consensus.cc:2804] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:01.677311 12705 raft_consensus.cc:697] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:01.677568 12705 consensus_queue.cc:237] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.678047 12781 leader_election.cc:290] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:01.679553 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 38603da7b4b14ce5835646c330b1f0ce (DEFAULT_TABLE table=default.Table_b18554efa4ef45df951e50be20d806b6 [id=0ac86942d4924587a9e1657b8bd71883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.679922 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38603da7b4b14ce5835646c330b1f0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.721295 11755 tablet_bootstrap.cc:492] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:01.721464 11755 ts_tablet_manager.cc:1403] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.311s user 0.004s sys 0.001s
I20260925 01:50:01.722226 11755 raft_consensus.cc:359] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.722409 11755 raft_consensus.cc:385] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.722467 11755 raft_consensus.cc:740] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.722712 11755 consensus_queue.cc:260] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.723227 11755 ts_tablet_manager.cc:1434] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:01.723526 11755 tablet_bootstrap.cc:492] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:01.725098 11755 tablet_bootstrap.cc:654] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.730702 11754 tablet_bootstrap.cc:492] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:01.730844 11754 ts_tablet_manager.cc:1403] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.170s user 0.006s sys 0.002s
I20260925 01:50:01.731503 11754 raft_consensus.cc:359] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.731670 11754 raft_consensus.cc:385] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.731714 11754 raft_consensus.cc:740] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.731920 11754 consensus_queue.cc:260] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.733748 11675 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]). Expected version 2 got 0
I20260925 01:50:01.734575 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bc99f3613c354d68bfde33e04dc1e9ab
I20260925 01:50:01.735136 11674 catalog_manager.cc:6934] ReplaceTablet: tablet bc99f3613c354d68bfde33e04dc1e9ab deleted and replaced by tablet eb4453c8f82c4c2bbe3d1ddb71045a9b
I20260925 01:50:01.738516 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet bc99f3613c354d68bfde33e04dc1e9ab with delete_type TABLET_DATA_DELETED (replaced by tablet eb4453c8f82c4c2bbe3d1ddb71045a9b) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.739089 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_80ca296c2f004baca398878b60eb0d0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.739670 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80ca296c2f004baca398878b60eb0d0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.744424 12689 raft_consensus.cc:2243] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.750294 12705 raft_consensus.cc:493] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.750459 12705 raft_consensus.cc:515] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.751227 12705 leader_election.cc:290] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:01.753000 11314 leader_election.cc:343] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:50:01.626619 11485 tablet_service.cc:1511] Processing CreateTablet for tablet b8f82aa815bd42bdbf70a673e3a4c9da (DEFAULT_TABLE table=default.Table_3f87fc14acdb4b89927b49c8fb09c83d [id=46f2129d44b04761bcacacc0cbe6e932]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.769021 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f82aa815bd42bdbf70a673e3a4c9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.770685 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_86edaad42a944526bfcf613cf67660dc" } new_table_name: "default.Table_99371c3e38fd42af8a6efa16f0f84d4b" modify_external_catalogs: true
I20260925 01:50:01.626957 12640 leader_election.cc:290] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.774783 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a94b6345ca427180e8f4e4b279efcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.664865 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 90b26aa8f149412d9a739882f7e3cd0d (DEFAULT_TABLE table=default.Table_c544bdd60f9f4b30ac00700239f9f0fa [id=983ef62b68a64b81bd120bf2e257d2a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.778936 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b26aa8f149412d9a739882f7e3cd0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:01.674355 11753 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.622s user 0.018s sys 0.026s
I20260925 01:50:01.679172 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a8e09b8838443c9bfff440ff1f877d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:01.595233 12508 raft_consensus.cc:515] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.704171 12770 raft_consensus.cc:493] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:01.780326 12770 raft_consensus.cc:515] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.780824 12508 leader_election.cc:290] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.780825 12770 leader_election.cc:290] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:01.781165 11753 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.728s user 0.018s sys 0.027s
I20260925 01:50:01.782027 11753 tablet_bootstrap.cc:492] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:01.782233 11753 ts_tablet_manager.cc:1403] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.884s user 0.021s sys 0.027s
I20260925 01:50:01.783129 11753 raft_consensus.cc:359] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.783418 11753 raft_consensus.cc:385] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.783510 11753 raft_consensus.cc:740] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.715739 11503 tablet_service.cc:1511] Processing CreateTablet for tablet ecff9e8f18954679896e5f8cd469a43c (DEFAULT_TABLE table=default.Table_fb1a77602ae243208b79f5f91292701e [id=2c09d7e7743f429ca1e1288b531639b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.783931 11753 consensus_queue.cc:260] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.784243 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecff9e8f18954679896e5f8cd469a43c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.716001 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 71b9b70296fc4c209b335f579210c111 (DEFAULT_TABLE table=default.Table_12112ab3522a4098be2d43c7a7d99987 [id=996ddc90deaf4a3ca90c141c83b21a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.790464 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b9b70296fc4c209b335f579210c111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.716238 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 769a53c2a79349dbad0bdc1f45a9c637 (DEFAULT_TABLE table=default.Table_04da09b466584f5086ee515c0c9bc634 [id=e67f9e992614454daeb17d33db89a0e5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:01.792945 11176 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:01.793083 11176 leader_election.cc:304] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:01.793340 12754 raft_consensus.cc:2749] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:01.793385 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769a53c2a79349dbad0bdc1f45a9c637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.794137 11753 ts_tablet_manager.cc:1434] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260925 01:50:01.716944 11487 tablet_service.cc:1511] Processing CreateTablet for tablet e2f9bcd81d474b4d9b550f0f4e901198 (DEFAULT_TABLE table=default.Table_bc3a5e48fbb543aa9ca4c1401a5699c8 [id=f25dd530ba654428be0aa1d81357ef01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.798717 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f9bcd81d474b4d9b550f0f4e901198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.799993 11753 tablet_bootstrap.cc:492] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:01.717478 11502 tablet_service.cc:1511] Processing CreateTablet for tablet f0e110efc66444deba519581e21c7b18 (DEFAULT_TABLE table=default.Table_25e20db647ea459db860551fd250139b [id=b18450437d764caa9f6c3ccfbc1c2988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.800385 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e110efc66444deba519581e21c7b18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.801470 11753 tablet_bootstrap.cc:654] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.802459 12689 raft_consensus.cc:2272] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.803133 12689 ts_tablet_manager.cc:1916] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.806286 11754 ts_tablet_manager.cc:1434] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.075s user 0.001s sys 0.001s
W20260925 01:50:01.807475 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 85026.7us
W20260925 01:50:01.808344 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 7c9364671fcc42dba51569d14979f030 (table default.Table_7f7dafdc6f97469b84dfb97f6ae1ceb5 [id=8fcc310b81cc4e4fad99fd9a7df66be6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7c9364671fcc42dba51569d14979f030 consensus state has no leader
I20260925 01:50:01.813038 12852 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:01.817698 11754 tablet_bootstrap.cc:492] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:01.819537 11754 tablet_bootstrap.cc:654] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.820076 11953 ts_tablet_manager.cc:1929] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:01.820230 11953 log.cc:1199] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/99913eb35197442880a27b3c288237f4
I20260925 01:50:01.820748 11953 ts_tablet_manager.cc:1950] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:50:01.824173 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 854549ed223142429513c1d80c026793 has no consensus state
I20260925 01:50:01.821293 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 233) took 10141 ms. Trace:
I20260925 01:50:01.825078 11953 rpcz_store.cc:276] 0925 01:49:51.679380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.682574 (+ 3194us) service_pool.cc:224] Handling call
0925 01:50:01.478022 (+9795448us) ts_tablet_manager.cc:1151] Deleting tablet 99913eb35197442880a27b3c288237f4
0925 01:50:01.478031 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.712382 (+234351us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.820007 (+107625us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.821274 (+ 1267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9780740}
I20260925 01:50:01.825642 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 99913eb35197442880a27b3c288237f4 (table default.Table_bf94da756bf24c42b0debbb732b59861 [id=5a101d4224e546e686f9bf819b07c07b]) successfully deleted
I20260925 01:50:01.826133 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 241) took 10025 ms. Trace:
I20260925 01:50:01.836268 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2a41cecc90bc4f7caeca09f31a429af3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.837474 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a41cecc90bc4f7caeca09f31a429af3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.837482 12689 ts_tablet_manager.cc:1929] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:01.837592 12689 log.cc:1199] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/4d9558462332400d92f7d61858bdeca2
I20260925 01:50:01.837944 12689 ts_tablet_manager.cc:1950] T 4d9558462332400d92f7d61858bdeca2 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:01.837814 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ba378e9d37c64a8ebd56894b2101ed8f
I20260925 01:50:01.838630 11679 catalog_manager.cc:6934] ReplaceTablet: tablet ba378e9d37c64a8ebd56894b2101ed8f deleted and replaced by tablet 21ee9163747b462f86105be553a57b2f
I20260925 01:50:01.836891 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4cd88c56891a44ea999bf93572048756"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.839913 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4cd88c56891a44ea999bf93572048756 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.843278 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_10c5ec3219c8401f81c2ee6b0013e4c3" } modify_external_catalogs: true
I20260925 01:50:01.843497 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_10c5ec3219c8401f81c2ee6b0013e4c3" } modify_external_catalogs: true
I20260925 01:50:01.850817 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6b7ea24cfbf4403b9a9683f626e600df" } modify_external_catalogs: true
I20260925 01:50:01.851007 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6b7ea24cfbf4403b9a9683f626e600df" } modify_external_catalogs: true
I20260925 01:50:01.853433 11753 tablet_bootstrap.cc:492] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:01.855125 11753 ts_tablet_manager.cc:1403] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.001s
I20260925 01:50:01.861019 12689 tablet_replica.cc:333] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:01.866856 12689 raft_consensus.cc:2243] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:01.867991 12689 raft_consensus.cc:2272] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.869110 11753 raft_consensus.cc:359] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.869333 11753 raft_consensus.cc:385] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.869410 11753 raft_consensus.cc:740] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.869638 11753 consensus_queue.cc:260] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.870157 11753 ts_tablet_manager.cc:1434] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:01.870479 11753 tablet_bootstrap.cc:492] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:01.870985 12689 ts_tablet_manager.cc:1916] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.871893 11753 tablet_bootstrap.cc:654] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:01.876566 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e973513b7c3d4c1dadf184056a92dad5" } modify_external_catalogs: true
I20260925 01:50:01.876853 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e973513b7c3d4c1dadf184056a92dad5" } modify_external_catalogs: true
W20260925 01:50:01.879000 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a07f977c6a00450a8e8ceb6580dab980 consensus state has no leader
I20260925 01:50:01.720760 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 38603da7b4b14ce5835646c330b1f0ce (DEFAULT_TABLE table=default.Table_b18554efa4ef45df951e50be20d806b6 [id=0ac86942d4924587a9e1657b8bd71883]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:01.728895 11457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s user 0.000s sys 0.011s
W20260925 01:50:01.881451 11457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s user 0.000s sys 0.011s
W20260925 01:50:01.881706 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 788083us
I20260925 01:50:01.882212 12770 consensus_queue.cc:1048] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:01.883023 11457 leader_election.cc:304] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.883410 12770 raft_consensus.cc:2804] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.883487 12770 raft_consensus.cc:493] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.883548 12770 raft_consensus.cc:3060] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.885196 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_408d8b2c40464a69b5427f4713abff09" } modify_external_catalogs: true
I20260925 01:50:01.885412 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_408d8b2c40464a69b5427f4713abff09" } modify_external_catalogs: true
I20260925 01:50:01.886391 11754 tablet_bootstrap.cc:492] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:01.886431 11457 leader_election.cc:304] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.886549 11754 ts_tablet_manager.cc:1403] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.080s user 0.009s sys 0.001s
I20260925 01:50:01.886848 12508 raft_consensus.cc:2804] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:01.886936 12508 raft_consensus.cc:493] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:01.886999 12508 raft_consensus.cc:3060] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.887307 11754 raft_consensus.cc:359] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.887490 11754 raft_consensus.cc:385] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.887555 11754 raft_consensus.cc:740] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.887775 11754 consensus_queue.cc:260] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.888795 12770 raft_consensus.cc:515] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.889592 12770 leader_election.cc:290] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:01.895875 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_2f4382db373943b6bc9420f53b562dd6 [id=464edb71967c4016ae7592aaad5492d6] alter complete (version 3)
I20260925 01:50:01.896952 12508 raft_consensus.cc:515] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:01.897578 12508 leader_election.cc:290] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:01.898970 11457 leader_election.cc:343] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:01.899165 11457 leader_election.cc:304] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:01.901520 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b9df8d98e5414186ef23b8b7f9cb61" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:01.902154 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38082c23d99148bb916b0ae74fd474b8" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:01.902364 11522 raft_consensus.cc:2393] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:50:01.903350 12508 raft_consensus.cc:2749] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:01.760586 11946 ts_tablet_manager.cc:1929] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:01.903752 11946 log.cc:1199] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:50:01.904148 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b4bfc0be56f644a58a63e250d8b3e1fc" } modify_external_catalogs: true
I20260925 01:50:01.904247 11946 ts_tablet_manager.cc:1950] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:01.904402 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b4bfc0be56f644a58a63e250d8b3e1fc" } modify_external_catalogs: true
I20260925 01:50:01.904786 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 522) took 1502 ms. Trace:
I20260925 01:50:01.905018 11946 rpcz_store.cc:276] 0925 01:50:00.401944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.402004 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:01.129787 (+727783us) ts_tablet_manager.cc:1151] Deleting tablet e2b9df8d98e5414186ef23b8b7f9cb61
0925 01:50:01.129796 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.141080 (+ 11284us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x616000221b54. stack: 00007f859f5785c6 00007f859f578380 00007f859e58034d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f85ab66ca70 00007f85ac9f5583 00007f85af5c28b7 00007f85af5f5a64 00007f85af5d63a0 00007f85af5d612d 0000000000aaef9c 00007f859f5beaef 00007f859f5c1deb 00007f859f5c1c68
0925 01:50:01.145052 (+ 3972us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.760521 (+615469us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:01.904765 (+144244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24440704,"tablet-delete.queue_time_us":727481}
I20260925 01:50:01.905159 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9ba286d06c5641748f432f59537f524e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:01.905556 11946 tablet_replica.cc:333] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:01.905740 11946 raft_consensus.cc:2243] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:01.905807 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ba286d06c5641748f432f59537f524e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.905890 11946 raft_consensus.cc:2272] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.906518 11946 ts_tablet_manager.cc:1916] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.907555 12689 ts_tablet_manager.cc:1929] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:50:01.915298 12689 log.cc:1199] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:01.915845 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d859207bbc4aefb26c726dce404c44" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:01.916039 11519 raft_consensus.cc:2468] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:01.917023 12689 ts_tablet_manager.cc:1950] T 7496a9eaa1714e9fa83d8c88bf1070fd P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:50:01.917685 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 107323us
I20260925 01:50:01.922027 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]) successfully deleted
I20260925 01:50:01.922690 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe96946b294785b8d76564e0f5fa12" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:01.922871 11519 raft_consensus.cc:2468] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:01.923569 11754 ts_tablet_manager.cc:1434] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260925 01:50:01.926196 12689 tablet_replica.cc:333] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:01.926982 12689 raft_consensus.cc:2243] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:01.927312 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet bc99f3613c354d68bfde33e04dc1e9ab with delete_type TABLET_DATA_DELETED (replaced by tablet eb4453c8f82c4c2bbe3d1ddb71045a9b) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:01.932291 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784de8c6e6e1434a91106dd19cd9262a" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:01.932519 11519 raft_consensus.cc:2468] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
W20260925 01:50:01.934752 11456 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e2b9df8d98e5414186ef23b8b7f9cb61
W20260925 01:50:01.935050 11456 consensus_peers.cc:597] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ee95aba7a8f4d8db4ed0b8a862dab63. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:01.935304 11456 leader_election.cc:343] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 30a5240093dd442a93bff006a965bc41
I20260925 01:50:01.937141 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80fe96946b294785b8d76564e0f5fa12" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:01.937408 11519 raft_consensus.cc:3060] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.927428 12689 raft_consensus.cc:2272] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:01.932981 11754 tablet_bootstrap.cc:492] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:01.940614 11519 raft_consensus.cc:2468] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:01.942909 12689 ts_tablet_manager.cc:1916] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:01.947177 11753 tablet_bootstrap.cc:492] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:01.947336 11753 ts_tablet_manager.cc:1403] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.000s
I20260925 01:50:01.949424 11753 raft_consensus.cc:359] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.968008 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17352fd6ea4e4ed9a178f1510edf4f6d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:01.968233 11519 raft_consensus.cc:2468] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:01.949597 11753 raft_consensus.cc:385] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:01.969352 11753 raft_consensus.cc:740] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:01.969586 11753 consensus_queue.cc:260] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:01.970206 11753 ts_tablet_manager.cc:1434] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260925 01:50:01.933722 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_075eb0b9de704b3488addb686e309da4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:01.971239 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_075eb0b9de704b3488addb686e309da4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:01.962930 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:01.972736 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
I20260925 01:50:01.976682 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
W20260925 01:50:01.979050 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 57052.1us
W20260925 01:50:01.981272 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 128be07ff230461ca7f998de7a02468f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 128be07ff230461ca7f998de7a02468f already in progress: creating tablet
I20260925 01:50:01.983341 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]) successfully deleted
I20260925 01:50:01.847923 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet ba378e9d37c64a8ebd56894b2101ed8f with delete_type TABLET_DATA_DELETED (replaced by tablet 21ee9163747b462f86105be553a57b2f) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.897931 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:01.985405 11953 rpcz_store.cc:276] 0925 01:49:51.800688 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.800740 (+ 52us) service_pool.cc:224] Handling call
0925 01:50:01.825959 (+10025219us) ts_tablet_manager.cc:1151] Deleting tablet 5d23c5d52faa4b6da2996fabb16bd74a
0925 01:50:01.825970 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:01.826114 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10019569}
W20260925 01:50:01.967227 11314 leader_election.cc:343] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 99913eb35197442880a27b3c288237f4
I20260925 01:50:01.990917 11314 leader_election.cc:304] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:01.991153 11314 raft_consensus.cc:2686] T 99913eb35197442880a27b3c288237f4 P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:01.992720 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "596f8ddbcd16458aa4f287f4f11282a1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:01.992913 11379 raft_consensus.cc:3060] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.993269 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd17f1ecead409ab7b54c2120476a3b (DEFAULT_TABLE table=default.Table_b7368994d6964edf87f8ed676a790ca0 [id=18c432ba97cc44c9962c952f57359887]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.993355 11351 tablet_service.cc:1511] Processing CreateTablet for tablet ae05900043cb49d29f528fcbe4c8ada0 (DEFAULT_TABLE table=default.Table_09785932e2864af7afe4554f30909290 [id=7204958e8ea0484eaeedf9264aef6333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.993727 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd17f1ecead409ab7b54c2120476a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.995786 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2b9df8d98e5414186ef23b8b7f9cb61" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:01.995990 11377 raft_consensus.cc:2393] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:50:01.997412 11379 raft_consensus.cc:2468] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:01.998193 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38082c23d99148bb916b0ae74fd474b8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:01.998425 11370 raft_consensus.cc:2393] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:50:01.998684 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d7b3c65d8a64734b2c432790dae07e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:01.998826 11375 raft_consensus.cc:3060] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:01.999976 11753 tablet_bootstrap.cc:492] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:02.001775 11375 raft_consensus.cc:2468] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:02.002233 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae05900043cb49d29f528fcbe4c8ada0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.002317 11754 tablet_bootstrap.cc:654] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:02.002436 11456 consensus_peers.cc:597] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 347a144e18ab4f6e834551044a2ac4ae. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:02.002605 11456 leader_election.cc:343] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 85d859207bbc4aefb26c726dce404c44
W20260925 01:50:02.002784 11456 leader_election.cc:343] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 17352fd6ea4e4ed9a178f1510edf4f6d
W20260925 01:50:02.005797 11456 leader_election.cc:343] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 19c718c83cfe49b9a745e06314e24409
W20260925 01:50:02.006002 11456 leader_election.cc:343] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: f1b6ea676a1f4d99807029d8401251ef
I20260925 01:50:01.967654 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba4def6c15a410f87b3bf1f168f80d4 (DEFAULT_TABLE table=default.Table_7948cfa6f9c44365859c26d788fbd1d6 [id=2950c0d26fe542fdadaeef6c46480762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.006424 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba4def6c15a410f87b3bf1f168f80d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:01.969537 11356 tablet_service.cc:1511] Processing CreateTablet for tablet cf0e934eb63145808ac05234a33f42be (DEFAULT_TABLE table=default.Table_9f053c2667d241f3b0349162a44be758 [id=6fe44bc51fb34145a11319e1aa36b3be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.973040 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 2efc66011a0c42b4a55d2f97d7cb6813 (DEFAULT_TABLE table=default.Table_e1addda8d0d543b7be2ee34ace5d76c8 [id=61254a933cb34bac8c98a48bc1b54054]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.980026 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea77bdd6680491da6f9aa8e218bdace (DEFAULT_TABLE table=default.Table_c98e3154b1c4405abb6aa97166f8c330 [id=9686238713534c25a2a80856b84e9085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.942162 11755 tablet_bootstrap.cc:492] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:02.011255 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd2e1bf7d3e4459a84235b9c3f5383c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.011427 11755 ts_tablet_manager.cc:1403] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.288s user 0.003s sys 0.022s
I20260925 01:50:02.011708 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a5240093dd442a93bff006a965bc41" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.012266 11755 raft_consensus.cc:359] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.012480 11755 raft_consensus.cc:385] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.012542 11755 raft_consensus.cc:740] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.012792 11755 consensus_queue.cc:260] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.013398 11755 ts_tablet_manager.cc:1434] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:02.013725 11755 tablet_bootstrap.cc:492] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:01.988302 11349 tablet_service.cc:1511] Processing CreateTablet for tablet cb8aa7454b2547e58a52c7c007027aa6 (DEFAULT_TABLE table=default.Table_eb97db398056479f9ae0f2c03b05d706 [id=1972269739b14bcbb935f5e7ef6cd727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.989488 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 2a95be5cafa74e7a87fd39cd86fa150e (DEFAULT_TABLE table=default.Table_7af8acc141c7463baecaf9e462f76558 [id=60ae24a4b03c4d5a912d802a195a38a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.011442 11372 raft_consensus.cc:3060] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.017357 11372 raft_consensus.cc:2468] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:02.019958 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5c9dac783d4ef3a24cb65275ff484f (DEFAULT_TABLE table=default.Table_fd035701fcd04644b86876963e515e35 [id=8b19e3cab6fa41d883e4981b42cb4df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.990599 11360 tablet_service.cc:1511] Processing CreateTablet for tablet fb9339ab8dcb4ecca41fef9e9552009e (DEFAULT_TABLE table=default.Table_635b952a4e8b4c5b9b99fdf275576e31 [id=92528498535f47baa077e127c4c2c03a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:01.990640 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 (DEFAULT_TABLE table=default.Table_71415b17dd35411f85245718ad9b25fd [id=36954127ea4147bfb13fe12b68e58e3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.010402 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0e934eb63145808ac05234a33f42be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.026652 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a95be5cafa74e7a87fd39cd86fa150e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.026822 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8aa7454b2547e58a52c7c007027aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.027017 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62eeb75b322e45a5bdbd63dbd4c6e582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.027220 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efc66011a0c42b4a55d2f97d7cb6813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.028995 11753 tablet_bootstrap.cc:654] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.034365 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9339ab8dcb4ecca41fef9e9552009e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.036540 11755 tablet_bootstrap.cc:654] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.037225 11753 tablet_bootstrap.cc:492] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:02.037384 11753 ts_tablet_manager.cc:1403] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260925 01:50:02.037380 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5c9dac783d4ef3a24cb65275ff484f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.046177 12754 raft_consensus.cc:493] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.048671 11753 raft_consensus.cc:359] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.049083 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea77bdd6680491da6f9aa8e218bdace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.055548 11753 raft_consensus.cc:385] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.055876 11753 raft_consensus.cc:740] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.056927 11753 consensus_queue.cc:260] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.065724 11753 ts_tablet_manager.cc:1434] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.028s user 0.001s sys 0.002s
I20260925 01:50:02.065997 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 242) took 10251 ms. Trace:
I20260925 01:50:02.066138 11953 rpcz_store.cc:276] 0925 01:49:51.814444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.817529 (+ 3085us) service_pool.cc:224] Handling call
0925 01:50:02.065832 (+10248303us) ts_tablet_manager.cc:1151] Deleting tablet 4f19bccf3c5540cb828ec7bfc89a1c17
0925 01:50:02.065843 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.065969 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10240705}
I20260925 01:50:02.066740 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 243) took 10238 ms. Trace:
I20260925 01:50:02.066838 11953 rpcz_store.cc:276] 0925 01:49:51.828352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.828415 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:02.066630 (+10238215us) ts_tablet_manager.cc:1151] Deleting tablet 35b123ac1e894239875404438ed19927
0925 01:50:02.066638 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.066721 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10237823}
I20260925 01:50:02.067531 11753 tablet_bootstrap.cc:492] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:02.068150 11953 tablet_replica.cc:333] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:02.068446 11953 raft_consensus.cc:2243] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.068639 11953 raft_consensus.cc:2272] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:02.069345 11953 ts_tablet_manager.cc:1916] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:02.070945 12865 tablet.cc:1751] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:02.073777 11753 tablet_bootstrap.cc:654] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.075103 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19c718c83cfe49b9a745e06314e24409" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:02.075205 11314 leader_election.cc:343] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 67921f86c4f6422e97d7f306262569f8
I20260925 01:50:02.075296 11379 raft_consensus.cc:3060] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.075431 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d859207bbc4aefb26c726dce404c44" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.075600 11376 raft_consensus.cc:2468] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:02.075838 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17352fd6ea4e4ed9a178f1510edf4f6d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.075969 11375 raft_consensus.cc:2468] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:02.075310 11314 leader_election.cc:304] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.076620 12781 raft_consensus.cc:2749] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:02.077265 12781 consensus_queue.cc:1048] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:50:02.078691 11314 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:02.078794 11314 leader_election.cc:304] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.079008 12782 raft_consensus.cc:2749] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.079321 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1b6ea676a1f4d99807029d8401251ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.079631 12508 raft_consensus.cc:493] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.079332 11314 leader_election.cc:304] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.079772 12508 raft_consensus.cc:515] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.080060 12782 raft_consensus.cc:2749] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.080384 12508 leader_election.cc:290] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.080551 12781 raft_consensus.cc:493] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.016448 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_31afeff7b38843a9a874569504c5d9d6" } new_table_name: "default.Table_c81fc5cfc06f4c059ba11507857d478d" modify_external_catalogs: true
I20260925 01:50:02.080665 12781 raft_consensus.cc:515] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.080922 11379 raft_consensus.cc:2468] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:02.081243 12781 leader_election.cc:290] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:02.020319 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f82704d6ddcb4ac9b15dd5ba8fc31477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.081873 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f82704d6ddcb4ac9b15dd5ba8fc31477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.082273 12782 consensus_queue.cc:1048] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:50:02.082297 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 98861.5us
I20260925 01:50:02.083227 11314 leader_election.cc:304] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.051306 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c2fa459a53a54f47be961067736d2d16
I20260925 01:50:02.083469 12781 raft_consensus.cc:2804] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.083529 12781 raft_consensus.cc:493] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.083580 12781 raft_consensus.cc:3060] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:02.086577 11314 leader_election.cc:343] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b98ad0f02eb74eba897040401a164f5c
I20260925 01:50:02.086736 11314 leader_election.cc:304] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.086972 12782 raft_consensus.cc:2749] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.087087 11208 tablet_service.cc:1511] Processing CreateTablet for tablet cf0e934eb63145808ac05234a33f42be (DEFAULT_TABLE table=default.Table_9f053c2667d241f3b0349162a44be758 [id=6fe44bc51fb34145a11319e1aa36b3be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.087584 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0e934eb63145808ac05234a33f42be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.087852 11314 leader_election.cc:304] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.088063 12782 raft_consensus.cc:2804] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.088147 12782 raft_consensus.cc:493] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.088227 12782 raft_consensus.cc:3060] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.091485 12782 raft_consensus.cc:515] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.092309 12782 leader_election.cc:290] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:02.092520 12781 raft_consensus.cc:515] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.093082 12781 leader_election.cc:290] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:02.093942 11314 leader_election.cc:304] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.094587 12705 raft_consensus.cc:2804] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.094717 12705 raft_consensus.cc:493] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.094830 12705 raft_consensus.cc:3060] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.097671 12705 raft_consensus.cc:515] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.098385 12705 leader_election.cc:290] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:02.098565 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet bc99f3613c354d68bfde33e04dc1e9ab with delete_type TABLET_DATA_DELETED (replaced by tablet eb4453c8f82c4c2bbe3d1ddb71045a9b) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.100193 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38603da7b4b14ce5835646c330b1f0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.101945 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba4def6c15a410f87b3bf1f168f80d4 (DEFAULT_TABLE table=default.Table_7948cfa6f9c44365859c26d788fbd1d6 [id=2950c0d26fe542fdadaeef6c46480762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.102528 11493 tablet_service.cc:1511] Processing CreateTablet for tablet cf0e934eb63145808ac05234a33f42be (DEFAULT_TABLE table=default.Table_9f053c2667d241f3b0349162a44be758 [id=6fe44bc51fb34145a11319e1aa36b3be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.103108 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 2efc66011a0c42b4a55d2f97d7cb6813 (DEFAULT_TABLE table=default.Table_e1addda8d0d543b7be2ee34ace5d76c8 [id=61254a933cb34bac8c98a48bc1b54054]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.103611 11499 tablet_service.cc:1511] Processing CreateTablet for tablet fb9339ab8dcb4ecca41fef9e9552009e (DEFAULT_TABLE table=default.Table_635b952a4e8b4c5b9b99fdf275576e31 [id=92528498535f47baa077e127c4c2c03a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.104200 11489 tablet_service.cc:1511] Processing CreateTablet for tablet cb8aa7454b2547e58a52c7c007027aa6 (DEFAULT_TABLE table=default.Table_eb97db398056479f9ae0f2c03b05d706 [id=1972269739b14bcbb935f5e7ef6cd727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.104707 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 2a95be5cafa74e7a87fd39cd86fa150e (DEFAULT_TABLE table=default.Table_7af8acc141c7463baecaf9e462f76558 [id=60ae24a4b03c4d5a912d802a195a38a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.105227 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 (DEFAULT_TABLE table=default.Table_71415b17dd35411f85245718ad9b25fd [id=36954127ea4147bfb13fe12b68e58e3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.105720 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd17f1ecead409ab7b54c2120476a3b (DEFAULT_TABLE table=default.Table_b7368994d6964edf87f8ed676a790ca0 [id=18c432ba97cc44c9962c952f57359887]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.106285 11492 tablet_service.cc:1511] Processing CreateTablet for tablet ae05900043cb49d29f528fcbe4c8ada0 (DEFAULT_TABLE table=default.Table_09785932e2864af7afe4554f30909290 [id=7204958e8ea0484eaeedf9264aef6333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.106776 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5c9dac783d4ef3a24cb65275ff484f (DEFAULT_TABLE table=default.Table_fd035701fcd04644b86876963e515e35 [id=8b19e3cab6fa41d883e4981b42cb4df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.107216 11484 tablet_service.cc:1558] Processing DeleteTablet for tablet 93329036763146beb8e6a9b039cc1ec1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1d2d998d834c21ab83694daae37520) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.051852 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cd78ce13b4ed4fba93ce221304656a7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:02.052628 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3541e17b47bc47f5b69add361877a2bf
I20260925 01:50:02.108793 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a8c2185b6ac4411baea7759cf6be1e25" } new_table_name: "default.Table_ecdd81ee82464f50a9ce22b94a341c9e" modify_external_catalogs: true
I20260925 01:50:02.052739 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ab8d5af739854f939ab585d943e7b7ca
I20260925 01:50:02.057747 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b65cab23b4894abc96c8bb874bf3dde2" } new_table_name: "default.Table_70bd693da6434458bd48271461931659" modify_external_catalogs: true
I20260925 01:50:02.111164 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3b9c5f79b2e444938f2face578ece85a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.065622 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5d23c5d52faa4b6da2996fabb16bd74a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d23c5d52faa4b6da2996fabb16bd74a already in progress: creating tablet
W20260925 01:50:02.111488 11666 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 45903.2us
W20260925 01:50:02.111742 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b9c5f79b2e444938f2face578ece85a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:02.112170 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f19bccf3c5540cb828ec7bfc89a1c17 already in progress: creating tablet
W20260925 01:50:02.112440 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 35b123ac1e894239875404438ed19927 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35b123ac1e894239875404438ed19927 already in progress: creating tablet
W20260925 01:50:02.114338 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd78ce13b4ed4fba93ce221304656a7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.114596 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8d5af739854f939ab585d943e7b7ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.115679 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_eff500a5321c4fc8ae32c0504aa63890"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.116313 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eff500a5321c4fc8ae32c0504aa63890 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.087102 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea77bdd6680491da6f9aa8e218bdace (DEFAULT_TABLE table=default.Table_c98e3154b1c4405abb6aa97166f8c330 [id=9686238713534c25a2a80856b84e9085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.117952 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 784de8c6e6e1434a91106dd19cd9262a with delete_type TABLET_DATA_DELETED (replaced by tablet 35b123ac1e894239875404438ed19927) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.118400 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 45a794ad0d87475a88efc02f5ae080f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.118614 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet ba378e9d37c64a8ebd56894b2101ed8f with delete_type TABLET_DATA_DELETED (replaced by tablet 21ee9163747b462f86105be553a57b2f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.119237 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea77bdd6680491da6f9aa8e218bdace (DEFAULT_TABLE table=default.Table_c98e3154b1c4405abb6aa97166f8c330 [id=9686238713534c25a2a80856b84e9085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.119666 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 (DEFAULT_TABLE table=default.Table_12bac6f78c7944d9bb5310a1c312abe3 [id=20b4a065ef3e4ea99d706de0ea431d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.120122 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c716eb26d04a33b4c3b3c56a7fbac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.120718 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 3541e17b47bc47f5b69add361877a2bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.127733 11946 ts_tablet_manager.cc:1929] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:02.140046 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet c2fa459a53a54f47be961067736d2d16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.141122 11755 tablet_bootstrap.cc:492] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:02.141286 11755 ts_tablet_manager.cc:1403] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.128s user 0.002s sys 0.007s
I20260925 01:50:02.142096 11755 raft_consensus.cc:359] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.142311 11755 raft_consensus.cc:385] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.142405 11755 raft_consensus.cc:740] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.142671 11755 consensus_queue.cc:260] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.143276 11755 ts_tablet_manager.cc:1434] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:02.151726 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e2b9df8d98e5414186ef23b8b7f9cb61 (table default.Table_a33362d5d6de41e985d86740d8af966c [id=351fd2bbafea4565a9cc4537f7f0c1aa]) successfully deleted
I20260925 01:50:02.152070 11946 log.cc:1199] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/596f8ddbcd16458aa4f287f4f11282a1
I20260925 01:50:02.152611 11946 ts_tablet_manager.cc:1950] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:02.133282 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 54073us
I20260925 01:50:02.141481 12770 raft_consensus.cc:493] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.152951 12770 raft_consensus.cc:515] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.153023 11457 leader_election.cc:304] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:02.153200 11457 raft_consensus.cc:2686] T e2b9df8d98e5414186ef23b8b7f9cb61 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:02.153581 12770 leader_election.cc:290] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.157737 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 854549ed223142429513c1d80c026793 (DEFAULT_TABLE table=default.Table_e92a27627ba1487594f1190c011575b6 [id=7bdcc0d3d1f248ddae0c41cac57949ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.158210 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854549ed223142429513c1d80c026793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.159796 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet 96b68399843a422b8da3ddfab2c522e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.160010 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 3541e17b47bc47f5b69add361877a2bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.160145 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8d5af739854f939ab585d943e7b7ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.160274 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet c2fa459a53a54f47be961067736d2d16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.162744 11953 ts_tablet_manager.cc:1929] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:02.163635 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 (DEFAULT_TABLE table=default.Table_12bac6f78c7944d9bb5310a1c312abe3 [id=20b4a065ef3e4ea99d706de0ea431d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.164342 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 854549ed223142429513c1d80c026793 (DEFAULT_TABLE table=default.Table_e92a27627ba1487594f1190c011575b6 [id=7bdcc0d3d1f248ddae0c41cac57949ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.165252 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba4def6c15a410f87b3bf1f168f80d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.167207 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet ba378e9d37c64a8ebd56894b2101ed8f with delete_type TABLET_DATA_DELETED (replaced by tablet 21ee9163747b462f86105be553a57b2f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.167594 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea77bdd6680491da6f9aa8e218bdace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.167668 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 43298d3575c34e6090b8f0767ec6918e (DEFAULT_TABLE table=default.Table_d7b95bb1d61b4d5cac9713b3ee125e24 [id=d314ea449ea5484ab9d7b6819625496f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.167979 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 2efc66011a0c42b4a55d2f97d7cb6813 (DEFAULT_TABLE table=default.Table_e1addda8d0d543b7be2ee34ace5d76c8 [id=61254a933cb34bac8c98a48bc1b54054]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.168324 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efc66011a0c42b4a55d2f97d7cb6813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.168741 11217 tablet_service.cc:1511] Processing CreateTablet for tablet fb9339ab8dcb4ecca41fef9e9552009e (DEFAULT_TABLE table=default.Table_635b952a4e8b4c5b9b99fdf275576e31 [id=92528498535f47baa077e127c4c2c03a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.169041 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9339ab8dcb4ecca41fef9e9552009e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.169394 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 75a8e09b8838443c9bfff440ff1f877d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.170883 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43298d3575c34e6090b8f0767ec6918e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.171131 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd17f1ecead409ab7b54c2120476a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.171340 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62eeb75b322e45a5bdbd63dbd4c6e582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.172225 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a95be5cafa74e7a87fd39cd86fa150e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.172462 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2efc66011a0c42b4a55d2f97d7cb6813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.172503 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 520) took 1771 ms. Trace:
I20260925 01:50:02.172569 11946 rpcz_store.cc:276] 0925 01:50:00.400714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.410238 (+ 9524us) service_pool.cc:224] Handling call
0925 01:50:01.905511 (+1495273us) ts_tablet_manager.cc:1151] Deleting tablet 596f8ddbcd16458aa4f287f4f11282a1
0925 01:50:01.905520 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.124011 (+218491us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.127678 (+ 3667us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.172484 (+ 44806us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19279,"tablet-delete.queue_time_us":1495008}
I20260925 01:50:02.172992 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fcb56153a802427aaebbf55a8193d62b
I20260925 01:50:02.173087 11946 tablet_replica.cc:333] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:02.173262 11946 raft_consensus.cc:2243] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.173810 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5c9dac783d4ef3a24cb65275ff484f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.173920 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 596f8ddbcd16458aa4f287f4f11282a1 (table default.Table_196b02edd23b4384aef87a7819365849 [id=2a64ecd7c8aa4c058cf50c57d0373c3c]) successfully deleted
I20260925 01:50:02.174220 11953 log.cc:1199] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/f1b6ea676a1f4d99807029d8401251ef
I20260925 01:50:02.174557 11953 ts_tablet_manager.cc:1950] T f1b6ea676a1f4d99807029d8401251ef P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:02.175313 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8aa7454b2547e58a52c7c007027aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.175343 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 244) took 10341 ms. Trace:
I20260925 01:50:02.175482 11500 tablet_service.cc:1558] Processing DeleteTablet for tablet fcb56153a802427aaebbf55a8193d62b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.175433 11953 rpcz_store.cc:276] 0925 01:49:51.833437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.833507 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:02.068088 (+10234581us) ts_tablet_manager.cc:1151] Deleting tablet f1b6ea676a1f4d99807029d8401251ef
0925 01:50:02.068101 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.073355 (+ 5254us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.162680 (+ 89325us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.175320 (+ 12640us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10231621}
I20260925 01:50:02.175825 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae05900043cb49d29f528fcbe4c8ada0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.176682 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:02.177841 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9339ab8dcb4ecca41fef9e9552009e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.178838 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf0e934eb63145808ac05234a33f42be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.181689 11946 raft_consensus.cc:2272] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:02.182559 11946 ts_tablet_manager.cc:1916] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:02.184875 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet f1b6ea676a1f4d99807029d8401251ef (table default.Table_95ebdd9395354eba91e3babd76028061 [id=dba58bdd410a4b8986cf7e359a563628]) successfully deleted
I20260925 01:50:02.187153 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea77bdd6680491da6f9aa8e218bdace. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.187862 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854549ed223142429513c1d80c026793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.189181 11457 leader_election.cc:304] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:02.189393 11457 raft_consensus.cc:2686] T 596f8ddbcd16458aa4f287f4f11282a1 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:02.189702 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c716eb26d04a33b4c3b3c56a7fbac6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:02.191735 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7da55c488da540048a94324fa347c1ef consensus state has no leader
I20260925 01:50:02.191745 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a8c46e780d4a4987ad52619e4c3b46c9
I20260925 01:50:02.193164 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet 501f41a3ee1d440bb07033e29c38bc7a from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:02.194769 11953 tablet_replica.cc:333] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:02.195005 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c46e780d4a4987ad52619e4c3b46c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.195070 11953 raft_consensus.cc:2243] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.196921 11953 raft_consensus.cc:2272] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:02.197768 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88d8616fc7e243a885c318ce8e631c56 consensus state has no leader
I20260925 01:50:02.198282 11457 leader_election.cc:304] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.198541 12770 raft_consensus.cc:2749] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.198580 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet b91957f62d8044ea8f6a3464c84b9e10 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:02.198712 11457 leader_election.cc:304] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.198938 12770 raft_consensus.cc:2804] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:50:02.199046 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 38249392c0df4d50b0e09f3671f92800 consensus state has no leader
I20260925 01:50:02.199054 12770 raft_consensus.cc:697] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:02.201135 11953 ts_tablet_manager.cc:1916] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:02.208192 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 17352fd6ea4e4ed9a178f1510edf4f6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.216077 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c46e780d4a4987ad52619e4c3b46c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.221724 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet fcb56153a802427aaebbf55a8193d62b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.165730 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 43298d3575c34e6090b8f0767ec6918e (DEFAULT_TABLE table=default.Table_d7b95bb1d61b4d5cac9713b3ee125e24 [id=d314ea449ea5484ab9d7b6819625496f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.223443 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43298d3575c34e6090b8f0767ec6918e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.212218 12770 consensus_queue.cc:237] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.225622 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c8f00a8634ef89e4773b62e095b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.225761 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc with delete_type TABLET_DATA_DELETED (replaced by tablet b8f82aa815bd42bdbf70a673e3a4c9da) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.225648 12754 raft_consensus.cc:515] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.167042 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 6ba4def6c15a410f87b3bf1f168f80d4 (DEFAULT_TABLE table=default.Table_7948cfa6f9c44365859c26d788fbd1d6 [id=2950c0d26fe542fdadaeef6c46480762]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.230639 12508 consensus_queue.cc:1048] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:02.230885 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd17f1ecead409ab7b54c2120476a3b (DEFAULT_TABLE table=default.Table_b7368994d6964edf87f8ed676a790ca0 [id=18c432ba97cc44c9962c952f57359887]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:02.231112 11457 leader_election.cc:343] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.231259 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd17f1ecead409ab7b54c2120476a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.231954 11216 tablet_service.cc:1511] Processing CreateTablet for tablet cb8aa7454b2547e58a52c7c007027aa6 (DEFAULT_TABLE table=default.Table_eb97db398056479f9ae0f2c03b05d706 [id=1972269739b14bcbb935f5e7ef6cd727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.232290 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8aa7454b2547e58a52c7c007027aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.237486 11753 tablet_bootstrap.cc:492] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:02.238250 11753 ts_tablet_manager.cc:1403] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.171s user 0.004s sys 0.008s
I20260925 01:50:02.239383 11753 raft_consensus.cc:359] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.240499 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c5adad03a1164397a2ba06ba460c508c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:02.240805 11753 raft_consensus.cc:385] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.240877 11753 raft_consensus.cc:740] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.241067 11753 consensus_queue.cc:260] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:02.241273 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5adad03a1164397a2ba06ba460c508c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.243634 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_362394b39f5c425499be7b3dc671fbba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.244293 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_362394b39f5c425499be7b3dc671fbba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.245785 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_92b2426cff01456aa879fd65bc0e112e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:02.231230 11457 leader_election.cc:304] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:02.247057 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92b2426cff01456aa879fd65bc0e112e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.248678 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a622c5514c214051a6dbe0ae8749ef6a" } new_table_name: "default.Table_19c88af560ee4b8ea34d884da9fb699c" modify_external_catalogs: true
I20260925 01:50:02.250339 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ebffdaf09f574cc4ace973f9ab55d5c3" } new_table_name: "default.Table_6ac7e753a9644f0d9c0d5da907041ea8" modify_external_catalogs: true
I20260925 01:50:02.251197 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_36fc5acd12564526acfddbbc5b059d38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.251788 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36fc5acd12564526acfddbbc5b059d38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.252115 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_301e577f16d742e8b3d2728f29ac4e47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.252653 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_301e577f16d742e8b3d2728f29ac4e47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.259166 12850 raft_consensus.cc:2749] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:02.259119 11314 leader_election.cc:343] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 784de8c6e6e1434a91106dd19cd9262a
W20260925 01:50:02.259371 11314 leader_election.cc:343] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 3e3a033c9e7545479130c7a3c48ac254
I20260925 01:50:02.260017 11457 leader_election.cc:304] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.260411 12850 raft_consensus.cc:2804] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:02.260529 12850 raft_consensus.cc:697] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:02.260787 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 (DEFAULT_TABLE table=default.Table_71415b17dd35411f85245718ad9b25fd [id=36954127ea4147bfb13fe12b68e58e3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.261175 11457 leader_election.cc:304] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.261255 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62eeb75b322e45a5bdbd63dbd4c6e582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.261499 12508 raft_consensus.cc:2804] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.261576 12508 raft_consensus.cc:493] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.261638 12508 raft_consensus.cc:3060] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.262091 11457 leader_election.cc:304] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.262252 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 2a95be5cafa74e7a87fd39cd86fa150e (DEFAULT_TABLE table=default.Table_7af8acc141c7463baecaf9e462f76558 [id=60ae24a4b03c4d5a912d802a195a38a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.262398 12640 raft_consensus.cc:2804] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.262465 12640 raft_consensus.cc:493] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.262527 12640 raft_consensus.cc:3060] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.262681 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a95be5cafa74e7a87fd39cd86fa150e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.263164 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 93329036763146beb8e6a9b039cc1ec1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1d2d998d834c21ab83694daae37520) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.263783 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ba4def6c15a410f87b3bf1f168f80d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.265007 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5c9dac783d4ef3a24cb65275ff484f (DEFAULT_TABLE table=default.Table_fd035701fcd04644b86876963e515e35 [id=8b19e3cab6fa41d883e4981b42cb4df8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.265326 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet c2fa459a53a54f47be961067736d2d16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:02.266741 12828 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260925 01:50:02.267210 12828 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260925 01:50:02.267328 12828 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260925 01:50:02.269198 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5c9dac783d4ef3a24cb65275ff484f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.269285 11360 tablet_service.cc:1511] Processing CreateTablet for tablet fbfec7d9a3b44fe4b8eb6f1fbbe292df (DEFAULT_TABLE table=default.Table_9bf94decad1c489da81b701f88fe1b44 [id=ffa8c6252d07475c91003f054df058dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.269680 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfec7d9a3b44fe4b8eb6f1fbbe292df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.270347 11205 tablet_service.cc:1511] Processing CreateTablet for tablet ae05900043cb49d29f528fcbe4c8ada0 (DEFAULT_TABLE table=default.Table_09785932e2864af7afe4554f30909290 [id=7204958e8ea0484eaeedf9264aef6333]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.270803 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae05900043cb49d29f528fcbe4c8ada0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:02.273916 11457 leader_election.cc:343] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:02.278228 11501 tablet_service.cc:1511] Processing CreateTablet for tablet fbfec7d9a3b44fe4b8eb6f1fbbe292df (DEFAULT_TABLE table=default.Table_9bf94decad1c489da81b701f88fe1b44 [id=ffa8c6252d07475c91003f054df058dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:02.281709 12828 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260925 01:50:02.281826 12828 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260925 01:50:02.281927 12828 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260925 01:50:02.282017 12828 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260925 01:50:02.282513 12754 leader_election.cc:290] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.284142 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c8f00a8634ef89e4773b62e095b74" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.284998 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 3541e17b47bc47f5b69add361877a2bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.285202 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8d5af739854f939ab585d943e7b7ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.285581 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 (DEFAULT_TABLE table=default.Table_12bac6f78c7944d9bb5310a1c312abe3 [id=20b4a065ef3e4ea99d706de0ea431d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.285950 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c716eb26d04a33b4c3b3c56a7fbac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.286789 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 43298d3575c34e6090b8f0767ec6918e (DEFAULT_TABLE table=default.Table_d7b95bb1d61b4d5cac9713b3ee125e24 [id=d314ea449ea5484ab9d7b6819625496f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.287122 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43298d3575c34e6090b8f0767ec6918e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.287883 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8041861b60a24a3c974d0e20742fc1ac" } modify_external_catalogs: true
I20260925 01:50:02.288071 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8041861b60a24a3c974d0e20742fc1ac" } modify_external_catalogs: true
W20260925 01:50:02.288416 11177 leader_election.cc:343] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.288617 11457 leader_election.cc:304] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.289096 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfec7d9a3b44fe4b8eb6f1fbbe292df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.289167 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a794ad0d87475a88efc02f5ae080f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:02.289502 11238 raft_consensus.cc:2468] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:02.289471 11353 tablet_service.cc:1511] Processing CreateTablet for tablet eb4453c8f82c4c2bbe3d1ddb71045a9b (DEFAULT_TABLE table=default.Table_b29d5c3e7011407a920707f27614b3de [id=4fbd33ce9dc14df583082451e1532b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.289549 11492 tablet_service.cc:1511] Processing CreateTablet for tablet eb4453c8f82c4c2bbe3d1ddb71045a9b (DEFAULT_TABLE table=default.Table_b29d5c3e7011407a920707f27614b3de [id=4fbd33ce9dc14df583082451e1532b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.289842 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4453c8f82c4c2bbe3d1ddb71045a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.291633 12754 raft_consensus.cc:493] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.291764 12754 raft_consensus.cc:515] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:02.292502 11456 leader_election.cc:343] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 90647937eb364a7a973d04ea69cbc9aa
I20260925 01:50:02.292837 11456 leader_election.cc:304] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:02.291816 12850 consensus_queue.cc:237] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.300321 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 018f68f800c9489a846c3b1b3ee3fa2d (DEFAULT_TABLE table=default.Table_8176372e797c4778a5761c5da6336218 [id=92e70eb5ced344888a20872f4aef6373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.300714 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018f68f800c9489a846c3b1b3ee3fa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.301491 12754 leader_election.cc:290] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.302397 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c9e0b0af4ab2a18c5a0080e22ffc" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.302565 12828 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.159.212:39403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.10.159.254:40913,127.10.159.253:42889,127.10.159.252:44823
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.159.253:42889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.159.253
--webserver_port=34593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 45d7eec4e3c43096ed05a5ede267d0cc91d7a32c
build type FASTDEBUG
built by None at 25 Sep 2026 01:43:22 UTC on bdcb31816ec0
build id 13985
ASAN enabled
W20260925 01:50:02.303092 11177 leader_election.cc:343] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.304898 12828 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 01:50:02.305120 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4453c8f82c4c2bbe3d1ddb71045a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.305527 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c46e780d4a4987ad52619e4c3b46c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.305979 11213 tablet_service.cc:1511] Processing CreateTablet for tablet eb4453c8f82c4c2bbe3d1ddb71045a9b (DEFAULT_TABLE table=default.Table_b29d5c3e7011407a920707f27614b3de [id=4fbd33ce9dc14df583082451e1532b7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.306468 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb4453c8f82c4c2bbe3d1ddb71045a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.307468 12828 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260925 01:50:02.309295 11753 ts_tablet_manager.cc:1434] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.071s user 0.001s sys 0.001s
I20260925 01:50:02.310169 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet fcb56153a802427aaebbf55a8193d62b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.310604 11204 tablet_service.cc:1511] Processing CreateTablet for tablet fbfec7d9a3b44fe4b8eb6f1fbbe292df (DEFAULT_TABLE table=default.Table_9bf94decad1c489da81b701f88fe1b44 [id=ffa8c6252d07475c91003f054df058dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.310993 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbfec7d9a3b44fe4b8eb6f1fbbe292df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.311262 11753 tablet_bootstrap.cc:492] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:02.314743 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c8f00a8634ef89e4773b62e095b74" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:02.314996 11522 raft_consensus.cc:2468] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:02.316161 11349 tablet_service.cc:1511] Processing CreateTablet for tablet a3ea82e4cc98406baafd95867fddc689 (DEFAULT_TABLE table=default.Table_920b4b17a516441f8cb76a72f44453b8 [id=9fbfc8b3de5b4d399ce8ca4480f4ff70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.316588 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ea82e4cc98406baafd95867fddc689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.316572 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c9e0b0af4ab2a18c5a0080e22ffc" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:02.326812 11946 ts_tablet_manager.cc:1929] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:02.327054 11946 log.cc:1199] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/19c718c83cfe49b9a745e06314e24409
I20260925 01:50:02.327491 11946 ts_tablet_manager.cc:1950] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:02.328054 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 521) took 1927 ms. Trace:
I20260925 01:50:02.328222 11946 rpcz_store.cc:276] 0925 01:50:00.401058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.410710 (+ 9652us) service_pool.cc:224] Handling call
0925 01:50:02.173043 (+1762333us) ts_tablet_manager.cc:1151] Deleting tablet 19c718c83cfe49b9a745e06314e24409
0925 01:50:02.173053 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.188016 (+ 14963us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.326756 (+138740us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.328031 (+ 1275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8239,"tablet-delete.queue_time_us":1762135}
I20260925 01:50:02.328845 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 528) took 1714 ms. Trace:
I20260925 01:50:02.329005 11946 rpcz_store.cc:276] 0925 01:50:00.614584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.614639 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:02.328712 (+1714073us) ts_tablet_manager.cc:1151] Deleting tablet 5695f3af46974cb6a662f8788f9543e0
0925 01:50:02.328723 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.328828 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1713884}
I20260925 01:50:02.329430 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 529) took 1710 ms. Trace:
I20260925 01:50:02.329558 11946 rpcz_store.cc:276] 0925 01:50:00.619262 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.619315 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:02.329322 (+1710007us) ts_tablet_manager.cc:1151] Deleting tablet 47b62644673447239feb0f8f851012ef
0925 01:50:02.329331 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.329414 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1709801}
I20260925 01:50:02.330014 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 527) took 1715 ms. Trace:
I20260925 01:50:02.330176 11946 rpcz_store.cc:276] 0925 01:50:00.614447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.624357 (+ 9910us) service_pool.cc:224] Handling call
0925 01:50:02.329849 (+1705492us) ts_tablet_manager.cc:1151] Deleting tablet 3702f09e45a14c80af716d642d30cdfa
0925 01:50:02.329857 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.329997 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1704116}
I20260925 01:50:02.330420 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 018f68f800c9489a846c3b1b3ee3fa2d (DEFAULT_TABLE table=default.Table_8176372e797c4778a5761c5da6336218 [id=92e70eb5ced344888a20872f4aef6373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.330900 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018f68f800c9489a846c3b1b3ee3fa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.332621 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 530) took 1693 ms. Trace:
I20260925 01:50:02.332702 11946 rpcz_store.cc:276] 0925 01:50:00.639446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.653728 (+ 14282us) service_pool.cc:224] Handling call
0925 01:50:02.332491 (+1678763us) ts_tablet_manager.cc:1151] Deleting tablet 774d14d5c7884f4e96662779b3100056
0925 01:50:02.332506 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.332602 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1676495}
I20260925 01:50:02.332999 11946 tablet_replica.cc:333] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:02.333182 11946 raft_consensus.cc:2243] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:02.333458 11946 pending_rounds.cc:70] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:02.334532 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 854549ed223142429513c1d80c026793 (DEFAULT_TABLE table=default.Table_e92a27627ba1487594f1190c011575b6 [id=7bdcc0d3d1f248ddae0c41cac57949ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.323787 11176 leader_election.cc:304] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:02.335918 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 2957cbd4669749b381f59d1e301a692d (DEFAULT_TABLE table=default.Table_1a5fa8d4c6294c46a36a515b0e0505df [id=2ed7178900554feb9c22335c805de280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.336607 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2957cbd4669749b381f59d1e301a692d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.337469 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854549ed223142429513c1d80c026793. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:02.344312 11176 leader_election.cc:343] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.344666 11176 leader_election.cc:304] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:02.345196 12754 raft_consensus.cc:2804] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.345287 12754 raft_consensus.cc:493] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.347478 11754 tablet_bootstrap.cc:492] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:02.347666 11754 ts_tablet_manager.cc:1403] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.415s user 0.006s sys 0.006s
I20260925 01:50:02.345381 12754 raft_consensus.cc:3060] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.349213 11360 tablet_service.cc:1511] Processing CreateTablet for tablet e0d31d53cb3f42a2b2df3e998623264c (DEFAULT_TABLE table=default.Table_1176be62cef345efa7604f2003a7fe7e [id=469de0828b4e49e48ad519081dc0e6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.349654 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d31d53cb3f42a2b2df3e998623264c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.350586 11754 raft_consensus.cc:359] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.350760 11754 raft_consensus.cc:385] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.350805 11754 raft_consensus.cc:740] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.351013 11754 consensus_queue.cc:260] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.355406 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 4480d3b5671a4f2aaf98941cc8d58433 (DEFAULT_TABLE table=default.Table_5f4b4ce122da40e4b0960e58bf811412 [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.355765 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4480d3b5671a4f2aaf98941cc8d58433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.365610 12754 raft_consensus.cc:515] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.379388 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 782f9c69e9824ca4971f0c2b15dec5c3 (DEFAULT_TABLE table=default.Table_b7432598d6f1496e8093cd785184a09b [id=76b078ec27ea47fd8c212392f27804af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.380944 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782f9c69e9824ca4971f0c2b15dec5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.385251 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb01b25e8864eae84ae483612b9e18b (DEFAULT_TABLE table=default.Table_e5d15c656fd848df95d75a664d3e7f32 [id=532182ac67d647a499fb0dc47ade0592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.385665 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb01b25e8864eae84ae483612b9e18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.396759 12782 raft_consensus.cc:493] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.396967 12782 raft_consensus.cc:515] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.397739 12782 leader_election.cc:290] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:02.400804 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 835e96fe1cfc41c6b8e5edfac07d28fd (DEFAULT_TABLE table=default.Table_c8efaeef1cd64670bcbf63eb0b401737 [id=28b03d6be66646398dfa0eb8c1b7f407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.401270 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835e96fe1cfc41c6b8e5edfac07d28fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.412333 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 043ec86a5af048ab81f1450856d5a85f (DEFAULT_TABLE table=default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.412890 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043ec86a5af048ab81f1450856d5a85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.416944 12878 raft_consensus.cc:2749] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.417609 12878 raft_consensus.cc:2804] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.417771 12878 raft_consensus.cc:493] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.417960 12878 raft_consensus.cc:3060] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.419392 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 7131531641464bba9ada4b5655dd0e47 (DEFAULT_TABLE table=default.Table_32a32bf92a704259be81d568b38294a6 [id=b25c0d556bb74cce9810b3c81ccb4faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.420007 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7131531641464bba9ada4b5655dd0e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.420888 12878 raft_consensus.cc:515] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.421670 12878 leader_election.cc:290] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.428099 12508 raft_consensus.cc:515] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.428841 12508 leader_election.cc:290] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.430152 12640 raft_consensus.cc:515] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.375168 11208 tablet_service.cc:1511] Processing CreateTablet for tablet a3ea82e4cc98406baafd95867fddc689 (DEFAULT_TABLE table=default.Table_920b4b17a516441f8cb76a72f44453b8 [id=9fbfc8b3de5b4d399ce8ca4480f4ff70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.430640 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ea82e4cc98406baafd95867fddc689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.430742 12640 leader_election.cc:290] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.413779 11212 tablet_service.cc:1511] Processing CreateTablet for tablet e0d31d53cb3f42a2b2df3e998623264c (DEFAULT_TABLE table=default.Table_1176be62cef345efa7604f2003a7fe7e [id=469de0828b4e49e48ad519081dc0e6c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.419211 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 4480d3b5671a4f2aaf98941cc8d58433 (DEFAULT_TABLE table=default.Table_5f4b4ce122da40e4b0960e58bf811412 [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.424764 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 782f9c69e9824ca4971f0c2b15dec5c3 (DEFAULT_TABLE table=default.Table_b7432598d6f1496e8093cd785184a09b [id=76b078ec27ea47fd8c212392f27804af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.434628 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb01b25e8864eae84ae483612b9e18b (DEFAULT_TABLE table=default.Table_e5d15c656fd848df95d75a664d3e7f32 [id=532182ac67d647a499fb0dc47ade0592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.443370 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782f9c69e9824ca4971f0c2b15dec5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.444554 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4480d3b5671a4f2aaf98941cc8d58433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.447199 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d31d53cb3f42a2b2df3e998623264c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.450971 12754 leader_election.cc:290] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.451066 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c8f00a8634ef89e4773b62e095b74" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.451220 12754 raft_consensus.cc:2749] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:02.451627 11177 leader_election.cc:343] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.457062 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 835e96fe1cfc41c6b8e5edfac07d28fd (DEFAULT_TABLE table=default.Table_c8efaeef1cd64670bcbf63eb0b401737 [id=28b03d6be66646398dfa0eb8c1b7f407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.457234 11753 tablet_bootstrap.cc:654] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.471465 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 043ec86a5af048ab81f1450856d5a85f (DEFAULT_TABLE table=default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.472152 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043ec86a5af048ab81f1450856d5a85f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:02.473994 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 181156us
I20260925 01:50:02.482931 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 19c718c83cfe49b9a745e06314e24409 (table default.Table_3134677312f34800bda02393eeaacbc1 [id=a1465ccb37624e9aa2abb95f1bbd1abd]) successfully deleted
I20260925 01:50:02.333509 11946 pending_rounds.cc:77] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072898301923328 op_type: NO_OP noop_request { }
I20260925 01:50:02.483420 11946 raft_consensus.cc:2889] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:02.483786 11946 raft_consensus.cc:2272] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:02.484325 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5695f3af46974cb6a662f8788f9543e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5695f3af46974cb6a662f8788f9543e0 already in progress: creating tablet
I20260925 01:50:02.485545 11946 ts_tablet_manager.cc:1916] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:02.486188 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 47b62644673447239feb0f8f851012ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b62644673447239feb0f8f851012ef already in progress: creating tablet
I20260925 01:50:02.486864 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835e96fe1cfc41c6b8e5edfac07d28fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:02.486901 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3702f09e45a14c80af716d642d30cdfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3702f09e45a14c80af716d642d30cdfa already in progress: creating tablet
I20260925 01:50:02.487450 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb01b25e8864eae84ae483612b9e18b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:02.487437 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 774d14d5c7884f4e96662779b3100056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 774d14d5c7884f4e96662779b3100056 already in progress: creating tablet
W20260925 01:50:02.482041 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 208123us
I20260925 01:50:02.494470 11457 leader_election.cc:304] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:02.494738 11457 raft_consensus.cc:2686] T 19c718c83cfe49b9a745e06314e24409 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:02.496634 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3a033c9e7545479130c7a3c48ac254" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:02.496836 11519 raft_consensus.cc:2468] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:02.498126 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784de8c6e6e1434a91106dd19cd9262a" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:02.498308 11521 raft_consensus.cc:3060] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.501076 11521 raft_consensus.cc:2468] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:02.501356 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a794ad0d87475a88efc02f5ae080f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:02.501579 11241 raft_consensus.cc:3060] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.510324 12640 raft_consensus.cc:493] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.510526 12640 raft_consensus.cc:515] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.511212 12640 leader_election.cc:290] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.512261 11501 tablet_service.cc:1511] Processing CreateTablet for tablet a3ea82e4cc98406baafd95867fddc689 (DEFAULT_TABLE table=default.Table_920b4b17a516441f8cb76a72f44453b8 [id=9fbfc8b3de5b4d399ce8ca4480f4ff70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.513032 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ea82e4cc98406baafd95867fddc689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.518579 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 018f68f800c9489a846c3b1b3ee3fa2d (DEFAULT_TABLE table=default.Table_8176372e797c4778a5761c5da6336218 [id=92e70eb5ced344888a20872f4aef6373]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.519105 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018f68f800c9489a846c3b1b3ee3fa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.524262 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 2957cbd4669749b381f59d1e301a692d (DEFAULT_TABLE table=default.Table_1a5fa8d4c6294c46a36a515b0e0505df [id=2ed7178900554feb9c22335c805de280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.525731 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 2957cbd4669749b381f59d1e301a692d (DEFAULT_TABLE table=default.Table_1a5fa8d4c6294c46a36a515b0e0505df [id=2ed7178900554feb9c22335c805de280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.526160 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2957cbd4669749b381f59d1e301a692d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.534739 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d859207bbc4aefb26c726dce404c44" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:02.534987 11517 raft_consensus.cc:2393] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:50:02.535275 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fd114e03807f4a78964e4057de720bfa" } modify_external_catalogs: true
I20260925 01:50:02.535583 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fd114e03807f4a78964e4057de720bfa" } modify_external_catalogs: true
I20260925 01:50:02.535609 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17352fd6ea4e4ed9a178f1510edf4f6d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:02.535836 11517 raft_consensus.cc:2393] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:50:02.537314 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4795a346170948d996e3f9d6abec0c9d" } modify_external_catalogs: true
W20260925 01:50:02.537556 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f92450c05b394603ba475328d5a3eb71 consensus state has no leader
I20260925 01:50:02.537653 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4795a346170948d996e3f9d6abec0c9d" } modify_external_catalogs: true
I20260925 01:50:02.538671 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5867f948c3824f95a39d7ccbc8b319d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.539378 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67d5d8ea522d4682a0eb4b3a51786f16 consensus state has no leader
W20260925 01:50:02.539434 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5867f948c3824f95a39d7ccbc8b319d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.539772 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dd2fbf6d10f744cd86b10091a53b0372" } modify_external_catalogs: true
I20260925 01:50:02.540009 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_dd2fbf6d10f744cd86b10091a53b0372" } modify_external_catalogs: true
I20260925 01:50:02.542855 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9ba286d06c5641748f432f59537f524e" } new_table_name: "default.Table_13f9ff413156494095a4ccdbc2d2b0e2" modify_external_catalogs: true
I20260925 01:50:02.544785 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cee543ab798e45a8b000515354a8ce3a" } modify_external_catalogs: true
I20260925 01:50:02.545008 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cee543ab798e45a8b000515354a8ce3a" } modify_external_catalogs: true
I20260925 01:50:02.546414 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 4480d3b5671a4f2aaf98941cc8d58433 (DEFAULT_TABLE table=default.Table_5f4b4ce122da40e4b0960e58bf811412 [id=ffb823f8ca1948faaf21d345a1643605]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.546809 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4480d3b5671a4f2aaf98941cc8d58433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.547142 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ab9614a352484be4a8f5e42dcf422828"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.547780 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab9614a352484be4a8f5e42dcf422828 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.554713 12781 raft_consensus.cc:493] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:02.554874 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 501f41a3ee1d440bb07033e29c38bc7a
I20260925 01:50:02.554867 12781 raft_consensus.cc:515] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:02.555126 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 782f9c69e9824ca4971f0c2b15dec5c3 (DEFAULT_TABLE table=default.Table_b7432598d6f1496e8093cd785184a09b [id=76b078ec27ea47fd8c212392f27804af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.555500 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782f9c69e9824ca4971f0c2b15dec5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.555523 11672 catalog_manager.cc:6934] ReplaceTablet: tablet 501f41a3ee1d440bb07033e29c38bc7a deleted and replaced by tablet 7e7d26af44f948948e0d4e6ac9e072c0
I20260925 01:50:02.555572 12781 leader_election.cc:290] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:02.556051 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5075112388444f988f39f42818fc8c36" } new_table_name: "default.Table_edc5e2ecf3d240d7a989ed4b671a85e7" modify_external_catalogs: true
I20260925 01:50:02.558581 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 501f41a3ee1d440bb07033e29c38bc7a with delete_type TABLET_DATA_DELETED (replaced by tablet 7e7d26af44f948948e0d4e6ac9e072c0) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.565572 11488 tablet_service.cc:1511] Processing CreateTablet for tablet e0d31d53cb3f42a2b2df3e998623264c (DEFAULT_TABLE table=default.Table_1176be62cef345efa7604f2003a7fe7e [id=469de0828b4e49e48ad519081dc0e6c5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:02.566382 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 322338us
I20260925 01:50:02.566596 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0d31d53cb3f42a2b2df3e998623264c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.575011 11753 tablet_bootstrap.cc:492] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:02.575060 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a794ad0d87475a88efc02f5ae080f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.575254 11372 raft_consensus.cc:2468] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:02.575785 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85d859207bbc4aefb26c726dce404c44" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.575856 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17352fd6ea4e4ed9a178f1510edf4f6d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.576011 11379 raft_consensus.cc:2393] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:50:02.576128 11314 leader_election.cc:304] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.576274 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93329036763146beb8e6a9b039cc1ec1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.576474 12705 raft_consensus.cc:2804] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.575796 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a794ad0d87475a88efc02f5ae080f4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.576555 12705 raft_consensus.cc:493] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.576011 11375 raft_consensus.cc:2393] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:50:02.576639 11377 raft_consensus.cc:3060] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.575238 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90647937eb364a7a973d04ea69cbc9aa" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.576627 12705 raft_consensus.cc:3060] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.581938 11753 ts_tablet_manager.cc:1403] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.271s user 0.004s sys 0.004s
I20260925 01:50:02.583063 11953 ts_tablet_manager.cc:1929] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:02.583163 11953 log.cc:1199] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/30a5240093dd442a93bff006a965bc41
I20260925 01:50:02.583349 11755 tablet_bootstrap.cc:492] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:02.583593 11953 ts_tablet_manager.cc:1950] T 30a5240093dd442a93bff006a965bc41 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:02.583855 12705 raft_consensus.cc:515] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.584491 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 245) took 10675 ms. Trace:
I20260925 01:50:02.584656 12705 leader_election.cc:290] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:02.584841 11755 tablet_bootstrap.cc:654] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.585327 11377 raft_consensus.cc:2468] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:02.590579 12852 tablet.cc:1751] T efaaf48f816640e4a36627275d3ce8c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:02.591920 11753 raft_consensus.cc:359] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.584594 11953 rpcz_store.cc:276] 0925 01:49:51.908770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:51.909164 (+ 394us) service_pool.cc:224] Handling call
0925 01:50:02.191360 (+10282196us) ts_tablet_manager.cc:1151] Deleting tablet 30a5240093dd442a93bff006a965bc41
0925 01:50:02.191373 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.210604 (+ 19231us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.582991 (+372387us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.584466 (+ 1475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10279497}
I20260925 01:50:02.595872 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 249) took 10526 ms. Trace:
I20260925 01:50:02.596040 11953 rpcz_store.cc:276] 0925 01:49:52.069176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.069237 (+ 61us) service_pool.cc:224] Handling call
0925 01:50:02.595723 (+10526486us) ts_tablet_manager.cc:1151] Deleting tablet 329a5af9fb654d4c894e1cf4fd636c13
0925 01:50:02.595737 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.595852 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10526227}
I20260925 01:50:02.596504 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 246) took 10541 ms. Trace:
I20260925 01:50:02.596635 11953 rpcz_store.cc:276] 0925 01:49:52.057541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.070902 (+ 13361us) service_pool.cc:224] Handling call
0925 01:50:02.596379 (+10525477us) ts_tablet_manager.cc:1151] Deleting tablet 1f1d2d998d834c21ab83694daae37520
0925 01:50:02.596389 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.596489 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10525222}
I20260925 01:50:02.597030 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 247) took 10532 ms. Trace:
I20260925 01:50:02.597656 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bd594870fa6a4ba190a18a48d821d72c
I20260925 01:50:02.599278 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bf8bd1bfa4db4706b545829d6d26b660
I20260925 01:50:02.599689 11671 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_99371c3e38fd42af8a6efa16f0f84d4b [id=0a0c2552ecc6401fbd36a855df46e77c] alter complete (version 2)
I20260925 01:50:02.600102 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_27e14f591c404a57b3f63a5d57a17a35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:02.600574 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e0b01afdaa9e428eb5543cd3ce359877" } new_table_name: "default.Table_e2f3327250404a46bf3cc196408fb2a6" modify_external_catalogs: true
W20260925 01:50:02.600685 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27e14f591c404a57b3f63a5d57a17a35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.601060 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 53d30f4940c44bcf900a8cf0de91a66d
I20260925 01:50:02.601586 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_286e8f931c00432a90bfebcf44f6154e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:02.601827 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a45eb10593cd43ec8508c6dee33b434e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.602197 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_286e8f931c00432a90bfebcf44f6154e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:02.602257 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a45eb10593cd43ec8508c6dee33b434e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.601027 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 2feaab143fae4312915579fdb2ff1e40 (table default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b]). Expected version 2 got 0
I20260925 01:50:02.603864 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:50:02.604056 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet efaaf48f816640e4a36627275d3ce8c9 (table default.Table_99371c3e38fd42af8a6efa16f0f84d4b [id=0a0c2552ecc6401fbd36a855df46e77c]). Expected version 2 got 0
I20260925 01:50:02.606393 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet fe947074863044c1a8640092735a51fc from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:02.597512 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb01b25e8864eae84ae483612b9e18b (DEFAULT_TABLE table=default.Table_e5d15c656fd848df95d75a664d3e7f32 [id=532182ac67d647a499fb0dc47ade0592]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.604900 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 835e96fe1cfc41c6b8e5edfac07d28fd (DEFAULT_TABLE table=default.Table_c8efaeef1cd64670bcbf63eb0b401737 [id=28b03d6be66646398dfa0eb8c1b7f407]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.609853 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835e96fe1cfc41c6b8e5edfac07d28fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.610915 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 30a5240093dd442a93bff006a965bc41 (table default.Table_1ffecf54f1b3464eae523b831ac20bc0 [id=61d8ea1b10c44d6eb92474186b70df53]) successfully deleted
W20260925 01:50:02.611234 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 329a5af9fb654d4c894e1cf4fd636c13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 329a5af9fb654d4c894e1cf4fd636c13 already in progress: creating tablet
I20260925 01:50:02.611718 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bd22b1eb643f4229a65566493e21d96c
I20260925 01:50:02.612474 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_50f2a466d4b34198a9ddc948428a968b [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 1 got 0
I20260925 01:50:02.607460 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 043ec86a5af048ab81f1450856d5a85f (DEFAULT_TABLE table=default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.614470 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043ec86a5af048ab81f1450856d5a85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.618582 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb01b25e8864eae84ae483612b9e18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.619167 11953 rpcz_store.cc:276] 0925 01:49:52.064818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.075147 (+ 10329us) service_pool.cc:224] Handling call
0925 01:50:02.596930 (+10521783us) ts_tablet_manager.cc:1151] Deleting tablet 24cd89d238bf4220a48ecdf59cca5e6d
0925 01:50:02.596939 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.597015 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10521436}
I20260925 01:50:02.609958 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet bd594870fa6a4ba190a18a48d821d72c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.610144 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet bf8bd1bfa4db4706b545829d6d26b660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.610261 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 53d30f4940c44bcf900a8cf0de91a66d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.613217 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet bd22b1eb643f4229a65566493e21d96c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.603523 11314 leader_election.cc:304] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.625640 12705 raft_consensus.cc:2804] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:50:02.625694 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 24cd89d238bf4220a48ecdf59cca5e6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 24cd89d238bf4220a48ecdf59cca5e6d already in progress: creating tablet
I20260925 01:50:02.625787 12705 raft_consensus.cc:697] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:02.626039 12705 consensus_queue.cc:237] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.609292 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a794ad0d87475a88efc02f5ae080f4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:02.630703 11522 raft_consensus.cc:2393] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:50:02.631022 11753 raft_consensus.cc:385] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:02.632195 11314 leader_election.cc:343] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 85d859207bbc4aefb26c726dce404c44
I20260925 01:50:02.631605 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 7131531641464bba9ada4b5655dd0e47 (DEFAULT_TABLE table=default.Table_32a32bf92a704259be81d568b38294a6 [id=b25c0d556bb74cce9810b3c81ccb4faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.632658 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7131531641464bba9ada4b5655dd0e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.632673 11314 leader_election.cc:304] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.633230 12781 raft_consensus.cc:2749] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260925 01:50:02.633701 11314 leader_election.cc:343] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:50:02.633791 11314 leader_election.cc:304] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.635030 12781 raft_consensus.cc:2749] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.640208 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 248) took 10571 ms. Trace:
I20260925 01:50:02.632181 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 501f41a3ee1d440bb07033e29c38bc7a with delete_type TABLET_DATA_DELETED (replaced by tablet 7e7d26af44f948948e0d4e6ac9e072c0) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.641006 11953 rpcz_store.cc:276] 0925 01:49:52.069012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.080916 (+ 11904us) service_pool.cc:224] Handling call
0925 01:50:02.640070 (+10559154us) ts_tablet_manager.cc:1151] Deleting tablet 31ecfc5a2a80449c9905c83b6bcb3652
0925 01:50:02.640083 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.640186 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10558753}
I20260925 01:50:02.641163 11753 raft_consensus.cc:740] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:02.641697 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40c26580581e4e76ad9218958b3f9b78 has no consensus state
I20260925 01:50:02.642200 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 250) took 10556 ms. Trace:
I20260925 01:50:02.642212 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 98a94b6345ca427180e8f4e4b279efcf
I20260925 01:50:02.642279 11953 rpcz_store.cc:276] 0925 01:49:52.085741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.088033 (+ 2292us) service_pool.cc:224] Handling call
0925 01:50:02.642075 (+10554042us) ts_tablet_manager.cc:1151] Deleting tablet a9944a1422d14ae2b22451e67c477d5b
0925 01:50:02.642088 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.642179 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10422761}
I20260925 01:50:02.642725 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet bd594870fa6a4ba190a18a48d821d72c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:02.643379 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb49118851664ee59be43122bb8d9b27 has no consensus state
I20260925 01:50:02.643386 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet bf8bd1bfa4db4706b545829d6d26b660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.643571 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 53d30f4940c44bcf900a8cf0de91a66d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.644301 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 256) took 10450 ms. Trace:
I20260925 01:50:02.644371 11953 rpcz_store.cc:276] 0925 01:49:52.193959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.195002 (+ 1043us) service_pool.cc:224] Handling call
0925 01:50:02.644196 (+10449194us) ts_tablet_manager.cc:1151] Deleting tablet c28c8f00a8634ef89e4773b62e095b74
0925 01:50:02.644206 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.644284 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10257974}
W20260925 01:50:02.645157 11457 leader_election.cc:343] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:02.645399 11457 leader_election.cc:343] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.645485 11457 leader_election.cc:304] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.642249 11753 consensus_queue.cc:260] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.647850 12850 raft_consensus.cc:2749] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.648283 11457 leader_election.cc:304] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:50:02.648494 12850 raft_consensus.cc:2804] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:02.648591 12850 raft_consensus.cc:697] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:02.648797 12850 consensus_queue.cc:237] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:02.649380 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 31ecfc5a2a80449c9905c83b6bcb3652 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ecfc5a2a80449c9905c83b6bcb3652 already in progress: creating tablet
I20260925 01:50:02.649505 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 98a94b6345ca427180e8f4e4b279efcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:02.649641 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a9944a1422d14ae2b22451e67c477d5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9944a1422d14ae2b22451e67c477d5b already in progress: creating tablet
W20260925 01:50:02.649900 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c28c8f00a8634ef89e4773b62e095b74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c28c8f00a8634ef89e4773b62e095b74 already in progress: creating tablet
I20260925 01:50:02.655850 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c8f00a8634ef89e4773b62e095b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.656749 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
W20260925 01:50:02.657548 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a82e0251ebb4500b628924c89bfe1b2 consensus state has no leader
I20260925 01:50:02.657622 11753 ts_tablet_manager.cc:1434] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.076s user 0.002s sys 0.000s
I20260925 01:50:02.658102 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet bd22b1eb643f4229a65566493e21d96c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.658787 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 98a94b6345ca427180e8f4e4b279efcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:02.659703 11456 leader_election.cc:343] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 85d859207bbc4aefb26c726dce404c44
I20260925 01:50:02.662756 11456 leader_election.cc:304] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.661108 11753 tablet_bootstrap.cc:492] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:02.667652 11753 tablet_bootstrap.cc:654] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.674081 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
I20260925 01:50:02.668262 12770 raft_consensus.cc:2749] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260925 01:50:02.668571 11456 leader_election.cc:343] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:50:02.675964 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e3a033c9e7545479130c7a3c48ac254" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:02.677171 11517 raft_consensus.cc:3060] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.681113 11517 raft_consensus.cc:2468] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:02.681501 11456 leader_election.cc:304] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.681860 12770 raft_consensus.cc:2749] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.682194 11755 tablet_bootstrap.cc:492] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:02.682343 11755 ts_tablet_manager.cc:1403] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.007s
I20260925 01:50:02.683015 11755 raft_consensus.cc:359] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.683079 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93329036763146beb8e6a9b039cc1ec1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:02.683185 11755 raft_consensus.cc:385] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.683244 11755 raft_consensus.cc:740] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.683319 11242 raft_consensus.cc:2468] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:02.683646 11755 consensus_queue.cc:260] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.684213 11755 ts_tablet_manager.cc:1434] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:02.684504 11755 tablet_bootstrap.cc:492] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:02.685861 11755 tablet_bootstrap.cc:654] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.706374 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 273) took 10215 ms. Trace:
I20260925 01:50:02.706645 11953 rpcz_store.cc:276] 0925 01:49:52.490621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.615594 (+124973us) service_pool.cc:224] Handling call
0925 01:50:02.706219 (+10090625us) ts_tablet_manager.cc:1151] Deleting tablet 226498ea628a475d8fcab28a6598a819
0925 01:50:02.706231 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.706346 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10079866}
W20260925 01:50:02.707233 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 226498ea628a475d8fcab28a6598a819 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 226498ea628a475d8fcab28a6598a819 already in progress: creating tablet
I20260925 01:50:02.707341 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 276) took 10215 ms. Trace:
I20260925 01:50:02.707403 11953 rpcz_store.cc:276] 0925 01:49:52.491572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.626382 (+134810us) service_pool.cc:224] Handling call
0925 01:50:02.707224 (+10080842us) ts_tablet_manager.cc:1151] Deleting tablet 7347b31f782c4508b004c7523dc11dbb
0925 01:50:02.707234 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.707327 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10080430}
W20260925 01:50:02.708065 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 7347b31f782c4508b004c7523dc11dbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7347b31f782c4508b004c7523dc11dbb already in progress: creating tablet
I20260925 01:50:02.708127 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 277) took 10216 ms. Trace:
I20260925 01:50:02.708302 11953 rpcz_store.cc:276] 0925 01:49:52.491721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.626821 (+135100us) service_pool.cc:224] Handling call
0925 01:50:02.708024 (+10081203us) ts_tablet_manager.cc:1151] Deleting tablet 818a792969a245f5b0fe5f80128206ba
0925 01:50:02.708035 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.708113 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10080911}
W20260925 01:50:02.708783 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 818a792969a245f5b0fe5f80128206ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 818a792969a245f5b0fe5f80128206ba already in progress: creating tablet
I20260925 01:50:02.708827 11953 tablet_replica.cc:333] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:02.709112 11953 raft_consensus.cc:2243] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.709383 11953 raft_consensus.cc:2272] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:02.710119 12886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 01:50:02.711035 11314 leader_election.cc:343] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 55e9d52e3f79408a99216250aefc45c8
I20260925 01:50:02.711440 11314 leader_election.cc:304] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:50:02.711794 12705 raft_consensus.cc:2804] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:02.712054 12705 raft_consensus.cc:697] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:02.712364 12705 consensus_queue.cc:237] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.715034 12689 ts_tablet_manager.cc:1929] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:02.715157 12689 log.cc:1199] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/80fe96946b294785b8d76564e0f5fa12
I20260925 01:50:02.715480 12689 ts_tablet_manager.cc:1950] T 80fe96946b294785b8d76564e0f5fa12 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:02.718915 11241 raft_consensus.cc:2468] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:02.730823 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 578) took 1381 ms. Trace:
I20260925 01:50:02.731441 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 61c1181b38a247e79bd7a6355950881e (DEFAULT_TABLE table=default.Table_075eb0b9de704b3488addb686e309da4 [id=881f7a8eaffd4b68b85f8fcf70f8d94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.730998 12689 rpcz_store.cc:276] 0925 01:50:01.349032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.349089 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:01.926139 (+577050us) ts_tablet_manager.cc:1151] Deleting tablet 80fe96946b294785b8d76564e0f5fa12
0925 01:50:01.926151 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.022196 (+ 96045us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.714963 (+692767us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.730760 (+ 15797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14182,"tablet-delete.queue_time_us":576869}
I20260925 01:50:02.733352 12689 tablet_replica.cc:333] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:02.733577 12689 raft_consensus.cc:2243] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.733757 12689 raft_consensus.cc:2272] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:02.734818 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5dc28041348159e8c9c2addb282e6 (DEFAULT_TABLE table=default.Table_4cd88c56891a44ea999bf93572048756 [id=6cb8765f43b3443793ae9336b9c86292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.736006 12866 tablet.cc:1751] T efaaf48f816640e4a36627275d3ce8c9 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:02.743213 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 7131531641464bba9ada4b5655dd0e47 (DEFAULT_TABLE table=default.Table_32a32bf92a704259be81d568b38294a6 [id=b25c0d556bb74cce9810b3c81ccb4faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.743649 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7131531641464bba9ada4b5655dd0e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.744218 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c1181b38a247e79bd7a6355950881e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.744089 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b28d944249da44c997013470672b2958"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:02.744233 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cb8a2634625e4318a33e4cdf80a1c078" } new_table_name: "default.Table_4965b53b04c441ae89a4ce1b076ef463" modify_external_catalogs: true
W20260925 01:50:02.744704 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b28d944249da44c997013470672b2958 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.746083 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_58ce32fc2217428ab10cab615b1c968e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.746557 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58ce32fc2217428ab10cab615b1c968e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.747610 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f99d8d394b9f4122829c839de171352e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.748044 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f99d8d394b9f4122829c839de171352e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.750219 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5dc28041348159e8c9c2addb282e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.751652 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1ee75b9473fc4bd286125af7095cfc80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.752134 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ee75b9473fc4bd286125af7095cfc80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:02.752426 11239 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.685s user 0.006s sys 0.015s
W20260925 01:50:02.752517 11239 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.685s user 0.006s sys 0.015s
I20260925 01:50:02.754813 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet bd594870fa6a4ba190a18a48d821d72c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.755169 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet bf8bd1bfa4db4706b545829d6d26b660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.755501 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 53d30f4940c44bcf900a8cf0de91a66d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.755887 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet bd22b1eb643f4229a65566493e21d96c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.756178 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 98a94b6345ca427180e8f4e4b279efcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.756500 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_efa90132b756448babd6a66ce360d744"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.757162 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efa90132b756448babd6a66ce360d744 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.758635 12689 ts_tablet_manager.cc:1916] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:02.760848 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6599a18283614e759cf3886d72c8250b consensus state has no leader
I20260925 01:50:02.761545 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 61c1181b38a247e79bd7a6355950881e (DEFAULT_TABLE table=default.Table_075eb0b9de704b3488addb686e309da4 [id=881f7a8eaffd4b68b85f8fcf70f8d94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.761900 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c1181b38a247e79bd7a6355950881e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.764739 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 40c26580581e4e76ad9218958b3f9b78 (DEFAULT_TABLE table=default.Table_13f9ff413156494095a4ccdbc2d2b0e2 [id=03fe3bd58be64aa0941c740ea8fc7d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.765108 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c26580581e4e76ad9218958b3f9b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.768227 11754 ts_tablet_manager.cc:1434] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.420s user 0.011s sys 0.006s
I20260925 01:50:02.768592 11754 tablet_bootstrap.cc:492] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:02.769076 12852 tablet.cc:1751] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:02.770494 11754 tablet_bootstrap.cc:654] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.770926 12689 ts_tablet_manager.cc:1929] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:02.771023 12689 log.cc:1199] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/45a794ad0d87475a88efc02f5ae080f4
I20260925 01:50:02.771306 12689 ts_tablet_manager.cc:1950] T 45a794ad0d87475a88efc02f5ae080f4 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:02.773146 12852 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49304 (request call id 550) took 1332 ms. Trace:
W20260925 01:50:02.775578 11240 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s user 0.001s sys 0.010s
I20260925 01:50:02.773231 12852 rpcz_store.cc:276] 0925 01:50:01.441007 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.460788 (+ 19781us) service_pool.cc:224] Handling call
0925 01:50:02.773124 (+1312336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:50:01.461258 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0925 01:50:01.461353 (+ 95us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0925 01:50:01.461363 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0925 01:50:01.461370 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0925 01:50:01.569639 (+108269us) alter_schema_op.cc:128] START. Timestamp: 1790301001569538
0925 01:50:01.569643 (+ 4us) op_driver.cc:348] REPLICATION: starting
0925 01:50:01.569869 (+ 226us) log.cc:844] Serialized 173 byte log entry
0925 01:50:02.768812 (+1198943us) op_driver.cc:464] REPLICATION: finished
0925 01:50:02.769049 (+ 237us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0925 01:50:02.769457 (+ 408us) log.cc:844] Serialized 5 byte log entry
0925 01:50:02.772615 (+ 3158us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.772860 (+ 245us) log.cc:844] Serialized 14 byte log entry
0925 01:50:02.773079 (+ 219us) alter_schema_op.cc:73] Released schema lock
0925 01:50:02.773084 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":176,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":15645,"prepare.run_wall_time_us":485012,"replication_time_us":1199126,"thread_start_us":361822,"threads_started":1,"wal-append.queue_time_us":364952}]]}
I20260925 01:50:02.781546 11456 leader_election.cc:304] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:02.782048 12850 raft_consensus.cc:2804] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.782167 12850 raft_consensus.cc:493] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.782387 12850 raft_consensus.cc:3060] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.785352 12850 raft_consensus.cc:515] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.786476 12850 leader_election.cc:290] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.786967 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5dc28041348159e8c9c2addb282e6 (DEFAULT_TABLE table=default.Table_4cd88c56891a44ea999bf93572048756 [id=6cb8765f43b3443793ae9336b9c86292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.787444 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5dc28041348159e8c9c2addb282e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.794989 12866 tablet.cc:1751] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:02.800928 12884 raft_consensus.cc:493] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.801103 12884 raft_consensus.cc:515] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.801816 12884 leader_election.cc:290] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.805776 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_680652ee5db44c0ca4fa70ca72f3afef" } new_table_name: "default.Table_9f6dd5ef40a04e98990d77a073bacec3" modify_external_catalogs: true
I20260925 01:50:02.806918 12852 tablet.cc:1751] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:02.808360 12908 tablet.cc:1751] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:02.810491 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5dc28041348159e8c9c2addb282e6 (DEFAULT_TABLE table=default.Table_4cd88c56891a44ea999bf93572048756 [id=6cb8765f43b3443793ae9336b9c86292]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.812747 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 40c26580581e4e76ad9218958b3f9b78 (DEFAULT_TABLE table=default.Table_13f9ff413156494095a4ccdbc2d2b0e2 [id=03fe3bd58be64aa0941c740ea8fc7d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.813458 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c26580581e4e76ad9218958b3f9b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.817710 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 40c26580581e4e76ad9218958b3f9b78 (DEFAULT_TABLE table=default.Table_13f9ff413156494095a4ccdbc2d2b0e2 [id=03fe3bd58be64aa0941c740ea8fc7d21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.818311 11946 ts_tablet_manager.cc:1929] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:02.818495 11946 log.cc:1199] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/347a144e18ab4f6e834551044a2ac4ae
I20260925 01:50:02.819031 11946 ts_tablet_manager.cc:1950] T 347a144e18ab4f6e834551044a2ac4ae P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:02.819344 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 579) took 1461 ms. Trace:
I20260925 01:50:02.819487 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45a794ad0d87475a88efc02f5ae080f4" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:02.820204 12689 rpcz_store.cc:276] 0925 01:50:01.357724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.357784 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:02.733273 (+1375489us) ts_tablet_manager.cc:1151] Deleting tablet 45a794ad0d87475a88efc02f5ae080f4
0925 01:50:02.733285 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.762190 (+ 28905us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.770883 (+ 8693us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.819324 (+ 48441us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1375103}
I20260925 01:50:02.820008 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 64a49fe04a104507aba39b4ac5b7b628 (DEFAULT_TABLE table=default.Table_80ca296c2f004baca398878b60eb0d0b [id=dc74da0e45934709a332060970635ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.822232 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93329036763146beb8e6a9b039cc1ec1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:02.822402 11237 raft_consensus.cc:3060] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.822974 12689 tablet_replica.cc:333] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:02.823069 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b68399843a422b8da3ddfab2c522e6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:02.823123 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b68399843a422b8da3ddfab2c522e6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:02.823195 12689 raft_consensus.cc:2243] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.823398 12689 raft_consensus.cc:2272] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:02.823992 12689 ts_tablet_manager.cc:1916] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:02.823211 11240 raft_consensus.cc:2468] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:02.826135 11237 raft_consensus.cc:2468] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:02.826159 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 64a49fe04a104507aba39b4ac5b7b628 (DEFAULT_TABLE table=default.Table_80ca296c2f004baca398878b60eb0d0b [id=dc74da0e45934709a332060970635ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.826195 11456 leader_election.cc:304] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:02.826864 11456 leader_election.cc:304] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:02.822171 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93329036763146beb8e6a9b039cc1ec1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.827214 12508 raft_consensus.cc:2804] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:02.827313 12508 raft_consensus.cc:493] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:02.827903 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 1c42096d96834a0a90d8c70c4601e35d (DEFAULT_TABLE table=default.Table_11b951ff79f74904a9e676cdd1c8cd12 [id=ee48f4b4de304fa98adc15aa34f8075e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.827044 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 501f41a3ee1d440bb07033e29c38bc7a with delete_type TABLET_DATA_DELETED (replaced by tablet 7e7d26af44f948948e0d4e6ac9e072c0) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.828349 12850 raft_consensus.cc:2804] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:02.828536 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 1c42096d96834a0a90d8c70c4601e35d (DEFAULT_TABLE table=default.Table_11b951ff79f74904a9e676cdd1c8cd12 [id=ee48f4b4de304fa98adc15aa34f8075e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.828692 12850 raft_consensus.cc:697] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
W20260925 01:50:02.828918 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet f92450c05b394603ba475328d5a3eb71 (table default.Table_19c88af560ee4b8ea34d884da9fb699c [id=8fb47e3a8f244d5b861e5878dbad047e], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet f92450c05b394603ba475328d5a3eb71 consensus state has no leader
I20260925 01:50:02.829142 12850 consensus_queue.cc:237] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.830374 11953 ts_tablet_manager.cc:1916] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:02.832046 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 64a49fe04a104507aba39b4ac5b7b628 (DEFAULT_TABLE table=default.Table_80ca296c2f004baca398878b60eb0d0b [id=dc74da0e45934709a332060970635ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.836283 12894 raft_consensus.cc:493] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:50:02.836406 11314 leader_election.cc:343] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 55e9d52e3f79408a99216250aefc45c8
I20260925 01:50:02.836423 12894 raft_consensus.cc:515] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.836512 11314 leader_election.cc:304] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.837476 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c4a23d974f4daea7a274eccd661d5c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:02.838025 11177 leader_election.cc:343] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.838341 12894 leader_election.cc:290] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:02.839819 11457 leader_election.cc:343] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.839915 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2957cbd4669749b381f59d1e301a692d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.840188 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a49fe04a104507aba39b4ac5b7b628. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:02.840214 11457 leader_election.cc:343] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.841428 12508 raft_consensus.cc:3060] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:02.843282 12900 log.cc:927] Time spent T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
W20260925 01:50:02.844683 12903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:50:02.844749 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 61c1181b38a247e79bd7a6355950881e (DEFAULT_TABLE table=default.Table_075eb0b9de704b3488addb686e309da4 [id=881f7a8eaffd4b68b85f8fcf70f8d94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.846762 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 532) took 2134 ms. Trace:
I20260925 01:50:02.846910 11946 rpcz_store.cc:276] 0925 01:50:00.712155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.712208 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:02.332954 (+1620746us) ts_tablet_manager.cc:1151] Deleting tablet 347a144e18ab4f6e834551044a2ac4ae
0925 01:50:02.332963 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.606325 (+273362us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.818252 (+211927us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:02.846743 (+ 28491us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1620535}
I20260925 01:50:02.847157 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c26580581e4e76ad9218958b3f9b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.847700 11946 tablet_replica.cc:333] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:02.847925 11946 raft_consensus.cc:2243] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.848109 11946 raft_consensus.cc:2272] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:02.848640 11946 ts_tablet_manager.cc:1916] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:02.849422 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c1181b38a247e79bd7a6355950881e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.850077 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a49fe04a104507aba39b4ac5b7b628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.850426 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c42096d96834a0a90d8c70c4601e35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.844406 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c8f00a8634ef89e4773b62e095b74" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:02.850787 11523 raft_consensus.cc:3060] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.853150 12866 tablet.cc:1751] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:02.853402 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5dc28041348159e8c9c2addb282e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.855046 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8176372e797c4778a5761c5da6336218" } modify_external_catalogs: true
I20260925 01:50:02.855420 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8176372e797c4778a5761c5da6336218" } modify_external_catalogs: true
I20260925 01:50:02.855834 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fd035701fcd04644b86876963e515e35" } modify_external_catalogs: true
I20260925 01:50:02.856125 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fd035701fcd04644b86876963e515e35" } modify_external_catalogs: true
I20260925 01:50:02.856812 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0a21405c13e44a9b98038ff6cd0205d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.857589 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a21405c13e44a9b98038ff6cd0205d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.859093 11754 tablet_bootstrap.cc:492] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:02.859246 11754 ts_tablet_manager.cc:1403] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.001s
I20260925 01:50:02.859790 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7eb435d3e2ec4209bdd1f04597fcadd8" } modify_external_catalogs: true
I20260925 01:50:02.860064 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7eb435d3e2ec4209bdd1f04597fcadd8" } modify_external_catalogs: true
I20260925 01:50:02.860776 11754 raft_consensus.cc:359] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:02.860932 11754 raft_consensus.cc:385] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.860982 11754 raft_consensus.cc:740] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.861159 11754 consensus_queue.cc:260] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:02.861505 12508 raft_consensus.cc:515] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.862310 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a30fe60bacc84cf5805f7b80eb570f11" } modify_external_catalogs: true
I20260925 01:50:02.868762 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c4a23d974f4daea7a274eccd661d5c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:02.870733 11502 tablet_service.cc:1511] Processing CreateTablet for tablet e7d8f134a49045efa9ecb5a333cc5a37 (DEFAULT_TABLE table=default.Table_41b6b9f73f9141d1ae49115efb41aa8c [id=f1b5f8934b944e8a8541293472e37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.870939 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 4ad9d992f7ed4021a7e472dd38ad2c2e (table default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366]). Expected version 1 got 0
I20260925 01:50:02.871311 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a30fe60bacc84cf5805f7b80eb570f11" } modify_external_catalogs: true
I20260925 01:50:02.872763 11523 raft_consensus.cc:2468] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:02.872814 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 80fe96946b294785b8d76564e0f5fa12 (table default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]) successfully deleted
I20260925 01:50:02.873888 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 45a794ad0d87475a88efc02f5ae080f4 (table default.Table_bc79315e26e64754b7ae9ce08ba0a88d [id=b96d7b3ebf9544a0867e0ab08c072648]) successfully deleted
W20260925 01:50:02.874836 11176 leader_election.cc:343] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.874996 11176 leader_election.cc:304] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:02.875321 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bc99f3613c354d68bfde33e04dc1e9ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc99f3613c354d68bfde33e04dc1e9ab already in progress: creating tablet
I20260925 01:50:02.875999 12894 raft_consensus.cc:2749] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.876405 12908 tablet.cc:1751] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:02.876926 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1cdf240ece4148e88d0b728903d255df" } modify_external_catalogs: true
I20260925 01:50:02.877089 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1cdf240ece4148e88d0b728903d255df" } modify_external_catalogs: true
I20260925 01:50:02.877660 11176 leader_election.cc:304] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:02.877926 12508 leader_election.cc:290] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:02.878369 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b68399843a422b8da3ddfab2c522e6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:02.878572 11239 raft_consensus.cc:3060] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:02.879048 12705 raft_consensus.cc:2749] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:02.879984 11314 leader_election.cc:343] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 3e3a033c9e7545479130c7a3c48ac254
I20260925 01:50:02.880179 11360 tablet_service.cc:1511] Processing CreateTablet for tablet e7d8f134a49045efa9ecb5a333cc5a37 (DEFAULT_TABLE table=default.Table_41b6b9f73f9141d1ae49115efb41aa8c [id=f1b5f8934b944e8a8541293472e37f11]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:02.880247 11314 leader_election.cc:343] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260925 01:50:02.880318 11314 leader_election.cc:304] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:02.880522 12781 raft_consensus.cc:2749] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:02.881841 11342 tablet_service.cc:1511] Processing CreateTablet for tablet fb49118851664ee59be43122bb8d9b27 (DEFAULT_TABLE table=default.Table_edc5e2ecf3d240d7a989ed4b671a85e7 [id=ca2645e742b847cc94f9514d7ffb8620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.882539 11239 raft_consensus.cc:2468] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:02.884830 11352 tablet_service.cc:1511] Processing CreateTablet for tablet c05bc0116afb40918c00e012ef77d48e (DEFAULT_TABLE table=default.Table_cd78ce13b4ed4fba93ce221304656a7f [id=bde20875f2334f1a919c92d80cc3df43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.886020 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d8f134a49045efa9ecb5a333cc5a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.889724 12689 ts_tablet_manager.cc:1929] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260925 01:50:02.895362 12917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 01:50:02.895663 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64a49fe04a104507aba39b4ac5b7b628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.896530 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c42096d96834a0a90d8c70c4601e35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.897131 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d8f134a49045efa9ecb5a333cc5a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.900616 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05bc0116afb40918c00e012ef77d48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.901137 11456 leader_election.cc:304] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:02.901408 12508 raft_consensus.cc:2804] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:02.901528 12508 raft_consensus.cc:697] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:02.901768 12508 consensus_queue.cc:237] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.901952 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 347a144e18ab4f6e834551044a2ac4ae (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]) successfully deleted
I20260925 01:50:02.902853 12828 server_base.cc:1061] running on GCE node
I20260925 01:50:02.903667 11489 tablet_service.cc:1511] Processing CreateTablet for tablet c05bc0116afb40918c00e012ef77d48e (DEFAULT_TABLE table=default.Table_cd78ce13b4ed4fba93ce221304656a7f [id=bde20875f2334f1a919c92d80cc3df43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.904044 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05bc0116afb40918c00e012ef77d48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.903667 11493 tablet_service.cc:1511] Processing CreateTablet for tablet fb49118851664ee59be43122bb8d9b27 (DEFAULT_TABLE table=default.Table_edc5e2ecf3d240d7a989ed4b671a85e7 [id=ca2645e742b847cc94f9514d7ffb8620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.904467 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb49118851664ee59be43122bb8d9b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.904625 12828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260925 01:50:02.908757 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cd450609843b4948942124e3f99ce8b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.909581 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd450609843b4948942124e3f99ce8b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.912266 11671 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_9c9ce5397aab47629f8271efca8c100f [id=590734454eea4965a095ef821bc27366] alter complete (version 1)
W20260925 01:50:02.913017 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8042784d3ab14285836a008745daabbc consensus state has no leader
I20260925 01:50:02.913406 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_445d4f81dda44494b1559b9c308b5c4c" } new_table_name: "default.Table_4ddf083eded349e1a653c4235f6949c7" modify_external_catalogs: true
I20260925 01:50:02.915411 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c21eb1eda2f74840a870850b1ac2d349"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.915962 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c21eb1eda2f74840a870850b1ac2d349 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.917711 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 21ee9163747b462f86105be553a57b2f (DEFAULT_TABLE table=default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.918081 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ee9163747b462f86105be553a57b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.921921 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0e530a05e7374eef90dd27c3d716072c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.922573 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e530a05e7374eef90dd27c3d716072c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.913422 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c98e3154b1c4405abb6aa97166f8c330" } new_table_name: "default.Table_d7668004fa2647ff8f36edcc9bf4ffe1" modify_external_catalogs: true
I20260925 01:50:02.928013 12689 log.cc:1199] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ba378e9d37c64a8ebd56894b2101ed8f
I20260925 01:50:02.928545 12689 ts_tablet_manager.cc:1950] T ba378e9d37c64a8ebd56894b2101ed8f P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:50:02.929158 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 47324.1us
I20260925 01:50:02.930861 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b68399843a422b8da3ddfab2c522e6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:02.933162 12689 tablet_replica.cc:333] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:02.933359 12689 raft_consensus.cc:2243] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:02.933514 12689 raft_consensus.cc:2272] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:02.934082 12689 ts_tablet_manager.cc:1916] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:02.892119 12918 tablet.cc:1751] T 2feaab143fae4312915579fdb2ff1e40 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:02.903795 12894 raft_consensus.cc:2804] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:02.935083 12894 raft_consensus.cc:697] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
W20260925 01:50:02.935555 11457 leader_election.cc:343] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:02.935487 12894 consensus_queue.cc:237] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.904891 11221 tablet_service.cc:1511] Processing CreateTablet for tablet fb49118851664ee59be43122bb8d9b27 (DEFAULT_TABLE table=default.Table_edc5e2ecf3d240d7a989ed4b671a85e7 [id=ca2645e742b847cc94f9514d7ffb8620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.937042 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb49118851664ee59be43122bb8d9b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.938675 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]) successfully deleted
I20260925 01:50:02.905313 11212 tablet_service.cc:1511] Processing CreateTablet for tablet e7d8f134a49045efa9ecb5a333cc5a37 (DEFAULT_TABLE table=default.Table_41b6b9f73f9141d1ae49115efb41aa8c [id=f1b5f8934b944e8a8541293472e37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.905560 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 1c42096d96834a0a90d8c70c4601e35d (DEFAULT_TABLE table=default.Table_11b951ff79f74904a9e676cdd1c8cd12 [id=ee48f4b4de304fa98adc15aa34f8075e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.942739 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d8f134a49045efa9ecb5a333cc5a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.878209 11754 ts_tablet_manager.cc:1434] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260925 01:50:02.943041 11754 tablet_bootstrap.cc:492] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:02.943478 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0c01195f07b84b359a974fab5ed52582
I20260925 01:50:02.944571 11754 tablet_bootstrap.cc:654] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:02.911860 11215 tablet_service.cc:1511] Processing CreateTablet for tablet c05bc0116afb40918c00e012ef77d48e (DEFAULT_TABLE table=default.Table_cd78ce13b4ed4fba93ce221304656a7f [id=bde20875f2334f1a919c92d80cc3df43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.945540 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c05bc0116afb40918c00e012ef77d48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.947486 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb49118851664ee59be43122bb8d9b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.949306 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c42096d96834a0a90d8c70c4601e35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.950484 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1575d0eb9ed64653b317edefd24f7dfd
I20260925 01:50:02.951514 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6494d683e65047fdbb34edad8bc00960"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:02.952328 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6494d683e65047fdbb34edad8bc00960 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:02.954917 11755 tablet_bootstrap.cc:492] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:02.955053 11755 ts_tablet_manager.cc:1403] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.271s user 0.009s sys 0.017s
I20260925 01:50:02.956190 12782 raft_consensus.cc:493] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:02.956332 12782 raft_consensus.cc:515] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:02.957072 12782 leader_election.cc:290] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:02.922254 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 21ee9163747b462f86105be553a57b2f (DEFAULT_TABLE table=default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.958024 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ee9163747b462f86105be553a57b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.925051 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 72b29eb581b14d3aa330c84811fbf261 (DEFAULT_TABLE table=default.Table_f82704d6ddcb4ac9b15dd5ba8fc31477 [id=7f9f4cf3c18c48c49a834e134848850b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.958546 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b29eb581b14d3aa330c84811fbf261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.959200 11755 raft_consensus.cc:359] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.959380 11755 raft_consensus.cc:385] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:02.959446 11755 raft_consensus.cc:740] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:02.961035 12782 consensus_queue.cc:1048] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:02.959682 11755 consensus_queue.cc:260] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:02.965596 11755 ts_tablet_manager.cc:1434] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:50:02.965847 11755 tablet_bootstrap.cc:492] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:02.969921 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 21ee9163747b462f86105be553a57b2f (DEFAULT_TABLE table=default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.970304 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21ee9163747b462f86105be553a57b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.972836 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 1575d0eb9ed64653b317edefd24f7dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.973446 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 1575d0eb9ed64653b317edefd24f7dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:02.976099 11314 consensus_peers.cc:597] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80fe96946b294785b8d76564e0f5fa12. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:02.976266 11314 leader_election.cc:343] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 90647937eb364a7a973d04ea69cbc9aa
I20260925 01:50:02.976385 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90647937eb364a7a973d04ea69cbc9aa" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:02.976943 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c01195f07b84b359a974fab5ed52582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.978505 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7a5c9dac783d4ef3a24cb65275ff484f
I20260925 01:50:02.980535 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a5c9dac783d4ef3a24cb65275ff484f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:02.982436 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 72b29eb581b14d3aa330c84811fbf261 (DEFAULT_TABLE table=default.Table_f82704d6ddcb4ac9b15dd5ba8fc31477 [id=7f9f4cf3c18c48c49a834e134848850b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.982873 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c01195f07b84b359a974fab5ed52582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.983141 11341 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a5c9dac783d4ef3a24cb65275ff484f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.983544 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b29eb581b14d3aa330c84811fbf261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.983882 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 074576ae86c44cf38961d22e600c042c (DEFAULT_TABLE table=default.Table_eff500a5321c4fc8ae32c0504aa63890 [id=cc5de2eada78491d8ff9ed6e43120ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.984007 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 72b29eb581b14d3aa330c84811fbf261 (DEFAULT_TABLE table=default.Table_f82704d6ddcb4ac9b15dd5ba8fc31477 [id=7f9f4cf3c18c48c49a834e134848850b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:02.984441 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72b29eb581b14d3aa330c84811fbf261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.984596 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074576ae86c44cf38961d22e600c042c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:02.984622 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 1575d0eb9ed64653b317edefd24f7dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:02.987910 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f8618e0dcc354193b6014b7fea7f7698" } new_table_name: "default.Table_1a17bc9d97f7458e8ec979b4728fa9e5" modify_external_catalogs: true
I20260925 01:50:02.992861 12828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260925 01:50:02.995002 12828 hybrid_clock.cc:648] HybridClock initialized: now 1790301002994884 us; error 94 us; skew 500 ppm
I20260925 01:50:02.995447 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a5c9dac783d4ef3a24cb65275ff484f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.995721 12828 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 01:50:02.976634 11523 raft_consensus.cc:2468] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:02.998170 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c01195f07b84b359a974fab5ed52582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.006610 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 018f68f800c9489a846c3b1b3ee3fa2d
I20260925 01:50:03.007133 11754 tablet_bootstrap.cc:492] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.007330 11754 ts_tablet_manager.cc:1403] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.001s
I20260925 01:50:03.007817 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 018f68f800c9489a846c3b1b3ee3fa2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:02.997501 12912 tablet.cc:1751] T 2feaab143fae4312915579fdb2ff1e40 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:03.008301 11754 raft_consensus.cc:359] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.008611 11754 raft_consensus.cc:385] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.008721 11754 raft_consensus.cc:740] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.009057 11754 consensus_queue.cc:260] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.009595 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 018f68f800c9489a846c3b1b3ee3fa2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.009902 11754 ts_tablet_manager.cc:1434] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:03.011909 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_52ce6901556c469fa619f86157a93007"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.012544 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52ce6901556c469fa619f86157a93007 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.017700 11755 tablet_bootstrap.cc:654] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.020176 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 6ff85bac0d22416987e8e3b379154b09
I20260925 01:50:03.021028 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff85bac0d22416987e8e3b379154b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.022599 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff85bac0d22416987e8e3b379154b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.031030 11314 leader_election.cc:304] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.031389 12705 raft_consensus.cc:2804] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.031595 12705 raft_consensus.cc:493] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.034140 12705 raft_consensus.cc:3060] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.034322 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 018f68f800c9489a846c3b1b3ee3fa2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.039831 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_50f2a466d4b34198a9ddc948428a968b" } new_table_name: "default.Table_5db64fc4070a45f0adc4c8234951e1bf" modify_external_catalogs: true
I20260925 01:50:03.042208 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff85bac0d22416987e8e3b379154b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.046988 12705 raft_consensus.cc:515] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:03.047605 12705 leader_election.cc:290] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:03.050414 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a43584aea51145d2982ee7e28cd1463f consensus state has no leader
I20260925 01:50:03.052608 12852 tablet.cc:1751] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:03.054733 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_aff4f0f44c1f482b996bba5360da5424"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.055371 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aff4f0f44c1f482b996bba5360da5424 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.066453 12828 webserver.cc:533] Webserver started at http://127.10.159.253:34593/ using document root <none> and password file <none>
I20260925 01:50:03.067787 12828 fs_manager.cc:362] Metadata directory not provided
I20260925 01:50:03.068042 12828 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 01:50:03.069335 11753 tablet_bootstrap.cc:492] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.069499 11753 ts_tablet_manager.cc:1403] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.408s user 0.010s sys 0.000s
I20260925 01:50:03.070374 11753 raft_consensus.cc:359] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.070580 11753 raft_consensus.cc:385] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.070643 11753 raft_consensus.cc:740] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.071691 11754 tablet_bootstrap.cc:492] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:03.073350 11754 tablet_bootstrap.cc:654] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.074538 12689 ts_tablet_manager.cc:1929] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.074713 12689 log.cc:1199] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:03.075299 12689 ts_tablet_manager.cc:1950] T 75a8e09b8838443c9bfff440ff1f877d P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.085450 11753 consensus_queue.cc:260] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.101068 11753 ts_tablet_manager.cc:1434] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.031s user 0.003s sys 0.000s
I20260925 01:50:03.101701 11953 ts_tablet_manager.cc:1929] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:03.101861 11953 log.cc:1199] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/67921f86c4f6422e97d7f306262569f8
I20260925 01:50:03.101953 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 75a8e09b8838443c9bfff440ff1f877d (table default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea [id=22de07c9013f4c3ab9568e926ea5b8c1]) successfully deleted
I20260925 01:50:03.102361 11953 ts_tablet_manager.cc:1950] T 67921f86c4f6422e97d7f306262569f8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:03.104336 11753 tablet_bootstrap.cc:492] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.109014 11753 tablet_bootstrap.cc:654] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.094163 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90647937eb364a7a973d04ea69cbc9aa" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:03.109299 11522 raft_consensus.cc:3060] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:03.111554 11314 leader_election.cc:343] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 90647937eb364a7a973d04ea69cbc9aa
I20260925 01:50:03.112140 11522 raft_consensus.cc:2468] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:03.088346 11946 ts_tablet_manager.cc:1929] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.112699 11946 log.cc:1199] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/38082c23d99148bb916b0ae74fd474b8
I20260925 01:50:03.113108 11946 ts_tablet_manager.cc:1950] T 38082c23d99148bb916b0ae74fd474b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:03.114701 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ea77bdd6680491da6f9aa8e218bdace consensus state has no leader
I20260925 01:50:03.114686 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 531) took 2402 ms. Trace:
I20260925 01:50:03.114781 11946 rpcz_store.cc:276] 0925 01:50:00.711993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.712579 (+ 586us) service_pool.cc:224] Handling call
0925 01:50:02.847661 (+2135082us) ts_tablet_manager.cc:1151] Deleting tablet 38082c23d99148bb916b0ae74fd474b8
0925 01:50:02.847670 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:02.908346 (+ 60676us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.088278 (+179932us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.114662 (+ 26384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":540,"tablet-delete.queue_time_us":2134901}
I20260925 01:50:03.115103 11946 tablet_replica.cc:333] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:03.115273 11946 raft_consensus.cc:2243] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.115407 11946 raft_consensus.cc:2272] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.115886 11946 ts_tablet_manager.cc:1916] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.115984 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 38082c23d99148bb916b0ae74fd474b8 (table default.Table_c6503d38584945e3a845e2f96ab5a4fc [id=093f5fa0a0d340b381d7794eede8d93a]) successfully deleted
I20260925 01:50:03.118607 12705 raft_consensus.cc:493] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.118757 12705 raft_consensus.cc:515] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.119923 12705 leader_election.cc:290] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:03.120647 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0c39d486ee7c4893bed0f1ee98d35b81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.121335 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c39d486ee7c4893bed0f1ee98d35b81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.122804 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5623ddf2e68941919d8ba2a5c6e50b5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.123440 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5623ddf2e68941919d8ba2a5c6e50b5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.123582 11314 leader_election.cc:304] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.125346 11753 tablet_bootstrap.cc:492] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.125599 11753 ts_tablet_manager.cc:1403] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.005s
I20260925 01:50:03.126132 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 074576ae86c44cf38961d22e600c042c (DEFAULT_TABLE table=default.Table_eff500a5321c4fc8ae32c0504aa63890 [id=cc5de2eada78491d8ff9ed6e43120ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.126117 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8331a7db9b06422182b4638dc448ae50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:03.126609 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074576ae86c44cf38961d22e600c042c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:03.126704 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8331a7db9b06422182b4638dc448ae50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.131793 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 274) took 10641 ms. Trace:
I20260925 01:50:03.133669 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 074576ae86c44cf38961d22e600c042c (DEFAULT_TABLE table=default.Table_eff500a5321c4fc8ae32c0504aa63890 [id=cc5de2eada78491d8ff9ed6e43120ea7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.134579 12781 raft_consensus.cc:2804] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.134737 12781 raft_consensus.cc:697] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:03.135073 11672 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff] alter complete (version 2)
I20260925 01:50:03.136040 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet ea10c9a7e20b48c69eb5f24631403e93 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:03.136596 11753 raft_consensus.cc:359] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.136814 11753 raft_consensus.cc:385] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.136898 11753 raft_consensus.cc:740] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.137356 11753 consensus_queue.cc:260] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.138193 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 96b68399843a422b8da3ddfab2c522e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.140062 11753 ts_tablet_manager.cc:1434] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260925 01:50:03.142766 11753 tablet_bootstrap.cc:492] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.142824 11204 tablet_service.cc:1511] Processing CreateTablet for tablet ae1cd01418cd44828560b260dd2c9577 (DEFAULT_TABLE table=default.Table_2a41cecc90bc4f7caeca09f31a429af3 [id=ce886555838840ad89bc3b3edb8a3f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.143314 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1cd01418cd44828560b260dd2c9577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.144748 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074576ae86c44cf38961d22e600c042c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.145785 11753 tablet_bootstrap.cc:654] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.148077 11493 tablet_service.cc:1511] Processing CreateTablet for tablet ae1cd01418cd44828560b260dd2c9577 (DEFAULT_TABLE table=default.Table_2a41cecc90bc4f7caeca09f31a429af3 [id=ce886555838840ad89bc3b3edb8a3f8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:03.148188 11314 leader_election.cc:343] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 331380a2be9a4893927c9b94a2c3e08b
I20260925 01:50:03.148727 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1cd01418cd44828560b260dd2c9577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.153576 11204 tablet_service.cc:1511] Processing CreateTablet for tablet c504185484c04a5e9f221d2826e99418 (DEFAULT_TABLE table=default.Table_a727d3e849e3447caa7689dbdf276ed1 [id=376c8eb116b543f299e481d33fbc7b91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.153985 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504185484c04a5e9f221d2826e99418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.154579 12781 consensus_queue.cc:237] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:03.156669 11360 tablet_service.cc:1511] Processing CreateTablet for tablet ae1cd01418cd44828560b260dd2c9577 (DEFAULT_TABLE table=default.Table_2a41cecc90bc4f7caeca09f31a429af3 [id=ce886555838840ad89bc3b3edb8a3f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.157069 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1cd01418cd44828560b260dd2c9577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.131907 11953 rpcz_store.cc:276] 0925 01:49:52.490727 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.619821 (+129094us) service_pool.cc:224] Handling call
0925 01:50:02.708780 (+10088959us) ts_tablet_manager.cc:1151] Deleting tablet 67921f86c4f6422e97d7f306262569f8
0925 01:50:02.708788 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.024501 (+315713us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.101630 (+ 77129us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.131762 (+ 30132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10081362}
I20260925 01:50:03.158247 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 67921f86c4f6422e97d7f306262569f8 (table default.Table_c33c7eb6481e4876aed3d7038afa9f93 [id=107d0cda55154f5e84ce4dd14d36364a]) successfully deleted
I20260925 01:50:03.158653 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 275) took 10667 ms. Trace:
I20260925 01:50:03.168697 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c96bd3104c0d439d92cfbd1d5be90f48" } new_table_name: "default.Table_69dd9b3d7d624415aacea6486cb9caeb" modify_external_catalogs: true
I20260925 01:50:03.169234 11753 tablet_bootstrap.cc:492] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.169603 11753 ts_tablet_manager.cc:1403] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.001s
I20260925 01:50:03.158731 11953 rpcz_store.cc:276] 0925 01:49:52.490813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.621649 (+130836us) service_pool.cc:224] Handling call
0925 01:50:03.158525 (+10536876us) ts_tablet_manager.cc:1151] Deleting tablet 8afcf8f6d0e24472a3190059df032698
0925 01:50:03.158535 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.158635 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10446417}
I20260925 01:50:03.170629 11753 raft_consensus.cc:359] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.170869 11753 raft_consensus.cc:385] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:03.170928 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8afcf8f6d0e24472a3190059df032698 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8afcf8f6d0e24472a3190059df032698 already in progress: creating tablet
I20260925 01:50:03.171056 11753 raft_consensus.cc:740] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.171401 11753 consensus_queue.cc:260] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.172513 11953 tablet_replica.cc:333] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:03.174631 11753 ts_tablet_manager.cc:1434] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:03.176218 11753 tablet_bootstrap.cc:492] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:03.176836 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0575861dd3d6437284cc183acb87af0a consensus state has no leader
I20260925 01:50:03.178846 11753 tablet_bootstrap.cc:654] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.172729 11953 raft_consensus.cc:2243] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:03.179601 11953 raft_consensus.cc:2272] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.180193 11953 ts_tablet_manager.cc:1916] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.093729 12894 raft_consensus.cc:493] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.180756 12894 raft_consensus.cc:515] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:03.182296 12894 leader_election.cc:290] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.182817 12689 tablet_replica.cc:333] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.183224 12689 raft_consensus.cc:2243] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:03.183985 12689 pending_rounds.cc:70] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:03.184104 12689 pending_rounds.cc:77] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072908026519552 op_type: NO_OP noop_request { }
I20260925 01:50:03.184262 12689 raft_consensus.cc:2889] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:03.184410 12689 raft_consensus.cc:2272] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.184329 11342 tablet_service.cc:1511] Processing CreateTablet for tablet c504185484c04a5e9f221d2826e99418 (DEFAULT_TABLE table=default.Table_a727d3e849e3447caa7689dbdf276ed1 [id=376c8eb116b543f299e481d33fbc7b91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.184729 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c29e410731842aeb64ab8eeb4ccc3ca" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.185746 11177 leader_election.cc:343] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.178989 11493 tablet_service.cc:1511] Processing CreateTablet for tablet c504185484c04a5e9f221d2826e99418 (DEFAULT_TABLE table=default.Table_a727d3e849e3447caa7689dbdf276ed1 [id=376c8eb116b543f299e481d33fbc7b91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.183701 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c29e410731842aeb64ab8eeb4ccc3ca" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:50:03.189563 11176 leader_election.cc:343] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.189646 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504185484c04a5e9f221d2826e99418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.189687 11176 leader_election.cc:304] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:03.191006 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_323f0bc0c8e145b3a67223de2f37adcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.191637 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_323f0bc0c8e145b3a67223de2f37adcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.194700 12689 ts_tablet_manager.cc:1916] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:03.195293 11667 consensus_peers.cc:597] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 -> Peer ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889): Couldn't send request to peer ec2f98d6295c4f8ead68b46f01e73d37. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.253:42889: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 01:50:03.200696 12894 raft_consensus.cc:2749] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.213563 12828 fs_manager.cc:714] Time spent opening directory manager: real 0.141s user 0.006s sys 0.000s
I20260925 01:50:03.214314 11753 tablet_bootstrap.cc:492] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.214570 11753 ts_tablet_manager.cc:1403] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260925 01:50:03.215286 11753 raft_consensus.cc:359] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.215754 11753 raft_consensus.cc:385] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.215862 11753 raft_consensus.cc:740] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.216197 11753 consensus_queue.cc:260] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.216771 11753 ts_tablet_manager.cc:1434] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:03.217132 11753 tablet_bootstrap.cc:492] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.218920 11753 tablet_bootstrap.cc:654] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.220896 11754 tablet_bootstrap.cc:492] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.221132 11754 ts_tablet_manager.cc:1403] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.150s user 0.019s sys 0.047s
I20260925 01:50:03.222157 11754 raft_consensus.cc:359] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:03.222390 11754 raft_consensus.cc:385] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.222499 11754 raft_consensus.cc:740] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.222793 11754 consensus_queue.cc:260] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:03.225606 11754 ts_tablet_manager.cc:1434] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260925 01:50:03.225962 11754 tablet_bootstrap.cc:492] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:03.227943 12689 ts_tablet_manager.cc:1929] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:03.228063 12689 log.cc:1199] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c28c8f00a8634ef89e4773b62e095b74
I20260925 01:50:03.228462 12689 ts_tablet_manager.cc:1950] T c28c8f00a8634ef89e4773b62e095b74 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.229384 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 615) took 1062 ms. Trace:
I20260925 01:50:03.229497 12689 rpcz_store.cc:276] 0925 01:50:02.166770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.171414 (+ 4644us) service_pool.cc:224] Handling call
0925 01:50:03.182753 (+1011339us) ts_tablet_manager.cc:1151] Deleting tablet c28c8f00a8634ef89e4773b62e095b74
0925 01:50:03.182769 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.206839 (+ 24070us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.227867 (+ 21028us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.229361 (+ 1494us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":956948}
I20260925 01:50:03.229998 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c28c8f00a8634ef89e4773b62e095b74 (table default.Table_6a8f6bbf5d5d430f89f28a60bf15e379 [id=bb36d144a12e4176974ca7119a4681c3]) successfully deleted
I20260925 01:50:03.232492 11754 tablet_bootstrap.cc:654] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.232528 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2428d63259334c4e96044516c1560465" } modify_external_catalogs: true
I20260925 01:50:03.232776 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2428d63259334c4e96044516c1560465" } modify_external_catalogs: true
I20260925 01:50:03.236680 11753 tablet_bootstrap.cc:492] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.236832 11753 ts_tablet_manager.cc:1403] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260925 01:50:03.239158 11753 raft_consensus.cc:359] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.239326 11753 raft_consensus.cc:385] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.239374 11753 raft_consensus.cc:740] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.239599 11753 consensus_queue.cc:260] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.242686 11753 ts_tablet_manager.cc:1434] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260925 01:50:03.242992 11753 tablet_bootstrap.cc:492] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.245260 11753 tablet_bootstrap.cc:654] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.237452 12689 tablet_replica.cc:333] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.248169 12689 raft_consensus.cc:2243] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.248397 12689 raft_consensus.cc:2272] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:03.248523 11456 consensus_peers.cc:597] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d7b3c65d8a64734b2c432790dae07e1. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.249044 12689 ts_tablet_manager.cc:1916] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.250723 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a0cea089195844d4a3f2e191f31d3750" } modify_external_catalogs: true
I20260925 01:50:03.251060 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a0cea089195844d4a3f2e191f31d3750" } modify_external_catalogs: true
I20260925 01:50:03.263255 11493 tablet_service.cc:1511] Processing CreateTablet for tablet b1cae40ea83e429f8d50958dcd0cdded (DEFAULT_TABLE table=default.Table_3b9c5f79b2e444938f2face578ece85a [id=f173fd094fbc44cebda85da683aa2720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.263700 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1cae40ea83e429f8d50958dcd0cdded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.263860 11204 tablet_service.cc:1511] Processing CreateTablet for tablet b1cae40ea83e429f8d50958dcd0cdded (DEFAULT_TABLE table=default.Table_3b9c5f79b2e444938f2face578ece85a [id=f173fd094fbc44cebda85da683aa2720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.264235 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1cae40ea83e429f8d50958dcd0cdded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.270660 12689 ts_tablet_manager.cc:1929] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.270795 12689 log.cc:1199] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8152c9e0b0af4ab2a18c5a0080e22ffc
I20260925 01:50:03.274909 11360 tablet_service.cc:1511] Processing CreateTablet for tablet b1cae40ea83e429f8d50958dcd0cdded (DEFAULT_TABLE table=default.Table_3b9c5f79b2e444938f2face578ece85a [id=f173fd094fbc44cebda85da683aa2720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:03.271106 12689 ts_tablet_manager.cc:1950] T 8152c9e0b0af4ab2a18c5a0080e22ffc P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.279304 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 614) took 1112 ms. Trace:
I20260925 01:50:03.279424 12689 rpcz_store.cc:276] 0925 01:50:02.166695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.169533 (+ 2838us) service_pool.cc:224] Handling call
0925 01:50:03.237385 (+1067852us) ts_tablet_manager.cc:1151] Deleting tablet 8152c9e0b0af4ab2a18c5a0080e22ffc
0925 01:50:03.237408 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.260695 (+ 23287us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.270597 (+ 9902us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.279273 (+ 8676us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1011492}
I20260925 01:50:03.280055 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8152c9e0b0af4ab2a18c5a0080e22ffc (table default.Table_3f87fc14acdb4b89927b49c8fb09c83d [id=46f2129d44b04761bcacacc0cbe6e932]) successfully deleted
I20260925 01:50:03.282316 12689 tablet_replica.cc:333] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.282585 12689 raft_consensus.cc:2243] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.282780 12689 raft_consensus.cc:2272] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.284504 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1cae40ea83e429f8d50958dcd0cdded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.286417 12689 ts_tablet_manager.cc:1916] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.289400 11755 tablet_bootstrap.cc:492] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:03.301149 11755 ts_tablet_manager.cc:1403] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.335s user 0.005s sys 0.005s
I20260925 01:50:03.303077 11753 tablet_bootstrap.cc:492] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.303298 11753 ts_tablet_manager.cc:1403] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.060s user 0.007s sys 0.012s
I20260925 01:50:03.304075 11753 raft_consensus.cc:359] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.304268 11753 raft_consensus.cc:385] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.304322 11753 raft_consensus.cc:740] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.305279 11754 tablet_bootstrap.cc:492] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.305523 11754 ts_tablet_manager.cc:1403] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.080s user 0.011s sys 0.009s
I20260925 01:50:03.306371 11754 raft_consensus.cc:359] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.306689 11754 raft_consensus.cc:385] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.306809 11754 raft_consensus.cc:740] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.306646 11755 raft_consensus.cc:359] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.307083 11755 raft_consensus.cc:385] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.307266 11755 raft_consensus.cc:740] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.307338 11754 consensus_queue.cc:260] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.307945 11755 consensus_queue.cc:260] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.309966 12689 ts_tablet_manager.cc:1929] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.310103 12689 log.cc:1199] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/93329036763146beb8e6a9b039cc1ec1
I20260925 01:50:03.310770 11753 consensus_queue.cc:260] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.311575 11753 ts_tablet_manager.cc:1434] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:50:03.311926 11753 tablet_bootstrap.cc:492] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.313768 11753 tablet_bootstrap.cc:654] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.310597 11754 ts_tablet_manager.cc:1434] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:03.310402 12689 ts_tablet_manager.cc:1950] T 93329036763146beb8e6a9b039cc1ec1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.325554 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 616) took 1099 ms. Trace:
I20260925 01:50:03.326272 12689 rpcz_store.cc:276] 0925 01:50:02.226335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.226397 (+ 62us) service_pool.cc:224] Handling call
0925 01:50:03.281985 (+1055588us) ts_tablet_manager.cc:1151] Deleting tablet 93329036763146beb8e6a9b039cc1ec1
0925 01:50:03.282001 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.303096 (+ 21095us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.309896 (+ 6800us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.325526 (+ 15630us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1018674}
I20260925 01:50:03.327304 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 93329036763146beb8e6a9b039cc1ec1 (table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]) successfully deleted
I20260925 01:50:03.327924 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 625) took 1043 ms. Trace:
I20260925 01:50:03.328158 11753 tablet_bootstrap.cc:492] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.328342 11753 ts_tablet_manager.cc:1403] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260925 01:50:03.329005 12689 rpcz_store.cc:276] 0925 01:50:02.284408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.284930 (+ 522us) service_pool.cc:224] Handling call
0925 01:50:03.327770 (+1042840us) ts_tablet_manager.cc:1151] Deleting tablet 3541e17b47bc47f5b69add361877a2bf
0925 01:50:03.327781 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.327905 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042639}
W20260925 01:50:03.329783 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 3541e17b47bc47f5b69add361877a2bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3541e17b47bc47f5b69add361877a2bf already in progress: creating tablet
I20260925 01:50:03.330276 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 626) took 1045 ms. Trace:
I20260925 01:50:03.331002 11753 raft_consensus.cc:359] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.331228 11753 raft_consensus.cc:385] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.331281 11753 raft_consensus.cc:740] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.331141 12689 rpcz_store.cc:276] 0925 01:50:02.284584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.285165 (+ 581us) service_pool.cc:224] Handling call
0925 01:50:03.330155 (+1044990us) ts_tablet_manager.cc:1151] Deleting tablet ab8d5af739854f939ab585d943e7b7ca
0925 01:50:03.330164 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.330243 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1044855}
I20260925 01:50:03.331547 11753 consensus_queue.cc:260] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.331809 12940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260925 01:50:03.331986 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ab8d5af739854f939ab585d943e7b7ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab8d5af739854f939ab585d943e7b7ca already in progress: creating tablet
I20260925 01:50:03.333825 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 624) took 1069 ms. Trace:
I20260925 01:50:03.333964 12689 rpcz_store.cc:276] 0925 01:50:02.264730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.265283 (+ 553us) service_pool.cc:224] Handling call
0925 01:50:03.333713 (+1068430us) ts_tablet_manager.cc:1151] Deleting tablet c2fa459a53a54f47be961067736d2d16
0925 01:50:03.333724 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.333808 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1035346}
W20260925 01:50:03.334575 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c2fa459a53a54f47be961067736d2d16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2fa459a53a54f47be961067736d2d16 already in progress: creating tablet
I20260925 01:50:03.335009 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 631) took 1030 ms. Trace:
I20260925 01:50:03.335142 12689 rpcz_store.cc:276] 0925 01:50:02.304903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.305455 (+ 552us) service_pool.cc:224] Handling call
0925 01:50:03.334902 (+1029447us) ts_tablet_manager.cc:1151] Deleting tablet a8c46e780d4a4987ad52619e4c3b46c9
0925 01:50:03.334912 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.334993 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1029222}
W20260925 01:50:03.335665 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a8c46e780d4a4987ad52619e4c3b46c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8c46e780d4a4987ad52619e4c3b46c9 already in progress: creating tablet
I20260925 01:50:03.336074 12689 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 630) took 1031 ms. Trace:
I20260925 01:50:03.337920 11753 ts_tablet_manager.cc:1434] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260925 01:50:03.338395 12689 rpcz_store.cc:276] 0925 01:50:02.304810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.310113 (+ 5303us) service_pool.cc:224] Handling call
0925 01:50:03.335967 (+1025854us) ts_tablet_manager.cc:1151] Deleting tablet fcb56153a802427aaebbf55a8193d62b
0925 01:50:03.335979 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.336057 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1025666}
W20260925 01:50:03.338999 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet fcb56153a802427aaebbf55a8193d62b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcb56153a802427aaebbf55a8193d62b already in progress: creating tablet
W20260925 01:50:03.339697 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bd594870fa6a4ba190a18a48d821d72c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd594870fa6a4ba190a18a48d821d72c already in progress: creating tablet
W20260925 01:50:03.340351 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bf8bd1bfa4db4706b545829d6d26b660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf8bd1bfa4db4706b545829d6d26b660 already in progress: creating tablet
W20260925 01:50:03.341003 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 53d30f4940c44bcf900a8cf0de91a66d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53d30f4940c44bcf900a8cf0de91a66d already in progress: creating tablet
W20260925 01:50:03.342115 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bd22b1eb643f4229a65566493e21d96c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd22b1eb643f4229a65566493e21d96c already in progress: creating tablet
W20260925 01:50:03.342778 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 98a94b6345ca427180e8f4e4b279efcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98a94b6345ca427180e8f4e4b279efcf already in progress: creating tablet
I20260925 01:50:03.342954 11753 tablet_bootstrap.cc:492] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.344741 11753 tablet_bootstrap.cc:654] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:03.344909 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 501f41a3ee1d440bb07033e29c38bc7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 501f41a3ee1d440bb07033e29c38bc7a already in progress: creating tablet
W20260925 01:50:03.345597 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1575d0eb9ed64653b317edefd24f7dfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1575d0eb9ed64653b317edefd24f7dfd already in progress: creating tablet
I20260925 01:50:03.349779 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_5e9bceacc719454ab66e9ae7f9942c69 [id=9efec48de98e40be93706911d8bdae7b] alter complete (version 2)
W20260925 01:50:03.350329 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 0c01195f07b84b359a974fab5ed52582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c01195f07b84b359a974fab5ed52582 already in progress: creating tablet
I20260925 01:50:03.350571 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_19c88af560ee4b8ea34d884da9fb699c" } modify_external_catalogs: true
W20260925 01:50:03.350930 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 7a5c9dac783d4ef3a24cb65275ff484f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a5c9dac783d4ef3a24cb65275ff484f already in progress: creating tablet
I20260925 01:50:03.351679 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c8f00a8634ef89e4773b62e095b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.351686 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b51b36266e424f8fa78dbf4ac8180c71" } modify_external_catalogs: true
W20260925 01:50:03.351950 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 018f68f800c9489a846c3b1b3ee3fa2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018f68f800c9489a846c3b1b3ee3fa2d already in progress: creating tablet
W20260925 01:50:03.352555 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 6ff85bac0d22416987e8e3b379154b09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ff85bac0d22416987e8e3b379154b09 already in progress: creating tablet
I20260925 01:50:03.352835 12689 tablet_replica.cc:333] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.353034 12689 raft_consensus.cc:2243] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.353190 12689 raft_consensus.cc:2272] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.355494 11753 tablet_bootstrap.cc:492] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.355676 11753 ts_tablet_manager.cc:1403] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260925 01:50:03.356457 11753 raft_consensus.cc:359] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.356694 11753 raft_consensus.cc:385] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.356801 11753 raft_consensus.cc:740] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.357086 12689 ts_tablet_manager.cc:1916] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.357125 11753 consensus_queue.cc:260] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.357882 12894 raft_consensus.cc:493] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.358047 12894 raft_consensus.cc:515] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.358839 12894 leader_election.cc:290] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.359817 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1abd3c2cb34915a595ea73a8d10743" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:03.359927 11753 ts_tablet_manager.cc:1434] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:03.360023 11516 raft_consensus.cc:2468] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:03.360235 11753 tablet_bootstrap.cc:492] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.361435 11176 leader_election.cc:304] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.362016 11753 tablet_bootstrap.cc:654] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.362145 12894 raft_consensus.cc:2804] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.362243 12894 raft_consensus.cc:493] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.362321 12894 raft_consensus.cc:3060] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.365854 12894 raft_consensus.cc:515] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.370926 12689 ts_tablet_manager.cc:1929] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.371040 12689 log.cc:1199] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/96b68399843a422b8da3ddfab2c522e6
I20260925 01:50:03.371331 12689 ts_tablet_manager.cc:1950] T 96b68399843a422b8da3ddfab2c522e6 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.372408 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 96b68399843a422b8da3ddfab2c522e6 (table default.Table_7ad0a76f459148b29a5a3c029573cc5b [id=74fd2e729fe648ab90e6e4e9876d28f0]) successfully deleted
I20260925 01:50:03.375110 12828 fs_manager.cc:730] Time spent opening block manager: real 0.158s user 0.010s sys 0.012s
I20260925 01:50:03.375366 12828 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data,/tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
uuid: "ec2f98d6295c4f8ead68b46f01e73d37"
format_stamp: "Formatted at 2026-09-25 01:49:37 on dist-test-slave-xxxl"
I20260925 01:50:03.376503 12828 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260925 01:50:03.377337 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet c28c8f00a8634ef89e4773b62e095b74 because the tablet was not found. No further retry: Not found: Tablet not found: c28c8f00a8634ef89e4773b62e095b74
I20260925 01:50:03.378371 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1abd3c2cb34915a595ea73a8d10743" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:03.378480 11753 tablet_bootstrap.cc:492] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.378543 11516 raft_consensus.cc:3060] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.378598 11753 ts_tablet_manager.cc:1403] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260925 01:50:03.379035 12894 leader_election.cc:290] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.379336 11753 raft_consensus.cc:359] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:03.379491 11753 raft_consensus.cc:385] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.379536 11753 raft_consensus.cc:740] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.379767 11753 consensus_queue.cc:260] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:03.381349 11516 raft_consensus.cc:2468] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:03.382400 11753 ts_tablet_manager.cc:1434] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:03.382674 11753 tablet_bootstrap.cc:492] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.383361 11946 ts_tablet_manager.cc:1929] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.383944 11946 log.cc:1199] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/30a5240093dd442a93bff006a965bc41
I20260925 01:50:03.384284 11176 leader_election.cc:304] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.384573 11753 tablet_bootstrap.cc:654] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.398264 11753 tablet_bootstrap.cc:492] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.398535 11753 ts_tablet_manager.cc:1403] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260925 01:50:03.399266 11753 raft_consensus.cc:359] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.399518 11753 raft_consensus.cc:385] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.399606 11753 raft_consensus.cc:740] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.399904 11753 consensus_queue.cc:260] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.384860 12894 raft_consensus.cc:2804] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.400933 11753 ts_tablet_manager.cc:1434] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:03.401314 12894 raft_consensus.cc:697] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:03.402323 11753 tablet_bootstrap.cc:492] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.404023 11753 tablet_bootstrap.cc:654] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.403697 12894 consensus_queue.cc:237] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.414630 11755 ts_tablet_manager.cc:1434] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.109s user 0.001s sys 0.002s
I20260925 01:50:03.416805 11753 tablet_bootstrap.cc:492] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.417052 11753 ts_tablet_manager.cc:1403] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260925 01:50:03.416837 11755 tablet_bootstrap.cc:492] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:03.417991 11753 raft_consensus.cc:359] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:03.418265 11753 raft_consensus.cc:385] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.418352 11753 raft_consensus.cc:740] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.418635 11753 consensus_queue.cc:260] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:03.419292 11753 ts_tablet_manager.cc:1434] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:03.419615 11753 tablet_bootstrap.cc:492] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.421422 11753 tablet_bootstrap.cc:654] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.421650 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1abd3c2cb34915a595ea73a8d10743" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.422674 11177 leader_election.cc:343] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.423506 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1abd3c2cb34915a595ea73a8d10743" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:03.424134 12850 raft_consensus.cc:493] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.424257 12850 raft_consensus.cc:515] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.424692 11177 leader_election.cc:343] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.424858 12850 leader_election.cc:290] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:03.426017 11456 leader_election.cc:343] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8152c9e0b0af4ab2a18c5a0080e22ffc
I20260925 01:50:03.436664 11753 tablet_bootstrap.cc:492] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.436887 11753 ts_tablet_manager.cc:1403] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260925 01:50:03.437649 11753 raft_consensus.cc:359] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.437872 11753 raft_consensus.cc:385] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.437969 11753 raft_consensus.cc:740] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.438278 11753 consensus_queue.cc:260] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.438189 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b51b36266e424f8fa78dbf4ac8180c71" } modify_external_catalogs: true
I20260925 01:50:03.441967 11753 ts_tablet_manager.cc:1434] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260925 01:50:03.442335 11753 tablet_bootstrap.cc:492] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.443970 12947 raft_consensus.cc:493] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:03.444125 12947 raft_consensus.cc:515] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:03.444721 12947 leader_election.cc:290] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:03.447106 11753 tablet_bootstrap.cc:654] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.440302 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ea10c9a7e20b48c69eb5f24631403e93
I20260925 01:50:03.449159 11672 catalog_manager.cc:6934] ReplaceTablet: tablet ea10c9a7e20b48c69eb5f24631403e93 deleted and replaced by tablet 7d9faca745994fa7944e2232049a2105
I20260925 01:50:03.449656 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet ea10c9a7e20b48c69eb5f24631403e93 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d9faca745994fa7944e2232049a2105) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.449977 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet ea10c9a7e20b48c69eb5f24631403e93 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d9faca745994fa7944e2232049a2105) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.449955 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3ecdc7c64ae449629e81d8bb5f1257e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.450580 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ecdc7c64ae449629e81d8bb5f1257e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:03.451512 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ea10c9a7e20b48c69eb5f24631403e93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea10c9a7e20b48c69eb5f24631403e93 already in progress: creating tablet
I20260925 01:50:03.440366 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_19c88af560ee4b8ea34d884da9fb699c" } modify_external_catalogs: true
I20260925 01:50:03.441113 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c361990e57274e58b9e99c7086a27792" } modify_external_catalogs: true
I20260925 01:50:03.453033 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c361990e57274e58b9e99c7086a27792" } modify_external_catalogs: true
I20260925 01:50:03.454762 12781 raft_consensus.cc:493] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:03.455044 12781 raft_consensus.cc:515] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.456444 12781 leader_election.cc:290] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:03.457453 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet ea10c9a7e20b48c69eb5f24631403e93 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d9faca745994fa7944e2232049a2105) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.457887 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504185484c04a5e9f221d2826e99418. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:03.437956 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7da55c488da540048a94324fa347c1ef (table default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17]). Expected version 5 got 0
I20260925 01:50:03.462025 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:03.465158 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.465464 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet a9944a1422d14ae2b22451e67c477d5b with delete_type TABLET_DATA_DELETED (replaced by tablet c86a78873e8847fa95bead4774bea606) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.465693 12689 tablet_replica.cc:333] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.467384 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:03.467850 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 176e572f77e242d799c334820579268d (table default.Table_5db64fc4070a45f0adc4c8234951e1bf [id=4ae41188fe5546918a2ec8cfb40e6ebc]). Expected version 2 got 0
I20260925 01:50:03.468760 11753 tablet_bootstrap.cc:492] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:03.469066 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 320640us
I20260925 01:50:03.469134 11753 ts_tablet_manager.cc:1403] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.001s
I20260925 01:50:03.470314 11753 raft_consensus.cc:359] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.470566 11753 raft_consensus.cc:385] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.470657 11753 raft_consensus.cc:740] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.470952 11753 consensus_queue.cc:260] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.471709 11753 ts_tablet_manager.cc:1434] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:03.472039 11753 tablet_bootstrap.cc:492] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.472361 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.472924 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.473007 12850 raft_consensus.cc:493] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.473115 12850 raft_consensus.cc:515] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.473209 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 8152c9e0b0af4ab2a18c5a0080e22ffc with delete_type TABLET_DATA_DELETED (replaced by tablet b8f82aa815bd42bdbf70a673e3a4c9da) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.473657 12850 leader_election.cc:290] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.473742 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 with delete_type TABLET_DATA_DELETED (replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.474443 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9c9ea2d22ad643308cc531459234f13b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.475142 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c9ea2d22ad643308cc531459234f13b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.479087 11754 tablet_bootstrap.cc:492] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:03.480758 11754 tablet_bootstrap.cc:654] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.481773 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 75a8e09b8838443c9bfff440ff1f877d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:03.482878 11456 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:03.483902 11953 ts_tablet_manager.cc:1929] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:03.484084 11953 log.cc:1199] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ba19192502634f8599407d923114a627
I20260925 01:50:03.484618 11953 ts_tablet_manager.cc:1950] T ba19192502634f8599407d923114a627 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:03.485488 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 278) took 10706 ms. Trace:
I20260925 01:50:03.485630 11953 rpcz_store.cc:276] 0925 01:49:52.778743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:52.778808 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:03.171407 (+10392599us) ts_tablet_manager.cc:1151] Deleting tablet ba19192502634f8599407d923114a627
0925 01:50:03.171419 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.429891 (+258472us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.483835 (+ 53944us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.485457 (+ 1622us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10392178}
I20260925 01:50:03.486285 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ba19192502634f8599407d923114a627 (table default.Table_aa19d1dd3fd24b70a6ac5137dd79e7be [id=a7a4cdc91d934debaa67cf892135a915]) successfully deleted
I20260925 01:50:03.486768 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 280) took 10124 ms. Trace:
I20260925 01:50:03.486937 11953 rpcz_store.cc:276] 0925 01:49:53.361852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.362372 (+ 520us) service_pool.cc:224] Handling call
0925 01:50:03.486629 (+10124257us) ts_tablet_manager.cc:1151] Deleting tablet 031687d4b26b4c7889dfbe3485c9f4c5
0925 01:50:03.486639 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.486752 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10124004}
I20260925 01:50:03.490408 11946 ts_tablet_manager.cc:1950] T 30a5240093dd442a93bff006a965bc41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:03.490525 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 031687d4b26b4c7889dfbe3485c9f4c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 031687d4b26b4c7889dfbe3485c9f4c5 already in progress: creating tablet
I20260925 01:50:03.490847 11753 tablet_bootstrap.cc:654] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.491015 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 283) took 10128 ms. Trace:
I20260925 01:50:03.491139 11953 rpcz_store.cc:276] 0925 01:49:53.362201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.370115 (+ 7914us) service_pool.cc:224] Handling call
0925 01:50:03.490855 (+10120740us) ts_tablet_manager.cc:1151] Deleting tablet 0b92054aaa704c7ebd6b075c30db2616
0925 01:50:03.490864 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.490998 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10120428}
I20260925 01:50:03.491349 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 533) took 2759 ms. Trace:
I20260925 01:50:03.491444 11946 rpcz_store.cc:276] 0925 01:50:00.732143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.732217 (+ 74us) service_pool.cc:224] Handling call
0925 01:50:03.115061 (+2382844us) ts_tablet_manager.cc:1151] Deleting tablet 30a5240093dd442a93bff006a965bc41
0925 01:50:03.115069 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.203739 (+ 88670us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.383052 (+179313us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.491328 (+108276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2382644}
I20260925 01:50:03.491843 11946 tablet_replica.cc:333] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:03.492096 11946 raft_consensus.cc:2243] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:03.492434 11946 pending_rounds.cc:70] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:03.492498 11946 pending_rounds.cc:77] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072905411149824 op_type: NO_OP noop_request { }
I20260925 01:50:03.492614 11946 raft_consensus.cc:2889] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:03.492705 11946 raft_consensus.cc:2272] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.493399 11946 ts_tablet_manager.cc:1916] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.494530 12850 raft_consensus.cc:493] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.494654 12850 raft_consensus.cc:515] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:03.495299 12850 leader_election.cc:290] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:03.496158 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c29e410731842aeb64ab8eeb4ccc3ca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:03.496337 11239 raft_consensus.cc:2468] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:03.496797 11456 leader_election.cc:304] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.497375 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 30a5240093dd442a93bff006a965bc41 (table default.Table_1ffecf54f1b3464eae523b831ac20bc0 [id=61d8ea1b10c44d6eb92474186b70df53]) successfully deleted
I20260925 01:50:03.497797 12850 raft_consensus.cc:2804] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.497866 12850 raft_consensus.cc:493] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.497931 12850 raft_consensus.cc:3060] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:03.499667 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8234c4d0c72541158826416e40f34031 consensus state has no leader
I20260925 01:50:03.500638 11754 tablet_bootstrap.cc:492] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.500773 11754 ts_tablet_manager.cc:1403] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.005s
I20260925 01:50:03.500953 12850 raft_consensus.cc:515] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:03.501829 11754 raft_consensus.cc:359] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.501984 11754 raft_consensus.cc:385] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.502034 11754 raft_consensus.cc:740] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.502290 11754 consensus_queue.cc:260] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.503109 11754 ts_tablet_manager.cc:1434] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:03.503398 11754 tablet_bootstrap.cc:492] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:03.505024 11754 tablet_bootstrap.cc:654] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:03.508745 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 0b92054aaa704c7ebd6b075c30db2616 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b92054aaa704c7ebd6b075c30db2616 already in progress: creating tablet
I20260925 01:50:03.509224 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 286) took 10116 ms. Trace:
I20260925 01:50:03.511260 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c29e410731842aeb64ab8eeb4ccc3ca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:03.511435 11236 raft_consensus.cc:3060] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.511754 11953 rpcz_store.cc:276] 0925 01:49:53.392900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.398225 (+ 5325us) service_pool.cc:224] Handling call
0925 01:50:03.509092 (+10110867us) ts_tablet_manager.cc:1151] Deleting tablet 81024a75b31e45e098d108bae4cc17c9
0925 01:50:03.509103 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.509207 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10110638}
W20260925 01:50:03.512375 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 81024a75b31e45e098d108bae4cc17c9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81024a75b31e45e098d108bae4cc17c9 already in progress: creating tablet
I20260925 01:50:03.514735 11236 raft_consensus.cc:2468] T 1c29e410731842aeb64ab8eeb4ccc3ca P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:03.515291 11456 leader_election.cc:304] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.515561 12508 raft_consensus.cc:2804] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.518124 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 75a8e09b8838443c9bfff440ff1f877d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:48 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.519373 11753 tablet_bootstrap.cc:492] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.519620 11753 ts_tablet_manager.cc:1403] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260925 01:50:03.520562 11753 raft_consensus.cc:359] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.520799 11753 raft_consensus.cc:385] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.520906 11753 raft_consensus.cc:740] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.521253 11753 consensus_queue.cc:260] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.522548 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 287) took 10111 ms. Trace:
I20260925 01:50:03.522636 12850 leader_election.cc:290] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:03.524432 11953 rpcz_store.cc:276] 0925 01:49:53.411289 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.411345 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:03.522386 (+10111041us) ts_tablet_manager.cc:1151] Deleting tablet 829d167dc0214890b722c0197500f159
0925 01:50:03.522410 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.522527 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10109310}
W20260925 01:50:03.524976 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 829d167dc0214890b722c0197500f159 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 829d167dc0214890b722c0197500f159 already in progress: creating tablet
I20260925 01:50:03.525308 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 288) took 10100 ms. Trace:
I20260925 01:50:03.525395 11953 rpcz_store.cc:276] 0925 01:49:53.424611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:53.424663 (+ 52us) service_pool.cc:224] Handling call
0925 01:50:03.525181 (+10100518us) ts_tablet_manager.cc:1151] Deleting tablet 9771b89303094974902c4ad1f1c8608e
0925 01:50:03.525193 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.525292 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10070942}
I20260925 01:50:03.526383 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 303) took 9392 ms. Trace:
I20260925 01:50:03.526465 11953 rpcz_store.cc:276] 0925 01:49:54.134247 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.134380 (+ 133us) service_pool.cc:224] Handling call
0925 01:50:03.526274 (+9391894us) ts_tablet_manager.cc:1151] Deleting tablet 04f412cbebe04a629070aecf2753287c
0925 01:50:03.526284 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.526366 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9391600}
I20260925 01:50:03.527155 12933 raft_consensus.cc:493] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.527266 12933 raft_consensus.cc:515] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.527395 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9771b89303094974902c4ad1f1c8608e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9771b89303094974902c4ad1f1c8608e already in progress: creating tablet
I20260925 01:50:03.527850 12933 leader_election.cc:290] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:03.529789 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 304) took 9355 ms. Trace:
I20260925 01:50:03.529866 11953 rpcz_store.cc:276] 0925 01:49:54.173973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.174046 (+ 73us) service_pool.cc:224] Handling call
0925 01:50:03.529693 (+9355647us) ts_tablet_manager.cc:1151] Deleting tablet 148f74b071c6420f8c78278c0cb37738
0925 01:50:03.529702 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.529773 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9355303}
W20260925 01:50:03.531497 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 148f74b071c6420f8c78278c0cb37738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 148f74b071c6420f8c78278c0cb37738 already in progress: creating tablet
I20260925 01:50:03.532039 12689 raft_consensus.cc:2243] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:03.532560 12689 pending_rounds.cc:70] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:03.533610 11755 tablet_bootstrap.cc:654] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.532627 12689 pending_rounds.cc:77] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072909960933376 op_type: NO_OP noop_request { }
I20260925 01:50:03.534511 12689 raft_consensus.cc:2889] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:03.534622 12689 raft_consensus.cc:2272] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.535032 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 310) took 9236 ms. Trace:
I20260925 01:50:03.535125 11953 rpcz_store.cc:276] 0925 01:49:54.298811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.298876 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:03.534928 (+9236052us) ts_tablet_manager.cc:1151] Deleting tablet 33967e5e11524b78bb86ce7a3e2e16ad
0925 01:50:03.534936 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.535016 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9228544}
W20260925 01:50:03.535545 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 33967e5e11524b78bb86ce7a3e2e16ad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33967e5e11524b78bb86ce7a3e2e16ad already in progress: creating tablet
W20260925 01:50:03.535861 12954 consensus_queue.cc:1175] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b93565e796c94a3699eb1824383bbaeb" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260925 01:50:03.536185 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c9e0b0af4ab2a18c5a0080e22ffc" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.536795 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a8e09b8838443c9bfff440ff1f877d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.536798 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0f1bffe2143d4a17b283c6fa0b3aa0e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:03.536957 11372 raft_consensus.cc:2468] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:50:03.537513 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f1bffe2143d4a17b283c6fa0b3aa0e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.537726 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 312) took 9117 ms. Trace:
I20260925 01:50:03.537793 11953 rpcz_store.cc:276] 0925 01:49:54.420653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.420733 (+ 80us) service_pool.cc:224] Handling call
0925 01:50:03.537618 (+9116885us) ts_tablet_manager.cc:1151] Deleting tablet a8055cc9b06045449e6133298c8074e1
0925 01:50:03.537627 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.537707 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9110721}
I20260925 01:50:03.538210 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c29e410731842aeb64ab8eeb4ccc3ca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.538769 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c29e410731842aeb64ab8eeb4ccc3ca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:03.539376 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a8055cc9b06045449e6133298c8074e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8055cc9b06045449e6133298c8074e1 already in progress: creating tablet
W20260925 01:50:03.539376 11314 leader_election.cc:343] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 331380a2be9a4893927c9b94a2c3e08b
I20260925 01:50:03.539489 11314 leader_election.cc:304] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.539987 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 316) took 9112 ms. Trace:
I20260925 01:50:03.540069 11953 rpcz_store.cc:276] 0925 01:49:54.427353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.427608 (+ 255us) service_pool.cc:224] Handling call
0925 01:50:03.539890 (+9112282us) ts_tablet_manager.cc:1151] Deleting tablet b91957f62d8044ea8f6a3464c84b9e10
0925 01:50:03.539899 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.539973 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9108843}
W20260925 01:50:03.540445 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b91957f62d8044ea8f6a3464c84b9e10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b91957f62d8044ea8f6a3464c84b9e10 already in progress: creating tablet
W20260925 01:50:03.540395 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 49702.2us
I20260925 01:50:03.540547 12933 raft_consensus.cc:2749] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:03.540964 11314 consensus_peers.cc:597] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba378e9d37c64a8ebd56894b2101ed8f. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.544847 11953 tablet_replica.cc:333] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:03.545043 11953 raft_consensus.cc:2243] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:50:03.546828 11314 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: bfa2e2d4bfe14b5db5b1dfd67e19f11c
W20260925 01:50:03.547004 11314 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 039ee80a2822417898c1d1d779f52867
I20260925 01:50:03.548329 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 49692d2824a34f48a4dcefad8c89618b
I20260925 01:50:03.549237 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 49692d2824a34f48a4dcefad8c89618b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.549918 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 49692d2824a34f48a4dcefad8c89618b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.550674 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 49692d2824a34f48a4dcefad8c89618b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.551297 11953 pending_rounds.cc:70] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:50:03.551532 11953 pending_rounds.cc:77] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072908923998208 op_type: NO_OP noop_request { }
I20260925 01:50:03.552192 11953 raft_consensus.cc:2889] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:03.469933 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7948cfa6f9c44365859c26d788fbd1d6" } new_table_name: "default.Table_1ade0ea78b1e41e5ab63a12b77b5d46d" modify_external_catalogs: true
I20260925 01:50:03.552974 12689 ts_tablet_manager.cc:1916] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.554909 11953 raft_consensus.cc:2272] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.558202 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a8e09b8838443c9bfff440ff1f877d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:03.558461 11516 raft_consensus.cc:2468] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:03.558490 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7825567ce8ce424aab880bd345cf3c3d" } new_table_name: "default.Table_a5b2fd6126ae4a30affdca9a5fd34821" modify_external_catalogs: true
I20260925 01:50:03.558048 11953 ts_tablet_manager.cc:1916] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.559983 12967 consensus_queue.cc:1048] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:50:03.563581 11457 leader_election.cc:343] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.563696 11457 leader_election.cc:304] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:03.563942 11314 leader_election.cc:343] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:50:03.564024 11457 leader_election.cc:304] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.564045 11314 leader_election.cc:304] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:03.564292 11457 leader_election.cc:343] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:03.564522 11457 leader_election.cc:343] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.564985 12967 raft_consensus.cc:2749] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.565135 12933 raft_consensus.cc:2749] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:03.565461 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f46004be36b543a395a783a13b1b14cf
I20260925 01:50:03.565557 12967 raft_consensus.cc:2804] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.565631 12967 raft_consensus.cc:493] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.565687 12967 raft_consensus.cc:3060] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.566859 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet f46004be36b543a395a783a13b1b14cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.567039 12689 ts_tablet_manager.cc:1929] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:03.567147 12689 log.cc:1199] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8c1abd3c2cb34915a595ea73a8d10743
W20260925 01:50:03.567440 11314 leader_election.cc:343] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 039ee80a2822417898c1d1d779f52867
I20260925 01:50:03.567508 12689 ts_tablet_manager.cc:1950] T 8c1abd3c2cb34915a595ea73a8d10743 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.568095 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet f46004be36b543a395a783a13b1b14cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.568225 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet f46004be36b543a395a783a13b1b14cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.568853 11314 leader_election.cc:304] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.569242 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8c1abd3c2cb34915a595ea73a8d10743 (table default.Table_5036ab1f1580484c8b9367dfab1a8a84 [id=a7cc09b27b1b463a982f1f4266bdf7fd]) successfully deleted
I20260925 01:50:03.569587 12689 tablet_replica.cc:333] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.569612 12850 raft_consensus.cc:493] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.569756 12850 raft_consensus.cc:515] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.569864 12689 raft_consensus.cc:2243] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.570097 12689 raft_consensus.cc:2272] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.570511 12850 leader_election.cc:290] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.571004 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff85bac0d22416987e8e3b379154b09" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:03.571615 11456 leader_election.cc:343] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.571851 12508 raft_consensus.cc:697] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:03.572225 12508 consensus_queue.cc:237] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:03.573823 12967 raft_consensus.cc:515] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.574169 12933 raft_consensus.cc:2749] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:03.574781 12689 ts_tablet_manager.cc:1916] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.575438 12912 tablet.cc:1751] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:03.580108 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_343ef1b070164793ac65033e6aabf977"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:03.576917 12963 raft_consensus.cc:493] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.580390 12963 raft_consensus.cc:515] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.580994 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_343ef1b070164793ac65033e6aabf977 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:03.581565 11456 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:03.581647 12967 leader_election.cc:290] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.582886 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c4a23d974f4daea7a274eccd661d5c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:03.582894 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 with delete_type TABLET_DATA_DELETED (replaced by tablet a8055cc9b06045449e6133298c8074e1) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.583266 11236 raft_consensus.cc:2468] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:03.583722 11456 leader_election.cc:304] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.584223 12963 leader_election.cc:290] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.584410 12963 raft_consensus.cc:2804] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.584504 12963 raft_consensus.cc:493] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.584599 12963 raft_consensus.cc:3060] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.587844 12963 raft_consensus.cc:515] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.589630 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c4a23d974f4daea7a274eccd661d5c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:03.589857 11236 raft_consensus.cc:3060] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.594206 11314 leader_election.cc:304] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:50:03.595701 12933 raft_consensus.cc:2804] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.595799 12933 raft_consensus.cc:493] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.595870 12933 raft_consensus.cc:3060] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.598654 12933 raft_consensus.cc:515] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.599339 12933 leader_election.cc:290] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:03.601660 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 728157ec17ed4df5a4a8559df6c1ac78
I20260925 01:50:03.607455 12967 raft_consensus.cc:493] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.607730 12967 raft_consensus.cc:515] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.607995 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.608223 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.608412 11753 ts_tablet_manager.cc:1434] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.089s user 0.001s sys 0.008s
I20260925 01:50:03.608477 12967 leader_election.cc:290] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.609148 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60706e2087b4ec7b63f6747534a4b0f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:03.609346 11238 raft_consensus.cc:2468] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:03.608727 11753 tablet_bootstrap.cc:492] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.610005 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a8e09b8838443c9bfff440ff1f877d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:03.610219 11522 raft_consensus.cc:2393] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in this term.
I20260925 01:50:03.610028 12828 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260925 01:50:03.611289 11456 leader_election.cc:304] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.611769 12967 raft_consensus.cc:2804] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.611971 11753 tablet_bootstrap.cc:654] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.612038 12967 raft_consensus.cc:493] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.612169 12828 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 01:50:03.612591 12967 raft_consensus.cc:3060] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.612839 12828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 01:50:03.616298 12967 raft_consensus.cc:515] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.617678 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f92450c05b394603ba475328d5a3eb71
I20260925 01:50:03.617981 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60706e2087b4ec7b63f6747534a4b0f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:03.618230 11238 raft_consensus.cc:3060] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.619144 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet f92450c05b394603ba475328d5a3eb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.619557 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2f4382db373943b6bc9420f53b562dd6" } new_table_name: "default.Table_b90907533e8c44c197c71f7dc9266cfe" modify_external_catalogs: true
I20260925 01:50:03.619930 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet f92450c05b394603ba475328d5a3eb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.621378 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bd28b864a15442ddbc1f52dcbf3f6915"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:03.621556 11238 raft_consensus.cc:2468] T b60706e2087b4ec7b63f6747534a4b0f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:03.622020 11456 leader_election.cc:304] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:50:03.622279 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd28b864a15442ddbc1f52dcbf3f6915 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.622903 12964 raft_consensus.cc:2804] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.623162 12964 raft_consensus.cc:697] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:03.623519 12964 consensus_queue.cc:237] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.624231 11456 consensus_peers.cc:597] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93329036763146beb8e6a9b039cc1ec1. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.625022 12967 leader_election.cc:290] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.627418 11753 tablet_bootstrap.cc:492] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.627628 11753 ts_tablet_manager.cc:1403] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260925 01:50:03.629688 11753 raft_consensus.cc:359] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.630213 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.630426 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet f92450c05b394603ba475328d5a3eb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:03.631120 11754 tablet_bootstrap.cc:492] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.631240 11754 ts_tablet_manager.cc:1403] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.128s user 0.015s sys 0.011s
I20260925 01:50:03.631443 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c4a23d974f4daea7a274eccd661d5c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.631624 11370 raft_consensus.cc:2468] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:50:03.631716 11314 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 75a8e09b8838443c9bfff440ff1f877d
W20260925 01:50:03.632056 11314 consensus_peers.cc:597] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 784de8c6e6e1434a91106dd19cd9262a. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.632041 11754 raft_consensus.cc:359] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.632200 11754 raft_consensus.cc:385] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.632242 11754 raft_consensus.cc:740] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:50:03.632357 11314 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:03.632432 11754 consensus_queue.cc:260] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.632747 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c4a23d974f4daea7a274eccd661d5c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:03.632890 11379 raft_consensus.cc:3060] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.633085 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60706e2087b4ec7b63f6747534a4b0f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.633437 12705 consensus_queue.cc:1048] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:03.636621 11754 ts_tablet_manager.cc:1434] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:50:03.637070 11754 tablet_bootstrap.cc:492] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:03.638828 11314 leader_election.cc:304] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.632491 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a8e09b8838443c9bfff440ff1f877d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:03.639135 11377 raft_consensus.cc:2393] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:50:03.639195 11754 tablet_bootstrap.cc:654] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.632292 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff85bac0d22416987e8e3b379154b09" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.638821 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60706e2087b4ec7b63f6747534a4b0f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:03.639804 12782 raft_consensus.cc:2749] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.641422 11753 raft_consensus.cc:385] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:03.636705 11456 consensus_peers.cc:597] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45a794ad0d87475a88efc02f5ae080f4. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.641582 11753 raft_consensus.cc:740] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:03.639645 11457 leader_election.cc:343] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.641839 11753 consensus_queue.cc:260] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.642319 11457 leader_election.cc:304] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.642447 11753 ts_tablet_manager.cc:1434] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
W20260925 01:50:03.642772 11457 leader_election.cc:343] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.642941 11457 leader_election.cc:304] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.643219 12850 raft_consensus.cc:2749] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260925 01:50:03.643324 11457 leader_election.cc:343] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.643455 12850 raft_consensus.cc:2749] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.643740 12850 consensus_queue.cc:1048] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:03.645251 11379 raft_consensus.cc:2468] T 41c4a23d974f4daea7a274eccd661d5c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:03.645872 11953 ts_tablet_manager.cc:1929] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:03.645982 11953 log.cc:1199] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/90647937eb364a7a973d04ea69cbc9aa
I20260925 01:50:03.646292 11457 leader_election.cc:304] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
I20260925 01:50:03.646785 11953 ts_tablet_manager.cc:1950] T 90647937eb364a7a973d04ea69cbc9aa P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:03.646907 12850 raft_consensus.cc:2804] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.647056 12850 raft_consensus.cc:697] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:03.647344 12850 consensus_queue.cc:237] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.642774 11753 tablet_bootstrap.cc:492] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.651064 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 313) took 9224 ms. Trace:
I20260925 01:50:03.653090 11753 tablet_bootstrap.cc:654] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.653576 11953 rpcz_store.cc:276] 0925 01:49:54.427011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.428072 (+ 1061us) service_pool.cc:224] Handling call
0925 01:50:03.544801 (+9116729us) ts_tablet_manager.cc:1151] Deleting tablet 90647937eb364a7a973d04ea69cbc9aa
0925 01:50:03.544810 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.628961 (+ 84151us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.645806 (+ 16845us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.651042 (+ 5236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6003,"tablet-delete.queue_time_us":9108564}
I20260925 01:50:03.654709 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 90647937eb364a7a973d04ea69cbc9aa (table default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]) successfully deleted
I20260925 01:50:03.654870 11755 tablet_bootstrap.cc:492] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:03.655025 11755 ts_tablet_manager.cc:1403] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.239s user 0.002s sys 0.002s
I20260925 01:50:03.655740 12689 ts_tablet_manager.cc:1929] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.655875 12689 log.cc:1199] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a9944a1422d14ae2b22451e67c477d5b
I20260925 01:50:03.655776 11755 raft_consensus.cc:359] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.655984 11755 raft_consensus.cc:385] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.656044 11755 raft_consensus.cc:740] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.656325 11755 consensus_queue.cc:260] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.657112 11754 tablet_bootstrap.cc:492] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.657276 11755 ts_tablet_manager.cc:1434] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:03.657289 11754 ts_tablet_manager.cc:1403] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.003s
I20260925 01:50:03.657588 11755 tablet_bootstrap.cc:492] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:03.660558 11953 tablet_replica.cc:333] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:03.661193 11953 raft_consensus.cc:2243] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:03.663568 11953 raft_consensus.cc:2272] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.664343 11754 raft_consensus.cc:359] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.664901 11953 ts_tablet_manager.cc:1916] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.665283 11754 raft_consensus.cc:385] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.665455 11754 raft_consensus.cc:740] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.665153 12689 ts_tablet_manager.cc:1950] T a9944a1422d14ae2b22451e67c477d5b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.666780 11754 consensus_queue.cc:260] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.626650 12969 tablet.cc:1751] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:03.656435 12967 raft_consensus.cc:493] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.667236 12967 raft_consensus.cc:515] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.668696 12967 leader_election.cc:290] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.641258 12963 leader_election.cc:290] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.669381 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f97ead49634bf6b03e292544af4d07" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.670158 11457 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.672892 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f892954cd22c48aaad2f0e20b1277844
I20260925 01:50:03.668311 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f97ead49634bf6b03e292544af4d07" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:03.674474 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a9944a1422d14ae2b22451e67c477d5b (table default.Table_4b87558f2a98419f96b453a44aae814b [id=a1a3b3d0054a4bff8de55b5c5e71880f]) successfully deleted
I20260925 01:50:03.674698 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet f892954cd22c48aaad2f0e20b1277844 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:03.674811 11456 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.674929 11456 leader_election.cc:304] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.675377 11754 ts_tablet_manager.cc:1434] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260925 01:50:03.675642 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet f892954cd22c48aaad2f0e20b1277844 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:03.676106 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet f892954cd22c48aaad2f0e20b1277844 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:03.676468 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 49692d2824a34f48a4dcefad8c89618b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49692d2824a34f48a4dcefad8c89618b already in progress: creating tablet
I20260925 01:50:03.677783 11755 tablet_bootstrap.cc:654] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.678929 12964 raft_consensus.cc:2749] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.679505 11754 tablet_bootstrap.cc:492] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:03.680514 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f46004be36b543a395a783a13b1b14cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f46004be36b543a395a783a13b1b14cf already in progress: creating tablet
I20260925 01:50:03.685660 12980 tablet.cc:1751] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:03.685860 12689 tablet_replica.cc:333] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.686043 12689 raft_consensus.cc:2243] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.686618 11753 tablet_bootstrap.cc:492] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.686225 12689 raft_consensus.cc:2272] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.687063 11753 ts_tablet_manager.cc:1403] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.001s
I20260925 01:50:03.687767 12689 ts_tablet_manager.cc:1916] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.688550 11753 raft_consensus.cc:359] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.682346 11754 tablet_bootstrap.cc:654] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.694923 11753 raft_consensus.cc:385] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.695073 11753 raft_consensus.cc:740] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.695396 11753 consensus_queue.cc:260] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.695855 11953 ts_tablet_manager.cc:1929] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:03.695987 11753 ts_tablet_manager.cc:1434] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 01:50:03.696305 11753 tablet_bootstrap.cc:492] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.705159 12689 ts_tablet_manager.cc:1929] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.705298 12689 log.cc:1199] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/98ffeb9d70374afdb72a728d7b211d33
I20260925 01:50:03.705595 12689 ts_tablet_manager.cc:1950] T 98ffeb9d70374afdb72a728d7b211d33 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.705900 11953 log.cc:1199] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/80fe96946b294785b8d76564e0f5fa12
I20260925 01:50:03.708143 11753 tablet_bootstrap.cc:654] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.710180 11754 tablet_bootstrap.cc:492] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.710397 11754 ts_tablet_manager.cc:1403] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20260925 01:50:03.711190 11754 raft_consensus.cc:359] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.711519 11754 raft_consensus.cc:385] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.711609 11754 raft_consensus.cc:740] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.711856 11754 consensus_queue.cc:260] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.714427 11754 ts_tablet_manager.cc:1434] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:03.714761 11754 tablet_bootstrap.cc:492] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:03.722744 11236 raft_consensus.cc:2468] T 41c4a23d974f4daea7a274eccd661d5c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:03.723096 11754 tablet_bootstrap.cc:654] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.724988 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6f80c3a17c384f9391cd5164d3c8b03a" } new_table_name: "default.Table_8453c4651b1f4ac8afd25ece798e9bc1" modify_external_catalogs: true
I20260925 01:50:03.725854 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 with delete_type TABLET_DATA_DELETED (replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:03.727730 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 98ffeb9d70374afdb72a728d7b211d33 (table default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]) successfully deleted
W20260925 01:50:03.732939 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 728157ec17ed4df5a4a8559df6c1ac78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 728157ec17ed4df5a4a8559df6c1ac78 already in progress: creating tablet
I20260925 01:50:03.734254 11753 tablet_bootstrap.cc:492] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.734488 11753 ts_tablet_manager.cc:1403] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.000s
I20260925 01:50:03.735615 11753 raft_consensus.cc:359] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.736509 11753 raft_consensus.cc:385] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:03.736575 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f92450c05b394603ba475328d5a3eb71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92450c05b394603ba475328d5a3eb71 already in progress: creating tablet
I20260925 01:50:03.736677 11753 raft_consensus.cc:740] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.737082 12689 tablet_replica.cc:333] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.737372 11753 consensus_queue.cc:260] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.738685 11314 consensus_peers.cc:597] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e3a033c9e7545479130c7a3c48ac254. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.739177 12689 raft_consensus.cc:2243] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.739791 11753 ts_tablet_manager.cc:1434] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:03.740057 12689 raft_consensus.cc:2272] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.740731 12782 raft_consensus.cc:493] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.740862 12782 raft_consensus.cc:515] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.741192 12689 ts_tablet_manager.cc:1916] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.743198 12782 leader_election.cc:290] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:03.744068 11314 leader_election.cc:343] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8152c9e0b0af4ab2a18c5a0080e22ffc
I20260925 01:50:03.744622 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c9e0b0af4ab2a18c5a0080e22ffc" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:03.744848 11522 raft_consensus.cc:2468] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:03.744948 11753 tablet_bootstrap.cc:492] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.746562 11314 leader_election.cc:304] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.746835 12933 raft_consensus.cc:2804] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.746915 12933 raft_consensus.cc:493] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.746975 12933 raft_consensus.cc:3060] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.747848 11754 tablet_bootstrap.cc:492] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.748045 11754 ts_tablet_manager.cc:1403] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.001s
I20260925 01:50:03.748754 11754 raft_consensus.cc:359] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.748991 11754 raft_consensus.cc:385] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.749075 11754 raft_consensus.cc:740] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.749318 11754 consensus_queue.cc:260] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.750696 12933 raft_consensus.cc:515] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.751502 12933 leader_election.cc:290] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:03.752741 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8152c9e0b0af4ab2a18c5a0080e22ffc" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:03.752980 11522 raft_consensus.cc:3060] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.753093 11754 ts_tablet_manager.cc:1434] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:50:03.753392 11754 tablet_bootstrap.cc:492] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:03.752741 11314 leader_election.cc:343] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8152c9e0b0af4ab2a18c5a0080e22ffc
I20260925 01:50:03.755204 11754 tablet_bootstrap.cc:654] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.755929 11522 raft_consensus.cc:2468] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:03.757048 11314 leader_election.cc:304] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.757853 12933 raft_consensus.cc:2804] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.759334 12933 raft_consensus.cc:697] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:03.759881 12933 consensus_queue.cc:237] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.762255 11753 tablet_bootstrap.cc:654] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.765297 11754 tablet_bootstrap.cc:492] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.765525 11754 ts_tablet_manager.cc:1403] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260925 01:50:03.765782 11953 ts_tablet_manager.cc:1950] T 80fe96946b294785b8d76564e0f5fa12 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:03.766168 12850 raft_consensus.cc:493] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.766424 12850 raft_consensus.cc:515] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.766845 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 317) took 9337 ms. Trace:
I20260925 01:50:03.766943 11953 rpcz_store.cc:276] 0925 01:49:54.429278 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.429331 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:03.660501 (+9231170us) ts_tablet_manager.cc:1151] Deleting tablet 80fe96946b294785b8d76564e0f5fa12
0925 01:50:03.660513 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.681377 (+ 20864us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.695780 (+ 14403us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.766816 (+ 71036us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9222097}
I20260925 01:50:03.767577 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 80fe96946b294785b8d76564e0f5fa12 (table default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]) successfully deleted
I20260925 01:50:03.768015 12894 raft_consensus.cc:493] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.768146 12894 raft_consensus.cc:515] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.768743 12894 leader_election.cc:290] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.769505 12850 leader_election.cc:290] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.769888 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0575861dd3d6437284cc183acb87af0a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:03.770124 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0575861dd3d6437284cc183acb87af0a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.770181 11522 raft_consensus.cc:2468] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:03.770705 11177 leader_election.cc:343] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.770853 11176 leader_election.cc:304] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:03.771241 12894 raft_consensus.cc:2804] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.771301 12894 raft_consensus.cc:493] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.771353 12894 raft_consensus.cc:3060] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.771658 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ac080782664fca8661c188ab822e89" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.772061 12782 consensus_queue.cc:1048] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:50:03.773416 11457 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.774220 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ac080782664fca8661c188ab822e89" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:03.774899 11456 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.775082 11456 leader_election.cc:304] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.775707 12964 raft_consensus.cc:2749] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.778254 12894 raft_consensus.cc:515] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.779332 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0575861dd3d6437284cc183acb87af0a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:03.779579 11516 raft_consensus.cc:3060] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.783782 11516 raft_consensus.cc:2468] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:03.784294 11176 leader_election.cc:304] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.784564 12885 raft_consensus.cc:2804] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.788561 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0575861dd3d6437284cc183acb87af0a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:03.788641 12894 leader_election.cc:290] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:03.789403 11177 leader_election.cc:343] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.793246 12894 raft_consensus.cc:493] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.793448 12894 raft_consensus.cc:515] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.798115 12894 leader_election.cc:290] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.798226 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257e6f224f99427eb68fd61fa1aadae0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.798799 11177 leader_election.cc:343] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:03.798815 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ba4def6c15a410f87b3bf1f168f80d4 consensus state has no leader
I20260925 01:50:03.799158 12850 raft_consensus.cc:493] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.799388 12850 raft_consensus.cc:515] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.800909 12850 leader_election.cc:290] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.801268 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e96576354fe46bf9bfcde18f0a53390" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:03.801875 11456 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.801954 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e96576354fe46bf9bfcde18f0a53390" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.802843 11457 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.803133 11457 leader_election.cc:304] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.804124 12850 raft_consensus.cc:2749] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.803141 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257e6f224f99427eb68fd61fa1aadae0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:03.804742 11516 raft_consensus.cc:2468] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:03.805276 11176 leader_election.cc:304] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:03.805754 12894 raft_consensus.cc:2804] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.805864 12894 raft_consensus.cc:493] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.805966 12894 raft_consensus.cc:3060] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.806584 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 315) took 9379 ms. Trace:
I20260925 01:50:03.806809 11953 rpcz_store.cc:276] 0925 01:49:54.427214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.427584 (+ 370us) service_pool.cc:224] Handling call
0925 01:50:03.806419 (+9378835us) ts_tablet_manager.cc:1151] Deleting tablet 85db5688ef064053870a39a906ad9071
0925 01:50:03.806435 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.806558 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9332507}
W20260925 01:50:03.807548 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 85db5688ef064053870a39a906ad9071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85db5688ef064053870a39a906ad9071 already in progress: creating tablet
I20260925 01:50:03.807920 11953 tablet_replica.cc:333] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:03.808148 11953 raft_consensus.cc:2243] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:03.808329 11953 raft_consensus.cc:2272] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:03.808903 11953 ts_tablet_manager.cc:1916] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.809077 12894 raft_consensus.cc:515] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.810041 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257e6f224f99427eb68fd61fa1aadae0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:03.810267 11516 raft_consensus.cc:3060] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.813501 11516 raft_consensus.cc:2468] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:03.814083 11176 leader_election.cc:304] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:03.817792 12850 raft_consensus.cc:493] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.817958 12850 raft_consensus.cc:515] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.818645 12850 leader_election.cc:290] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.819054 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cd89d238bf4220a48ecdf59cca5e6d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:03.819295 12967 raft_consensus.cc:493] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.819445 12967 raft_consensus.cc:515] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:03.819988 12967 leader_election.cc:290] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:03.819736 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cd89d238bf4220a48ecdf59cca5e6d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.821530 11456 leader_election.cc:343] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a9944a1422d14ae2b22451e67c477d5b
W20260925 01:50:03.822343 11457 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.822953 11755 tablet_bootstrap.cc:492] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:03.823086 11755 ts_tablet_manager.cc:1403] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.166s user 0.006s sys 0.001s
I20260925 01:50:03.823256 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9944a1422d14ae2b22451e67c477d5b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.823387 11456 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.823485 11456 leader_election.cc:304] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.823922 12964 raft_consensus.cc:2749] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:03.829905 11457 leader_election.cc:343] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.830093 11457 leader_election.cc:304] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.830519 12964 raft_consensus.cc:2749] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:03.834019 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 6ba4def6c15a410f87b3bf1f168f80d4 (table default.Table_1ade0ea78b1e41e5ab63a12b77b5d46d [id=2950c0d26fe542fdadaeef6c46480762], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ba4def6c15a410f87b3bf1f168f80d4 consensus state has no leader
I20260925 01:50:03.842319 11754 raft_consensus.cc:359] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.842669 11754 raft_consensus.cc:385] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.842764 11754 raft_consensus.cc:740] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.843058 11754 consensus_queue.cc:260] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.843708 12964 raft_consensus.cc:493] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.825410 11755 raft_consensus.cc:359] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.843855 12964 raft_consensus.cc:515] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.843961 11755 raft_consensus.cc:385] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.844056 11755 raft_consensus.cc:740] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.844297 11755 consensus_queue.cc:260] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.844623 12964 leader_election.cc:290] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.844789 12963 raft_consensus.cc:493] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:03.844899 11755 ts_tablet_manager.cc:1434] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260925 01:50:03.844897 12963 raft_consensus.cc:515] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.845165 11755 tablet_bootstrap.cc:492] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:03.845285 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffeb9d70374afdb72a728d7b211d33" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:03.845418 12963 leader_election.cc:290] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:03.845808 11457 leader_election.cc:343] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.846184 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da55c488da540048a94324fa347c1ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:03.846675 11457 leader_election.cc:343] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.846957 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da55c488da540048a94324fa347c1ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:03.847150 11239 raft_consensus.cc:2468] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:03.848059 11456 leader_election.cc:304] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:03.848448 12964 raft_consensus.cc:2804] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:03.848556 12964 raft_consensus.cc:493] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:03.848615 12964 raft_consensus.cc:3060] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.849707 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f1256da336d043ccb47d410999361986"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.850405 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1256da336d043ccb47d410999361986 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.851516 12964 raft_consensus.cc:515] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.851701 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_91f5d26231524dd6ad91b6d49e5e9d14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:03.852145 12964 leader_election.cc:290] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:03.852283 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91f5d26231524dd6ad91b6d49e5e9d14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.853427 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da55c488da540048a94324fa347c1ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:03.853608 11239 raft_consensus.cc:3060] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:03.853685 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 86f3f75784af42f6b14b919815ab1890 consensus state has no leader
I20260925 01:50:03.854188 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ee767a4b9d33413aa7a46e7a97833b4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:03.854677 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da55c488da540048a94324fa347c1ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:03.854794 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee767a4b9d33413aa7a46e7a97833b4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:03.855226 11457 leader_election.cc:343] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.856493 11239 raft_consensus.cc:2468] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:03.857148 11456 leader_election.cc:304] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:03.857595 12964 raft_consensus.cc:2804] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.857829 12964 raft_consensus.cc:697] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:03.858177 12964 consensus_queue.cc:237] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.859660 11456 leader_election.cc:343] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 98ffeb9d70374afdb72a728d7b211d33
I20260925 01:50:03.859781 11456 leader_election.cc:304] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:03.859975 12963 raft_consensus.cc:2749] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:03.871127 12894 leader_election.cc:290] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:03.871425 12894 raft_consensus.cc:2804] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:03.871397 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257e6f224f99427eb68fd61fa1aadae0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:03.871580 12894 raft_consensus.cc:697] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:03.871815 12894 consensus_queue.cc:237] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.872182 11177 leader_election.cc:343] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:03.872538 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_785304ebf8394910b4bd62dbfe8381f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.873198 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_785304ebf8394910b4bd62dbfe8381f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:03.874583 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 46129.5us
I20260925 01:50:03.877170 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet ff70e44b72d1425c81751ff0b3d93b11 from {username='slave'} at 127.0.0.1:60372
W20260925 01:50:03.879606 11314 consensus_peers.cc:597] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.884439 11754 ts_tablet_manager.cc:1434] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.119s user 0.002s sys 0.001s
I20260925 01:50:03.885178 11754 tablet_bootstrap.cc:492] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:03.895381 12689 ts_tablet_manager.cc:1929] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:03.897517 11753 tablet_bootstrap.cc:492] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.897758 11753 ts_tablet_manager.cc:1403] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.153s user 0.008s sys 0.000s
I20260925 01:50:03.898522 11753 raft_consensus.cc:359] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.898765 11753 raft_consensus.cc:385] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.898849 11753 raft_consensus.cc:740] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.899115 11753 consensus_queue.cc:260] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.899791 11755 tablet_bootstrap.cc:654] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.900509 11753 ts_tablet_manager.cc:1434] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:50:03.901193 11753 tablet_bootstrap.cc:492] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.902472 12689 log.cc:1199] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/f892954cd22c48aaad2f0e20b1277844
W20260925 01:50:03.905619 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9feb00f881ed4518a32e08d170080a46 consensus state has no leader
I20260925 01:50:03.907354 11372 raft_consensus.cc:3060] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:03.911164 12963 consensus_queue.cc:1048] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:03.912767 12689 ts_tablet_manager.cc:1950] T f892954cd22c48aaad2f0e20b1277844 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.913862 12689 tablet_replica.cc:333] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:03.914275 11754 tablet_bootstrap.cc:654] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.914999 12885 raft_consensus.cc:697] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:03.915045 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_c361990e57274e58b9e99c7086a27792 [id=8dcfe1cef923411faea69f4f694a51e6]) successfully deleted
I20260925 01:50:03.916090 11753 tablet_bootstrap.cc:654] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.916642 12885 consensus_queue.cc:237] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.917928 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c93323e771fe4ab1a5a77dd05caed954" } new_table_name: "default.Table_582166189abe4876a4e7dbd3a0dd135e" modify_external_catalogs: true
I20260925 01:50:03.920011 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d21e6c10f3a34da9aa36f6f3201df482" } modify_external_catalogs: true
I20260925 01:50:03.920251 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d21e6c10f3a34da9aa36f6f3201df482" } modify_external_catalogs: true
I20260925 01:50:03.921123 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0f02542b67804eb896581e58a3fdfe80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:03.921981 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f02542b67804eb896581e58a3fdfe80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:03.922940 12689 raft_consensus.cc:2243] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:03.923516 12689 pending_rounds.cc:70] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:03.923581 12689 pending_rounds.cc:77] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072911946346496 op_type: NO_OP noop_request { }
I20260925 01:50:03.923684 12689 raft_consensus.cc:2889] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:03.923775 12689 raft_consensus.cc:2272] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:03.924563 13008 consensus_queue.cc:1175] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b93565e796c94a3699eb1824383bbaeb" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260925 01:50:03.925891 12689 ts_tablet_manager.cc:1916] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:03.936714 11953 ts_tablet_manager.cc:1929] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:03.937060 11953 log.cc:1199] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/b98ad0f02eb74eba897040401a164f5c
I20260925 01:50:03.952343 11755 tablet_bootstrap.cc:492] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:03.964713 11753 tablet_bootstrap.cc:492] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:03.964919 11753 ts_tablet_manager.cc:1403] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.002s
I20260925 01:50:03.965767 11753 raft_consensus.cc:359] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.965982 11753 raft_consensus.cc:385] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.966043 11753 raft_consensus.cc:740] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.966334 11753 consensus_queue.cc:260] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.970981 11753 ts_tablet_manager.cc:1434] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260925 01:50:03.980464 11753 tablet_bootstrap.cc:492] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:03.987769 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85" } modify_external_catalogs: true
I20260925 01:50:03.988149 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85" } modify_external_catalogs: true
I20260925 01:50:03.989389 11754 tablet_bootstrap.cc:492] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:03.989534 11754 ts_tablet_manager.cc:1403] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.104s user 0.003s sys 0.003s
I20260925 01:50:03.990404 12980 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:03.991688 11753 tablet_bootstrap.cc:654] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:03.992195 12969 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:03.990404 11754 raft_consensus.cc:359] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:03.994612 11754 raft_consensus.cc:385] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:03.994690 11754 raft_consensus.cc:740] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.994675 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3f87fc14acdb4b89927b49c8fb09c83d" } modify_external_catalogs: true
I20260925 01:50:03.994997 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3f87fc14acdb4b89927b49c8fb09c83d" } modify_external_catalogs: true
I20260925 01:50:03.995123 12689 ts_tablet_manager.cc:1929] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:03.995227 12689 log.cc:1199] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/257e6f224f99427eb68fd61fa1aadae0
I20260925 01:50:03.995639 12689 ts_tablet_manager.cc:1950] T 257e6f224f99427eb68fd61fa1aadae0 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:03.996049 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f7b427ed4a7346fbbfaba8281fbfd929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:03.996591 11754 consensus_queue.cc:260] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:03.997135 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab09d980c0814a2f8babc83222f2bc17 consensus state has no leader
I20260925 01:50:03.997136 11755 ts_tablet_manager.cc:1403] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.152s user 0.002s sys 0.002s
I20260925 01:50:03.997220 11754 ts_tablet_manager.cc:1434] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:50:03.997649 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1a5fa8d4c6294c46a36a515b0e0505df" } modify_external_catalogs: true
I20260925 01:50:03.997856 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1a5fa8d4c6294c46a36a515b0e0505df" } modify_external_catalogs: true
I20260925 01:50:03.981351 11953 ts_tablet_manager.cc:1950] T b98ad0f02eb74eba897040401a164f5c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:50:03.998634 11457 consensus_peers.cc:597] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:03.998831 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 321) took 9516 ms. Trace:
I20260925 01:50:03.998930 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 257e6f224f99427eb68fd61fa1aadae0 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]) successfully deleted
I20260925 01:50:03.998925 11953 rpcz_store.cc:276] 0925 01:49:54.482834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.495232 (+ 12398us) service_pool.cc:224] Handling call
0925 01:50:03.807869 (+9312637us) ts_tablet_manager.cc:1151] Deleting tablet b98ad0f02eb74eba897040401a164f5c
0925 01:50:03.807879 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.847050 (+ 39171us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.936606 (+ 89556us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:03.998814 (+ 62208us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9312112}
I20260925 01:50:03.999378 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet b98ad0f02eb74eba897040401a164f5c (table default.Table_f12eeda830be434fbc7fa9b8827978d4 [id=ded734199b0246ab9f10a405170b0091]) successfully deleted
I20260925 01:50:03.999933 12964 raft_consensus.cc:493] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.000077 12964 raft_consensus.cc:515] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:04.000300 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7b427ed4a7346fbbfaba8281fbfd929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.000759 12964 leader_election.cc:290] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.001396 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fca09010f841c5a7b58678560065f3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:04.001982 11457 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.002467 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fca09010f841c5a7b58678560065f3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:04.003525 11456 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.003641 11456 leader_election.cc:304] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.004227 12964 raft_consensus.cc:2749] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.005625 11754 tablet_bootstrap.cc:492] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.009183 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_69dd9b3d7d624415aacea6486cb9caeb" } modify_external_catalogs: true
I20260925 01:50:04.009580 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_69dd9b3d7d624415aacea6486cb9caeb" } modify_external_catalogs: true
I20260925 01:50:04.014209 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 333) took 9223 ms. Trace:
I20260925 01:50:04.014380 11953 rpcz_store.cc:276] 0925 01:49:54.790766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.845291 (+ 54525us) service_pool.cc:224] Handling call
0925 01:50:03.999658 (+9154367us) ts_tablet_manager.cc:1151] Deleting tablet 9f7f7ee517df483b83d1627cdb6f9433
0925 01:50:03.999668 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.014173 (+ 14505us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9151835}
W20260925 01:50:04.015527 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9f7f7ee517df483b83d1627cdb6f9433 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7f7ee517df483b83d1627cdb6f9433 already in progress: creating tablet
I20260925 01:50:04.015853 12912 tablet.cc:1751] T ec82ac4f3b4d48fbbb33c21f5630d749 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:04.018435 11754 tablet_bootstrap.cc:654] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.021330 11753 tablet_bootstrap.cc:492] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.021548 11753 ts_tablet_manager.cc:1403] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260925 01:50:04.022346 11753 raft_consensus.cc:359] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.022603 11753 raft_consensus.cc:385] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.022692 11753 raft_consensus.cc:740] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:03.998003 11755 raft_consensus.cc:359] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.022847 11755 raft_consensus.cc:385] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.022931 11755 raft_consensus.cc:740] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.023170 11755 consensus_queue.cc:260] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.023234 11753 consensus_queue.cc:260] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.023715 11755 ts_tablet_manager.cc:1434] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.026s user 0.001s sys 0.000s
I20260925 01:50:04.024649 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 338) took 9174 ms. Trace:
I20260925 01:50:04.024768 11953 rpcz_store.cc:276] 0925 01:49:54.850428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.850654 (+ 226us) service_pool.cc:224] Handling call
0925 01:50:04.016597 (+9165943us) ts_tablet_manager.cc:1151] Deleting tablet abcb285ebc1a4bfd8317546823e01b09
0925 01:50:04.024520 (+ 7923us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.024632 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9165591}
W20260925 01:50:04.027159 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet abcb285ebc1a4bfd8317546823e01b09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abcb285ebc1a4bfd8317546823e01b09 already in progress: creating tablet
I20260925 01:50:04.027583 11953 tablet_replica.cc:333] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:04.027813 11953 raft_consensus.cc:2243] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:04.028242 11953 raft_consensus.cc:2272] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.029564 11755 tablet_bootstrap.cc:492] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:04.030162 11753 ts_tablet_manager.cc:1434] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:50:04.031841 11753 tablet_bootstrap.cc:492] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.033234 11753 tablet_bootstrap.cc:654] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.044821 11946 ts_tablet_manager.cc:1929] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:04.045102 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet 2487a41e682740cb83a4281aeef0368a from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:04.047816 11953 ts_tablet_manager.cc:1916] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.051638 11754 tablet_bootstrap.cc:492] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.051941 11754 ts_tablet_manager.cc:1403] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.046s user 0.007s sys 0.000s
I20260925 01:50:04.051644 11753 tablet_bootstrap.cc:492] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.052716 11946 log.cc:1199] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/9cd2e1bf7d3e4459a84235b9c3f5383c
I20260925 01:50:04.053764 11754 raft_consensus.cc:359] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.052732 11753 ts_tablet_manager.cc:1403] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260925 01:50:04.054517 11946 ts_tablet_manager.cc:1950] T 9cd2e1bf7d3e4459a84235b9c3f5383c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.055001 11753 raft_consensus.cc:359] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.055202 11753 raft_consensus.cc:385] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.055269 11753 raft_consensus.cc:740] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.055552 11753 consensus_queue.cc:260] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.055809 11755 tablet_bootstrap.cc:654] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.056703 11753 ts_tablet_manager.cc:1434] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:04.057132 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 534) took 3316 ms. Trace:
I20260925 01:50:04.057616 11754 raft_consensus.cc:385] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.058107 11754 raft_consensus.cc:740] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.057343 11753 tablet_bootstrap.cc:492] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.058295 11946 rpcz_store.cc:276] 0925 01:50:00.741047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.741098 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:03.491788 (+2750690us) ts_tablet_manager.cc:1151] Deleting tablet 9cd2e1bf7d3e4459a84235b9c3f5383c
0925 01:50:03.491801 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:03.576825 (+ 85024us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.044748 (+467923us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.057114 (+ 12366us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2750525}
I20260925 01:50:04.058774 11754 consensus_queue.cc:260] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.059986 11946 tablet_replica.cc:333] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.060216 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 9cd2e1bf7d3e4459a84235b9c3f5383c (table default.Table_962d7117724d4e5aa1b45a6fab966667 [id=768d79ef588e46be97ceffa64db19940]) successfully deleted
I20260925 01:50:04.060266 11946 raft_consensus.cc:2243] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.060401 11946 raft_consensus.cc:2272] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.060642 11753 tablet_bootstrap.cc:654] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.060899 11946 ts_tablet_manager.cc:1916] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.066715 11753 tablet_bootstrap.cc:492] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.068784 11754 ts_tablet_manager.cc:1434] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260925 01:50:04.069320 11754 tablet_bootstrap.cc:492] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.068674 11753 ts_tablet_manager.cc:1403] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20260925 01:50:04.070703 11753 raft_consensus.cc:359] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.071112 11754 tablet_bootstrap.cc:654] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:04.072697 11456 consensus_peers.cc:597] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 96b68399843a422b8da3ddfab2c522e6. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:04.073249 11753 raft_consensus.cc:385] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.073439 11753 raft_consensus.cc:740] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.073954 11753 consensus_queue.cc:260] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.075709 11753 ts_tablet_manager.cc:1434] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:50:04.076340 11753 tablet_bootstrap.cc:492] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.082165 11753 tablet_bootstrap.cc:654] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.084107 11671 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0575861dd3d6437284cc183acb87af0a (table default.Table_1a17bc9d97f7458e8ec979b4728fa9e5 [id=1a5a59e2daad4fb78689dd25363b7086]). Expected version 1 got 0
I20260925 01:50:04.084733 11946 ts_tablet_manager.cc:1929] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.084846 11946 log.cc:1199] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:50:04.085304 11946 ts_tablet_manager.cc:1950] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.085335 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_5db64fc4070a45f0adc4c8234951e1bf [id=4ae41188fe5546918a2ec8cfb40e6ebc] alter complete (version 2)
I20260925 01:50:04.086174 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 536) took 3342 ms. Trace:
I20260925 01:50:04.086277 11946 rpcz_store.cc:276] 0925 01:50:00.743197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.743515 (+ 318us) service_pool.cc:224] Handling call
0925 01:50:04.059934 (+3316419us) ts_tablet_manager.cc:1151] Deleting tablet 73d9a26bbfd74a30a2ae0a61aacca4d1
0925 01:50:04.059946 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.064942 (+ 4996us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.084668 (+ 19726us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.086152 (+ 1484us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3316252}
I20260925 01:50:04.086015 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3dbae4f2663d46e2bc77afddcd09fed2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:04.086755 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 (table default.Table_62819e2601e6498796cbf6ba500c43de [id=091267034b9049728ddece813abe0fed]) successfully deleted
W20260925 01:50:04.086971 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3dbae4f2663d46e2bc77afddcd09fed2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.089673 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8d4c17a642b345df81ff7b46604af4f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:04.089797 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 with delete_type TABLET_DATA_DELETED (replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.090027 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:04.090312 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d4c17a642b345df81ff7b46604af4f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.090448 12689 tablet_replica.cc:333] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:04.090623 12689 raft_consensus.cc:2243] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.090767 12689 raft_consensus.cc:2272] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.091848 12689 ts_tablet_manager.cc:1916] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.092273 11754 tablet_bootstrap.cc:492] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.092389 11754 ts_tablet_manager.cc:1403] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260925 01:50:04.093075 11754 raft_consensus.cc:359] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.093228 11754 raft_consensus.cc:385] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.093272 11754 raft_consensus.cc:740] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.093583 11754 consensus_queue.cc:260] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:04.094581 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 257e6f224f99427eb68fd61fa1aadae0 because the tablet was not found. No further retry: Not found: Tablet not found: 257e6f224f99427eb68fd61fa1aadae0
I20260925 01:50:04.096216 11754 ts_tablet_manager.cc:1434] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:04.097035 11754 tablet_bootstrap.cc:492] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.099718 11754 tablet_bootstrap.cc:654] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.100129 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 95ac080782664fca8661c188ab822e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.100499 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f97ead49634bf6b03e292544af4d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.100689 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.101557 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet a9944a1422d14ae2b22451e67c477d5b with delete_type TABLET_DATA_DELETED (replaced by tablet c86a78873e8847fa95bead4774bea606) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.103525 12689 ts_tablet_manager.cc:1929] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.103868 11946 tablet_replica.cc:333] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.104055 12689 log.cc:1199] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:04.108839 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ecdd81ee82464f50a9ce22b94a341c9e" } new_table_name: "default.Table_a04d9c3f68554870a7d3ca86b53f09bc" modify_external_catalogs: true
I20260925 01:50:04.104563 12689 ts_tablet_manager.cc:1950] T be89c0911dfa4b9d83d6bd88755be2b2 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:04.106585 11753 tablet_bootstrap.cc:492] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.112996 11753 ts_tablet_manager.cc:1403] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.001s
I20260925 01:50:04.113894 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet be89c0911dfa4b9d83d6bd88755be2b2 (table default.Table_3ce60e2486054c3081ecab5a46f58e16 [id=653678819a1849b2a923a6793976ae8c]) successfully deleted
I20260925 01:50:04.114264 11753 raft_consensus.cc:359] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.114545 11753 raft_consensus.cc:385] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.114606 11753 raft_consensus.cc:740] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.114898 11753 consensus_queue.cc:260] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.116283 11753 ts_tablet_manager.cc:1434] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 01:50:04.117277 11753 tablet_bootstrap.cc:492] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.118350 11946 raft_consensus.cc:2243] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.118546 11946 raft_consensus.cc:2272] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.119105 11946 ts_tablet_manager.cc:1916] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.119803 11753 tablet_bootstrap.cc:654] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.121542 11953 ts_tablet_manager.cc:1929] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:04.121654 11953 log.cc:1199] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ccffbe61eea34333abdc6da94612c0f6
I20260925 01:50:04.121974 11953 ts_tablet_manager.cc:1950] T ccffbe61eea34333abdc6da94612c0f6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:04.122990 11755 tablet_bootstrap.cc:492] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:04.123142 11755 ts_tablet_manager.cc:1403] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.094s user 0.002s sys 0.000s
I20260925 01:50:04.123826 11754 tablet_bootstrap.cc:492] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.123981 11754 ts_tablet_manager.cc:1403] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.007s
I20260925 01:50:04.123980 11755 raft_consensus.cc:359] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.124183 11755 raft_consensus.cc:385] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.124246 11755 raft_consensus.cc:740] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.124600 11755 consensus_queue.cc:260] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.124951 11754 raft_consensus.cc:359] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.125181 11754 raft_consensus.cc:385] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.125254 11754 raft_consensus.cc:740] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.125505 11754 consensus_queue.cc:260] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.126804 11754 ts_tablet_manager.cc:1434] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260925 01:50:04.127076 11754 tablet_bootstrap.cc:492] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.129715 11753 tablet_bootstrap.cc:492] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.129845 11753 ts_tablet_manager.cc:1403] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260925 01:50:04.130329 11755 ts_tablet_manager.cc:1434] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260925 01:50:04.130330 11946 ts_tablet_manager.cc:1929] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.130498 11946 log.cc:1199] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/f1b6ea676a1f4d99807029d8401251ef
I20260925 01:50:04.130854 11946 ts_tablet_manager.cc:1950] T f1b6ea676a1f4d99807029d8401251ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.139111 11754 tablet_bootstrap.cc:654] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.141984 11678 catalog_manager.cc:5838] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:04.142647 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 0575861dd3d6437284cc183acb87af0a (table default.Table_1a17bc9d97f7458e8ec979b4728fa9e5 [id=1a5a59e2daad4fb78689dd25363b7086]). Expected version 1 got 0
I20260925 01:50:04.143076 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7da55c488da540048a94324fa347c1ef (table default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17]). Expected version 5 got 0
I20260925 01:50:04.145310 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 537) took 3402 ms. Trace:
I20260925 01:50:04.145464 11946 rpcz_store.cc:276] 0925 01:50:00.743283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.743705 (+ 422us) service_pool.cc:224] Handling call
0925 01:50:04.103799 (+3360094us) ts_tablet_manager.cc:1151] Deleting tablet f1b6ea676a1f4d99807029d8401251ef
0925 01:50:04.103814 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.127054 (+ 23240us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.130278 (+ 3224us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.145284 (+ 15006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5594,"tablet-delete.queue_time_us":3359985}
I20260925 01:50:04.146199 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet f1b6ea676a1f4d99807029d8401251ef (table default.Table_95ebdd9395354eba91e3babd76028061 [id=dba58bdd410a4b8986cf7e359a563628]) successfully deleted
I20260925 01:50:04.132802 11753 raft_consensus.cc:359] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.146551 11753 raft_consensus.cc:385] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.146672 11753 raft_consensus.cc:740] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.147012 11753 consensus_queue.cc:260] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.147691 11753 ts_tablet_manager.cc:1434] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260925 01:50:04.148043 11753 tablet_bootstrap.cc:492] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.149984 11753 tablet_bootstrap.cc:654] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:04.151276 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88d8616fc7e243a885c318ce8e631c56 consensus state has no leader
I20260925 01:50:04.155112 11208 tablet_service.cc:1511] Processing CreateTablet for tablet d8e9d16f20d44e71bdb3bccb9b858079 (DEFAULT_TABLE table=default.Table_aff4f0f44c1f482b996bba5360da5424 [id=b6347d25383349ca915f7afedfeae432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.155562 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e9d16f20d44e71bdb3bccb9b858079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.157447 11755 tablet_bootstrap.cc:492] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:04.158711 12947 raft_consensus.cc:493] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.158841 12947 raft_consensus.cc:515] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:04.159461 12947 leader_election.cc:290] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:04.160743 11314 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 73d9a26bbfd74a30a2ae0a61aacca4d1
W20260925 01:50:04.160957 11314 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:50:04.161028 11314 leader_election.cc:304] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.161355 12947 raft_consensus.cc:2749] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:04.162928 11755 tablet_bootstrap.cc:654] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.164698 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2487a41e682740cb83a4281aeef0368a
I20260925 01:50:04.165474 11676 catalog_manager.cc:6934] ReplaceTablet: tablet 2487a41e682740cb83a4281aeef0368a deleted and replaced by tablet 71339adb55e34645b947c0a9ba8984fb
I20260925 01:50:04.166515 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 2487a41e682740cb83a4281aeef0368a with delete_type TABLET_DATA_DELETED (replaced by tablet 71339adb55e34645b947c0a9ba8984fb) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.167416 11754 tablet_bootstrap.cc:492] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.167589 11754 ts_tablet_manager.cc:1403] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.006s
I20260925 01:50:04.168020 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 2487a41e682740cb83a4281aeef0368a with delete_type TABLET_DATA_DELETED (replaced by tablet 71339adb55e34645b947c0a9ba8984fb) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.168495 11754 raft_consensus.cc:359] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.168691 11754 raft_consensus.cc:385] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.168740 11754 raft_consensus.cc:740] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.168735 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2957cbd4669749b381f59d1e301a692d
I20260925 01:50:04.168967 11754 consensus_queue.cc:260] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.169123 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_67ce33e86d8543478a5454db8199d1ef" } new_table_name: "default.Table_cf2d103c478e4c228e3e9e3156096833" modify_external_catalogs: true
I20260925 01:50:04.170011 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_69442eece38448df85a566c510504769"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:04.170795 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69442eece38448df85a566c510504769 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.172111 11754 ts_tablet_manager.cc:1434] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:04.172246 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 75014fc54fc7481f83da07e1d96c4370
I20260925 01:50:04.172406 11754 tablet_bootstrap.cc:492] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.173302 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 2957cbd4669749b381f59d1e301a692d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.174119 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 2957cbd4669749b381f59d1e301a692d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.174450 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 2957cbd4669749b381f59d1e301a692d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.174676 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 75014fc54fc7481f83da07e1d96c4370 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.175005 11754 tablet_bootstrap.cc:654] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:04.176152 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2957cbd4669749b381f59d1e301a692d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2957cbd4669749b381f59d1e301a692d already in progress: creating tablet
W20260925 01:50:04.176497 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 75014fc54fc7481f83da07e1d96c4370 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75014fc54fc7481f83da07e1d96c4370 already in progress: creating tablet
I20260925 01:50:04.177352 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3c14d4f477e248bdaddf42e4370c5557" } new_table_name: "default.Table_44b098622a324bd6a415bf756ce0160b" modify_external_catalogs: true
I20260925 01:50:04.179189 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 75014fc54fc7481f83da07e1d96c4370 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.180178 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 75014fc54fc7481f83da07e1d96c4370 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.167637 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 2487a41e682740cb83a4281aeef0368a with delete_type TABLET_DATA_DELETED (replaced by tablet 71339adb55e34645b947c0a9ba8984fb) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:04.182322 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2487a41e682740cb83a4281aeef0368a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2487a41e682740cb83a4281aeef0368a already in progress: creating tablet
I20260925 01:50:04.188318 11946 tablet_replica.cc:333] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.188602 11946 raft_consensus.cc:2243] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.188778 11946 raft_consensus.cc:2272] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.189440 11946 ts_tablet_manager.cc:1916] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.191345 11493 tablet_service.cc:1511] Processing CreateTablet for tablet d8e9d16f20d44e71bdb3bccb9b858079 (DEFAULT_TABLE table=default.Table_aff4f0f44c1f482b996bba5360da5424 [id=b6347d25383349ca915f7afedfeae432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.191793 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e9d16f20d44e71bdb3bccb9b858079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.193723 11360 tablet_service.cc:1511] Processing CreateTablet for tablet d8e9d16f20d44e71bdb3bccb9b858079 (DEFAULT_TABLE table=default.Table_aff4f0f44c1f482b996bba5360da5424 [id=b6347d25383349ca915f7afedfeae432]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.194187 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8e9d16f20d44e71bdb3bccb9b858079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.199538 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 06de5ebe3a674d2989855dcd71d0b363 (DEFAULT_TABLE table=default.Table_52ce6901556c469fa619f86157a93007 [id=421bf814a11542aeb3064fe5f71c920e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.199976 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06de5ebe3a674d2989855dcd71d0b363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.201081 11754 tablet_bootstrap.cc:492] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.201251 11754 ts_tablet_manager.cc:1403] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260925 01:50:04.202055 11754 raft_consensus.cc:359] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.202288 11754 raft_consensus.cc:385] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.202369 11754 raft_consensus.cc:740] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.202646 11754 consensus_queue.cc:260] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.205654 11754 ts_tablet_manager.cc:1434] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260925 01:50:04.205968 11754 tablet_bootstrap.cc:492] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.208626 11754 tablet_bootstrap.cc:654] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.215103 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 06de5ebe3a674d2989855dcd71d0b363 (DEFAULT_TABLE table=default.Table_52ce6901556c469fa619f86157a93007 [id=421bf814a11542aeb3064fe5f71c920e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.215646 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06de5ebe3a674d2989855dcd71d0b363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.217015 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 06de5ebe3a674d2989855dcd71d0b363 (DEFAULT_TABLE table=default.Table_52ce6901556c469fa619f86157a93007 [id=421bf814a11542aeb3064fe5f71c920e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.217489 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06de5ebe3a674d2989855dcd71d0b363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.221669 11221 tablet_service.cc:1511] Processing CreateTablet for tablet fe3627bfb342448591ccaf3d7ab23c4a (DEFAULT_TABLE table=default.Table_0e530a05e7374eef90dd27c3d716072c [id=8f15d8eb9a62407fb6c9244a1cd08558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.222159 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3627bfb342448591ccaf3d7ab23c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.231335 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8234c4d0c72541158826416e40f34031
I20260925 01:50:04.232548 11488 tablet_service.cc:1511] Processing CreateTablet for tablet fe3627bfb342448591ccaf3d7ab23c4a (DEFAULT_TABLE table=default.Table_0e530a05e7374eef90dd27c3d716072c [id=8f15d8eb9a62407fb6c9244a1cd08558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.232982 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3627bfb342448591ccaf3d7ab23c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.235807 11754 tablet_bootstrap.cc:492] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.235803 12964 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:04.235934 12964 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.236269 11754 ts_tablet_manager.cc:1403] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.001s
I20260925 01:50:04.236588 12964 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:04.237334 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:04.238269 11456 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:04.238340 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 8234c4d0c72541158826416e40f34031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.238390 11456 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.238541 11754 raft_consensus.cc:359] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.238742 12964 raft_consensus.cc:2749] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:04.238759 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 8234c4d0c72541158826416e40f34031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.238765 11754 raft_consensus.cc:385] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.238896 11754 raft_consensus.cc:740] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.239378 11754 consensus_queue.cc:260] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:04.239831 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8234c4d0c72541158826416e40f34031 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8234c4d0c72541158826416e40f34031 already in progress: creating tablet
I20260925 01:50:04.240721 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_79a1a30d8d93482aa7135607c46b5b7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:04.242442 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 8234c4d0c72541158826416e40f34031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.243206 11349 tablet_service.cc:1511] Processing CreateTablet for tablet fe3627bfb342448591ccaf3d7ab23c4a (DEFAULT_TABLE table=default.Table_0e530a05e7374eef90dd27c3d716072c [id=8f15d8eb9a62407fb6c9244a1cd08558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.243630 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe3627bfb342448591ccaf3d7ab23c4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:04.244031 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79a1a30d8d93482aa7135607c46b5b7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.245671 11754 ts_tablet_manager.cc:1434] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260925 01:50:04.247154 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 80cd9735bf634871b7157443d0cfac37 (DEFAULT_TABLE table=default.Table_0a21405c13e44a9b98038ff6cd0205d0 [id=f121adbea26c4b80a2814aea1f8b2a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.247584 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80cd9735bf634871b7157443d0cfac37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.249011 12996 raft_consensus.cc:493] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.249133 12996 raft_consensus.cc:515] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.249742 12996 leader_election.cc:290] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.250391 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb56153a802427aaebbf55a8193d62b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:04.251070 11177 leader_election.cc:343] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.251739 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb56153a802427aaebbf55a8193d62b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.251955 11522 raft_consensus.cc:2468] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:04.252570 11176 leader_election.cc:304] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:04.253183 12996 raft_consensus.cc:2804] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:04.253260 12996 raft_consensus.cc:493] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:04.253327 12996 raft_consensus.cc:3060] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.255918 12996 raft_consensus.cc:515] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.256274 11754 tablet_bootstrap.cc:492] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.257006 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb56153a802427aaebbf55a8193d62b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:04.257179 11522 raft_consensus.cc:3060] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.257386 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcb56153a802427aaebbf55a8193d62b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:04.257903 11177 leader_election.cc:343] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.258076 12996 leader_election.cc:290] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.258605 11754 tablet_bootstrap.cc:654] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.260169 11522 raft_consensus.cc:2468] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:04.260944 11176 leader_election.cc:304] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:04.262444 12996 raft_consensus.cc:2804] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:04.263005 12996 raft_consensus.cc:697] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:04.263331 12996 consensus_queue.cc:237] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.270604 11753 tablet_bootstrap.cc:492] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.270761 11753 ts_tablet_manager.cc:1403] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.123s user 0.002s sys 0.002s
I20260925 01:50:04.271524 11753 raft_consensus.cc:359] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.271705 11753 raft_consensus.cc:385] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.271764 11753 raft_consensus.cc:740] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.271955 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 80cd9735bf634871b7157443d0cfac37 (DEFAULT_TABLE table=default.Table_0a21405c13e44a9b98038ff6cd0205d0 [id=f121adbea26c4b80a2814aea1f8b2a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.272011 11753 consensus_queue.cc:260] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.272342 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80cd9735bf634871b7157443d0cfac37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.272603 11753 ts_tablet_manager.cc:1434] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:04.272887 11753 tablet_bootstrap.cc:492] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.275226 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 80cd9735bf634871b7157443d0cfac37 (DEFAULT_TABLE table=default.Table_0a21405c13e44a9b98038ff6cd0205d0 [id=f121adbea26c4b80a2814aea1f8b2a02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.275599 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80cd9735bf634871b7157443d0cfac37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.275550 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 729f52be49d849d1aa039a74e3da4981 (DEFAULT_TABLE table=default.Table_f99d8d394b9f4122829c839de171352e [id=c8d7109cb6af42faaa846944b81b983a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.275914 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f52be49d849d1aa039a74e3da4981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.284323 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 729f52be49d849d1aa039a74e3da4981 (DEFAULT_TABLE table=default.Table_f99d8d394b9f4122829c839de171352e [id=c8d7109cb6af42faaa846944b81b983a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.284973 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f52be49d849d1aa039a74e3da4981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.286540 11946 ts_tablet_manager.cc:1929] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.286672 11946 log.cc:1199] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/85d859207bbc4aefb26c726dce404c44
I20260925 01:50:04.286974 11946 ts_tablet_manager.cc:1950] T 85d859207bbc4aefb26c726dce404c44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.287786 11755 tablet_bootstrap.cc:492] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:04.287925 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 538) took 3544 ms. Trace:
I20260925 01:50:04.287952 11755 ts_tablet_manager.cc:1403] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.000s
I20260925 01:50:04.288012 11946 rpcz_store.cc:276] 0925 01:50:00.743369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.743826 (+ 457us) service_pool.cc:224] Handling call
0925 01:50:04.188251 (+3444425us) ts_tablet_manager.cc:1151] Deleting tablet 85d859207bbc4aefb26c726dce404c44
0925 01:50:04.188266 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.214673 (+ 26407us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.286453 (+ 71780us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.287905 (+ 1452us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3444323}
I20260925 01:50:04.288537 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 85d859207bbc4aefb26c726dce404c44 (table default.Table_b294b68c22864c009d79e9fb833ba9f1 [id=547a29a570064420aa9eaaec9543cdb3]) successfully deleted
I20260925 01:50:04.288666 11755 raft_consensus.cc:359] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.288846 11755 raft_consensus.cc:385] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.266693 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 340) took 9356 ms. Trace:
I20260925 01:50:04.290215 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe (DEFAULT_TABLE table=default.Table_a45eb10593cd43ec8508c6dee33b434e [id=2793026a9d0f40f39a0fc3acebef437d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.290661 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.289894 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 729f52be49d849d1aa039a74e3da4981 (DEFAULT_TABLE table=default.Table_f99d8d394b9f4122829c839de171352e [id=c8d7109cb6af42faaa846944b81b983a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.291225 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729f52be49d849d1aa039a74e3da4981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.291352 11754 tablet_bootstrap.cc:492] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.291494 11754 ts_tablet_manager.cc:1403] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.000s
I20260925 01:50:04.292188 11754 raft_consensus.cc:359] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.292361 11754 raft_consensus.cc:385] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.292423 11754 raft_consensus.cc:740] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.292678 11754 consensus_queue.cc:260] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.296325 11953 rpcz_store.cc:276] 0925 01:49:54.910675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.910799 (+ 124us) service_pool.cc:224] Handling call
0925 01:50:04.027518 (+9116719us) ts_tablet_manager.cc:1151] Deleting tablet ccffbe61eea34333abdc6da94612c0f6
0925 01:50:04.027529 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.090987 (+ 63458us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.121477 (+ 30490us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.266667 (+145190us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9113697}
I20260925 01:50:04.297214 12964 raft_consensus.cc:493] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.297367 12964 raft_consensus.cc:515] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.297847 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ccffbe61eea34333abdc6da94612c0f6 (table default.Table_b2c32d1c9f694835aa159840a4024f00 [id=fd0ffd9fb56b40f590be7bd7b9128f45]) successfully deleted
I20260925 01:50:04.298038 12964 leader_election.cc:290] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.298586 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 341) took 9386 ms. Trace:
I20260925 01:50:04.298818 11754 ts_tablet_manager.cc:1434] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
W20260925 01:50:04.301533 11456 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:04.302184 11753 tablet_bootstrap.cc:654] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.303424 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe (DEFAULT_TABLE table=default.Table_a45eb10593cd43ec8508c6dee33b434e [id=2793026a9d0f40f39a0fc3acebef437d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.303828 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.303874 11754 tablet_bootstrap.cc:492] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.306371 11754 tablet_bootstrap.cc:654] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.307284 11671 catalog_manager.cc:5838] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:04.311601 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 27455fcf8e7b4c3cbaab61969291a1bd (DEFAULT_TABLE table=default.Table_ab9614a352484be4a8f5e42dcf422828 [id=1ff50428177442f18d600c2fa48dd9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.312004 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27455fcf8e7b4c3cbaab61969291a1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.301005 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be89c0911dfa4b9d83d6bd88755be2b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.311702 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe (DEFAULT_TABLE table=default.Table_a45eb10593cd43ec8508c6dee33b434e [id=2793026a9d0f40f39a0fc3acebef437d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:04.313714 11457 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.313846 11457 leader_election.cc:304] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.313931 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.314218 12964 raft_consensus.cc:2749] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.323832 11953 rpcz_store.cc:276] 0925 01:49:54.912314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:54.912374 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:04.298444 (+9386070us) ts_tablet_manager.cc:1151] Deleting tablet 0e3ba459a81845699435c2e44f5c9f19
0925 01:50:04.298455 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.298564 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9383382}
I20260925 01:50:04.324529 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 27455fcf8e7b4c3cbaab61969291a1bd (DEFAULT_TABLE table=default.Table_ab9614a352484be4a8f5e42dcf422828 [id=1ff50428177442f18d600c2fa48dd9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.324927 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27455fcf8e7b4c3cbaab61969291a1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.288906 11755 raft_consensus.cc:740] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.332787 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 343) took 9161 ms. Trace:
I20260925 01:50:04.332890 11953 rpcz_store.cc:276] 0925 01:49:55.171015 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.171079 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:04.329116 (+9158037us) ts_tablet_manager.cc:1151] Deleting tablet 0749a0ae58df4ff8b74a86f072332fad
0925 01:50:04.331943 (+ 2827us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.332768 (+ 825us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9157772}
I20260925 01:50:04.333762 11755 consensus_queue.cc:260] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.334311 11522 raft_consensus.cc:1275] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Refusing update from remote peer b93565e796c94a3699eb1824383bbaeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 01:50:04.335040 12885 consensus_queue.cc:1048] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:50:04.335593 11177 consensus_peers.cc:597] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:04.336472 11204 tablet_service.cc:1511] Processing CreateTablet for tablet d9a1ac178d194c818bf71116f3d44dfc (DEFAULT_TABLE table=default.Table_92b2426cff01456aa879fd65bc0e112e [id=5ca26743fe35437687bed6bebf0624b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.336935 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a1ac178d194c818bf71116f3d44dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.338326 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff7d3c553114ac48c0c3584c24343a1 (DEFAULT_TABLE table=default.Table_362394b39f5c425499be7b3dc671fbba [id=a368fa54c449427b9cedc61e47f64e45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.338665 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff7d3c553114ac48c0c3584c24343a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.309691 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b8f82aa815bd42bdbf70a673e3a4c9da
I20260925 01:50:04.341559 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_167e60d2ec454ce38356ee349c14867b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:04.342257 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_167e60d2ec454ce38356ee349c14867b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:04.309825 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 43561.7us
W20260925 01:50:04.328843 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 0e3ba459a81845699435c2e44f5c9f19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e3ba459a81845699435c2e44f5c9f19 already in progress: creating tablet
I20260925 01:50:04.343266 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet b8f82aa815bd42bdbf70a673e3a4c9da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:04.343276 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 0749a0ae58df4ff8b74a86f072332fad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0749a0ae58df4ff8b74a86f072332fad already in progress: creating tablet
I20260925 01:50:04.344084 11358 tablet_service.cc:1511] Processing CreateTablet for tablet d9a1ac178d194c818bf71116f3d44dfc (DEFAULT_TABLE table=default.Table_92b2426cff01456aa879fd65bc0e112e [id=5ca26743fe35437687bed6bebf0624b4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:04.344326 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b8f82aa815bd42bdbf70a673e3a4c9da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8f82aa815bd42bdbf70a673e3a4c9da already in progress: creating tablet
I20260925 01:50:04.344590 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet b8f82aa815bd42bdbf70a673e3a4c9da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.344731 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet b8f82aa815bd42bdbf70a673e3a4c9da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.345077 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 27455fcf8e7b4c3cbaab61969291a1bd (DEFAULT_TABLE table=default.Table_ab9614a352484be4a8f5e42dcf422828 [id=1ff50428177442f18d600c2fa48dd9eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.345129 11492 tablet_service.cc:1511] Processing CreateTablet for tablet d9a1ac178d194c818bf71116f3d44dfc (DEFAULT_TABLE table=default.Table_92b2426cff01456aa879fd65bc0e112e [id=5ca26743fe35437687bed6bebf0624b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.345558 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a1ac178d194c818bf71116f3d44dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.351529 11946 tablet_replica.cc:333] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.351828 11946 raft_consensus.cc:2243] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:04.352224 11946 raft_consensus.cc:2272] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.353356 11946 ts_tablet_manager.cc:1916] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.355093 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff7d3c553114ac48c0c3584c24343a1 (DEFAULT_TABLE table=default.Table_362394b39f5c425499be7b3dc671fbba [id=a368fa54c449427b9cedc61e47f64e45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.355540 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff7d3c553114ac48c0c3584c24343a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.356993 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet db217278aa27439587768291c4ca7e3a
I20260925 01:50:04.357860 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f4b0958b4dfd4611a1e8c622ddc7fb28" } new_table_name: "default.Table_78fb2c35bc36492f8ae1eb15521969f5" modify_external_catalogs: true
I20260925 01:50:04.357968 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet db217278aa27439587768291c4ca7e3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:04.358783 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet db217278aa27439587768291c4ca7e3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db217278aa27439587768291c4ca7e3a already in progress: creating tablet
I20260925 01:50:04.359241 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet db217278aa27439587768291c4ca7e3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.359368 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ff70e44b72d1425c81751ff0b3d93b11
I20260925 01:50:04.359834 11672 catalog_manager.cc:6934] ReplaceTablet: tablet ff70e44b72d1425c81751ff0b3d93b11 deleted and replaced by tablet 03487a3fa9574fd583d9c95d0624203c
I20260925 01:50:04.360074 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet 17d628e46be942b3be3a69afd3f6968b from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:04.360100 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 with delete_type TABLET_DATA_DELETED (replaced by tablet 03487a3fa9574fd583d9c95d0624203c) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:04.360735 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ff70e44b72d1425c81751ff0b3d93b11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff70e44b72d1425c81751ff0b3d93b11 already in progress: creating tablet
I20260925 01:50:04.361136 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 with delete_type TABLET_DATA_DELETED (replaced by tablet 03487a3fa9574fd583d9c95d0624203c) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.364462 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a1ac178d194c818bf71116f3d44dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.365010 12980 tablet.cc:1751] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:04.367707 12969 tablet.cc:1751] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:04.370395 11212 tablet_service.cc:1511] Processing CreateTablet for tablet a36aab162abb4ecb97f8af106b8db006 (DEFAULT_TABLE table=default.Table_27e14f591c404a57b3f63a5d57a17a35 [id=d2588faeba974a188369389d4283ff42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.370823 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36aab162abb4ecb97f8af106b8db006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.374327 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27455fcf8e7b4c3cbaab61969291a1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.380483 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 74a5427634ea4bc48a2e7c764380c988 (DEFAULT_TABLE table=default.Table_c5adad03a1164397a2ba06ba460c508c [id=7b5e4d5137e64608a04cbebd64131c82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.380951 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a5427634ea4bc48a2e7c764380c988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.387156 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 74a5427634ea4bc48a2e7c764380c988 (DEFAULT_TABLE table=default.Table_c5adad03a1164397a2ba06ba460c508c [id=7b5e4d5137e64608a04cbebd64131c82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.387645 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a5427634ea4bc48a2e7c764380c988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.388116 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 70706bab33144ad09e6c00b37570a88f (DEFAULT_TABLE table=default.Table_36fc5acd12564526acfddbbc5b059d38 [id=3a7384d6f3784d628c1f869f6cb99653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.388491 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70706bab33144ad09e6c00b37570a88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.393093 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 70706bab33144ad09e6c00b37570a88f (DEFAULT_TABLE table=default.Table_36fc5acd12564526acfddbbc5b059d38 [id=3a7384d6f3784d628c1f869f6cb99653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.393563 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70706bab33144ad09e6c00b37570a88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.394044 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7d26af44f948948e0d4e6ac9e072c0 (DEFAULT_TABLE table=default.Table_ca6dba60babb4961bfc10a76b8cec13d [id=322335ff6f12469b91cb8af100a7f1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.394433 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7d26af44f948948e0d4e6ac9e072c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.412376 11946 ts_tablet_manager.cc:1929] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:04.412770 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 with delete_type TABLET_DATA_DELETED (replaced by tablet 03487a3fa9574fd583d9c95d0624203c) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.413264 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 1ff7d3c553114ac48c0c3584c24343a1 (DEFAULT_TABLE table=default.Table_362394b39f5c425499be7b3dc671fbba [id=a368fa54c449427b9cedc61e47f64e45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.413663 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ff7d3c553114ac48c0c3584c24343a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.418624 11946 log.cc:1199] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/4d7b3c65d8a64734b2c432790dae07e1
I20260925 01:50:04.419055 11946 ts_tablet_manager.cc:1950] T 4d7b3c65d8a64734b2c432790dae07e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.419981 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 539) took 3676 ms. Trace:
I20260925 01:50:04.420080 11946 rpcz_store.cc:276] 0925 01:50:00.743460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.743936 (+ 476us) service_pool.cc:224] Handling call
0925 01:50:04.351463 (+3607527us) ts_tablet_manager.cc:1151] Deleting tablet 4d7b3c65d8a64734b2c432790dae07e1
0925 01:50:04.351474 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.357141 (+ 5667us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.412300 (+ 55159us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.419959 (+ 7659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3607414}
I20260925 01:50:04.420446 12964 raft_consensus.cc:493] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.420593 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 4d7b3c65d8a64734b2c432790dae07e1 (table default.Table_b00b413ef17343febe7fadd2f08ae596 [id=0cfde61c060841d8b99d75fa7557a258]) successfully deleted
I20260925 01:50:04.420573 12964 raft_consensus.cc:515] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.421336 12964 leader_election.cc:290] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:04.422504 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d50e428bfc46caa130f96ccc7e8f40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:04.422737 11238 raft_consensus.cc:2468] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:04.423146 11352 tablet_service.cc:1511] Processing CreateTablet for tablet a36aab162abb4ecb97f8af106b8db006 (DEFAULT_TABLE table=default.Table_27e14f591c404a57b3f63a5d57a17a35 [id=d2588faeba974a188369389d4283ff42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.423199 11456 leader_election.cc:304] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.423439 12964 raft_consensus.cc:2804] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:04.423522 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36aab162abb4ecb97f8af106b8db006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.423516 12964 raft_consensus.cc:493] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:04.423573 12964 raft_consensus.cc:3060] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.426285 12964 raft_consensus.cc:515] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.426452 11946 tablet_replica.cc:333] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.426636 11946 raft_consensus.cc:2243] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.426779 11946 raft_consensus.cc:2272] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.427325 11946 ts_tablet_manager.cc:1916] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.427345 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d50e428bfc46caa130f96ccc7e8f40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:04.427934 11457 leader_election.cc:343] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.428236 12964 leader_election.cc:290] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:04.428789 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d50e428bfc46caa130f96ccc7e8f40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:04.428984 11238 raft_consensus.cc:3060] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.429455 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 74a5427634ea4bc48a2e7c764380c988 (DEFAULT_TABLE table=default.Table_c5adad03a1164397a2ba06ba460c508c [id=7b5e4d5137e64608a04cbebd64131c82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.429824 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a5427634ea4bc48a2e7c764380c988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.431988 11488 tablet_service.cc:1511] Processing CreateTablet for tablet a36aab162abb4ecb97f8af106b8db006 (DEFAULT_TABLE table=default.Table_27e14f591c404a57b3f63a5d57a17a35 [id=d2588faeba974a188369389d4283ff42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.432327 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a36aab162abb4ecb97f8af106b8db006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.432308 11238 raft_consensus.cc:2468] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:04.432871 11456 leader_election.cc:304] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:04.433254 12964 raft_consensus.cc:2804] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:04.433343 12964 raft_consensus.cc:697] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:04.433553 12964 consensus_queue.cc:237] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.437872 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 70706bab33144ad09e6c00b37570a88f (DEFAULT_TABLE table=default.Table_36fc5acd12564526acfddbbc5b059d38 [id=3a7384d6f3784d628c1f869f6cb99653]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.438316 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70706bab33144ad09e6c00b37570a88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.439981 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7d26af44f948948e0d4e6ac9e072c0 (DEFAULT_TABLE table=default.Table_ca6dba60babb4961bfc10a76b8cec13d [id=322335ff6f12469b91cb8af100a7f1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.440358 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7d26af44f948948e0d4e6ac9e072c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.449934 12933 raft_consensus.cc:493] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.450120 12933 raft_consensus.cc:515] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.450716 12933 leader_election.cc:290] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:04.451241 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d50e428bfc46caa130f96ccc7e8f40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.451320 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 71a64863f0744f44943113d7c60806b7 (DEFAULT_TABLE table=default.Table_efa90132b756448babd6a66ce360d744 [id=f7c63e1af3534aa8b9190a6a0ba9e1bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.451459 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28c8f00a8634ef89e4773b62e095b74" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.451730 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a64863f0744f44943113d7c60806b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.451747 11522 raft_consensus.cc:2393] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
W20260925 01:50:04.452564 11457 leader_election.cc:343] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.463828 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 71a64863f0744f44943113d7c60806b7 (DEFAULT_TABLE table=default.Table_efa90132b756448babd6a66ce360d744 [id=f7c63e1af3534aa8b9190a6a0ba9e1bb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:04.464356 11314 leader_election.cc:343] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c28c8f00a8634ef89e4773b62e095b74
I20260925 01:50:04.464480 11314 leader_election.cc:304] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.464708 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a64863f0744f44943113d7c60806b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.464859 12933 raft_consensus.cc:3060] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.464973 11946 ts_tablet_manager.cc:1929] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.465080 11946 log.cc:1199] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:50:04.465373 11946 ts_tablet_manager.cc:1950] T 17352fd6ea4e4ed9a178f1510edf4f6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.465911 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7d26af44f948948e0d4e6ac9e072c0 (DEFAULT_TABLE table=default.Table_ca6dba60babb4961bfc10a76b8cec13d [id=322335ff6f12469b91cb8af100a7f1f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.466333 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7d26af44f948948e0d4e6ac9e072c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.468245 12933 raft_consensus.cc:2749] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.473249 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 8d261808192d4ba09ab368a41e101d39 (DEFAULT_TABLE table=default.Table_301e577f16d742e8b3d2728f29ac4e47 [id=c019247485b64d8f8b03b87c514ba7c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.473320 12967 consensus_queue.cc:1048] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:04.473786 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d261808192d4ba09ab368a41e101d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.474222 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 535) took 3731 ms. Trace:
I20260925 01:50:04.474326 11946 rpcz_store.cc:276] 0925 01:50:00.743100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.744067 (+ 967us) service_pool.cc:224] Handling call
0925 01:50:04.426402 (+3682335us) ts_tablet_manager.cc:1151] Deleting tablet 17352fd6ea4e4ed9a178f1510edf4f6d
0925 01:50:04.426413 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.440003 (+ 13590us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.464908 (+ 24905us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.474199 (+ 9291us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3682171}
I20260925 01:50:04.474711 11946 tablet_replica.cc:333] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.476181 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 17352fd6ea4e4ed9a178f1510edf4f6d (table default.Table_ca88ffeaae4a4f1999cf9834715b791b [id=9389812769844f279c1e0c5fa9707dc0]) successfully deleted
I20260925 01:50:04.477336 12933 raft_consensus.cc:493] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.477427 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 71a64863f0744f44943113d7c60806b7 (DEFAULT_TABLE table=default.Table_efa90132b756448babd6a66ce360d744 [id=f7c63e1af3534aa8b9190a6a0ba9e1bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.477545 12933 raft_consensus.cc:515] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.477809 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a64863f0744f44943113d7c60806b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.478128 11946 raft_consensus.cc:2243] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.478341 11946 raft_consensus.cc:2272] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.478588 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 8d261808192d4ba09ab368a41e101d39 (DEFAULT_TABLE table=default.Table_301e577f16d742e8b3d2728f29ac4e47 [id=c019247485b64d8f8b03b87c514ba7c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.478920 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d261808192d4ba09ab368a41e101d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.478991 11946 ts_tablet_manager.cc:1916] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:04.479579 11314 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
I20260925 01:50:04.479856 12933 leader_election.cc:290] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:04.481652 12967 consensus_queue.cc:1048] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:04.483454 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 2c93bb7a34f94deaa65f8b588c604b81 (DEFAULT_TABLE table=default.Table_58ce32fc2217428ab10cab615b1c968e [id=92398df2944443acaa59d969be660163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.483807 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c93bb7a34f94deaa65f8b588c604b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.484858 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 8d261808192d4ba09ab368a41e101d39 (DEFAULT_TABLE table=default.Table_301e577f16d742e8b3d2728f29ac4e47 [id=c019247485b64d8f8b03b87c514ba7c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.485258 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d261808192d4ba09ab368a41e101d39. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:04.487316 11314 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
I20260925 01:50:04.487466 11314 leader_election.cc:304] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:04.491142 11457 consensus_peers.cc:597] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:04.495405 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 2c93bb7a34f94deaa65f8b588c604b81 (DEFAULT_TABLE table=default.Table_58ce32fc2217428ab10cab615b1c968e [id=92398df2944443acaa59d969be660163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.496100 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c93bb7a34f94deaa65f8b588c604b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.496150 12933 raft_consensus.cc:2749] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:04.503240 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 7976799ecf7e4c3e9ea6e74e9c8720c2 (DEFAULT_TABLE table=default.Table_c21eb1eda2f74840a870850b1ac2d349 [id=1a4d395732164545aebe94e44ea16231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.503756 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7976799ecf7e4c3e9ea6e74e9c8720c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.505255 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 2c93bb7a34f94deaa65f8b588c604b81 (DEFAULT_TABLE table=default.Table_58ce32fc2217428ab10cab615b1c968e [id=92398df2944443acaa59d969be660163]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.505622 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c93bb7a34f94deaa65f8b588c604b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.510186 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet db217278aa27439587768291c4ca7e3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.510510 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 344) took 9217 ms. Trace:
I20260925 01:50:04.510727 11953 rpcz_store.cc:276] 0925 01:49:55.293471 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.293535 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:04.353287 (+9059752us) ts_tablet_manager.cc:1151] Deleting tablet 113d7ccee4e349e19d3948e09d2c533d
0925 01:50:04.510362 (+157075us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.510491 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9059150}
W20260925 01:50:04.511260 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 113d7ccee4e349e19d3948e09d2c533d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113d7ccee4e349e19d3948e09d2c533d already in progress: creating tablet
I20260925 01:50:04.511623 11953 tablet_replica.cc:333] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:04.511835 11953 raft_consensus.cc:2243] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.512008 11953 raft_consensus.cc:2272] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.512569 11953 ts_tablet_manager.cc:1916] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.512660 11946 ts_tablet_manager.cc:1929] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:04.513990 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 7976799ecf7e4c3e9ea6e74e9c8720c2 (DEFAULT_TABLE table=default.Table_c21eb1eda2f74840a870850b1ac2d349 [id=1a4d395732164545aebe94e44ea16231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.514359 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7976799ecf7e4c3e9ea6e74e9c8720c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.514338 11212 tablet_service.cc:1511] Processing CreateTablet for tablet a7e0abecec40457eb8f15a48117cf8e4 (DEFAULT_TABLE table=default.Table_286e8f931c00432a90bfebcf44f6154e [id=10e280ba493144fa8ae587d50827858a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.514714 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e0abecec40457eb8f15a48117cf8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.514796 11946 log.cc:1199] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/80fe96946b294785b8d76564e0f5fa12
I20260925 01:50:04.515287 11946 ts_tablet_manager.cc:1950] T 80fe96946b294785b8d76564e0f5fa12 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.512864 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 7976799ecf7e4c3e9ea6e74e9c8720c2 (DEFAULT_TABLE table=default.Table_c21eb1eda2f74840a870850b1ac2d349 [id=1a4d395732164545aebe94e44ea16231]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.521518 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7976799ecf7e4c3e9ea6e74e9c8720c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.521489 11755 ts_tablet_manager.cc:1434] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.233s user 0.002s sys 0.000s
I20260925 01:50:04.523403 11755 tablet_bootstrap.cc:492] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:04.524947 11755 tablet_bootstrap.cc:654] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.528277 11494 tablet_service.cc:1511] Processing CreateTablet for tablet a7e0abecec40457eb8f15a48117cf8e4 (DEFAULT_TABLE table=default.Table_286e8f931c00432a90bfebcf44f6154e [id=10e280ba493144fa8ae587d50827858a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.528724 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e0abecec40457eb8f15a48117cf8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.350574 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:04.529973 11671 catalog_manager.cc:5838] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:04.530550 11671 catalog_manager.cc:5838] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:04.531304 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 0575861dd3d6437284cc183acb87af0a (table default.Table_1a17bc9d97f7458e8ec979b4728fa9e5 [id=1a5a59e2daad4fb78689dd25363b7086]). Expected version 1 got 0
I20260925 01:50:04.531621 11671 catalog_manager.cc:5838] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:04.532022 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7da55c488da540048a94324fa347c1ef (table default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17]). Expected version 5 got 0
I20260925 01:50:04.537045 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f (DEFAULT_TABLE table=default.Table_5867f948c3824f95a39d7ccbc8b319d4 [id=ebfa0206bada432092bb94e67f31fa23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.537580 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:04.554374 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 007ee8e3087c4a70b9c5d8436a31659f consensus state has no leader
I20260925 01:50:04.557703 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f (DEFAULT_TABLE table=default.Table_5867f948c3824f95a39d7ccbc8b319d4 [id=ebfa0206bada432092bb94e67f31fa23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.558341 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.562983 11754 tablet_bootstrap.cc:492] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.563169 11754 ts_tablet_manager.cc:1403] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.260s user 0.022s sys 0.030s
I20260925 01:50:04.563915 11754 raft_consensus.cc:359] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.564109 11754 raft_consensus.cc:385] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.564168 11754 raft_consensus.cc:740] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.564438 11754 consensus_queue.cc:260] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.566404 11754 ts_tablet_manager.cc:1434] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:04.567121 11754 tablet_bootstrap.cc:492] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.571103 11754 tablet_bootstrap.cc:654] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.574188 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 6091ed7d816a46958a6de343fe682292 (DEFAULT_TABLE table=default.Table_1ee75b9473fc4bd286125af7095cfc80 [id=8c7d3809c5f54912a6d06e8ef61f0fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.574779 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6091ed7d816a46958a6de343fe682292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.577898 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed1e103a0ec413494a46dad6c2ed006 (DEFAULT_TABLE table=default.Table_cd450609843b4948942124e3f99ce8b7 [id=09d93cd1238f4429a83b7d63be5b3b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.578035 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e63c9983706349cc9be41a3203248fba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:04.578423 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 6091ed7d816a46958a6de343fe682292 (DEFAULT_TABLE table=default.Table_1ee75b9473fc4bd286125af7095cfc80 [id=8c7d3809c5f54912a6d06e8ef61f0fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.578449 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddb5961efcb4fb6838ee183b3211feb (DEFAULT_TABLE table=default.Table_6494d683e65047fdbb34edad8bc00960 [id=0a2d7580749b4e7ba4a46d36bf39756c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:04.578752 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63c9983706349cc9be41a3203248fba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.578999 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddb5961efcb4fb6838ee183b3211feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.580206 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed1e103a0ec413494a46dad6c2ed006 (DEFAULT_TABLE table=default.Table_cd450609843b4948942124e3f99ce8b7 [id=09d93cd1238f4429a83b7d63be5b3b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.580649 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed1e103a0ec413494a46dad6c2ed006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.587597 13068 raft_consensus.cc:493] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.587752 13068 raft_consensus.cc:515] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.588836 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfde700aff8049f4b10c46059da6907f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:04.589561 11456 leader_election.cc:343] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.589852 12964 raft_consensus.cc:493] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.590013 12964 raft_consensus.cc:515] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.591022 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f778b87d307483b9edb17dce7355a65" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:04.591410 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed1e103a0ec413494a46dad6c2ed006. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:04.591552 11456 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.592176 12964 leader_election.cc:290] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.592639 13068 leader_election.cc:290] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.598150 11753 tablet_bootstrap.cc:492] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.598308 11753 ts_tablet_manager.cc:1403] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.326s user 0.023s sys 0.044s
I20260925 01:50:04.598896 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6091ed7d816a46958a6de343fe682292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.599103 11753 raft_consensus.cc:359] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.599279 11753 raft_consensus.cc:385] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.599332 11753 raft_consensus.cc:740] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.599547 11753 consensus_queue.cc:260] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.600116 11753 ts_tablet_manager.cc:1434] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:04.600665 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddb5961efcb4fb6838ee183b3211feb (DEFAULT_TABLE table=default.Table_6494d683e65047fdbb34edad8bc00960 [id=0a2d7580749b4e7ba4a46d36bf39756c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.602226 12933 raft_consensus.cc:493] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.602427 12933 raft_consensus.cc:515] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.603243 12933 leader_election.cc:290] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:04.603552 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f778b87d307483b9edb17dce7355a65" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.603763 11379 raft_consensus.cc:3060] T 1c29e410731842aeb64ab8eeb4ccc3ca P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.604316 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c1abd3c2cb34915a595ea73a8d10743" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.604539 11522 raft_consensus.cc:2393] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:50:04.610291 11377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfde700aff8049f4b10c46059da6907f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.614229 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddb5961efcb4fb6838ee183b3211feb (DEFAULT_TABLE table=default.Table_6494d683e65047fdbb34edad8bc00960 [id=0a2d7580749b4e7ba4a46d36bf39756c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.614710 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddb5961efcb4fb6838ee183b3211feb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:04.614938 11457 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.615052 11457 leader_election.cc:304] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:04.615439 11457 leader_election.cc:343] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.615530 11457 leader_election.cc:304] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.615556 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 540) took 3767 ms. Trace:
I20260925 01:50:04.615672 11946 rpcz_store.cc:276] 0925 01:50:00.847842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.848118 (+ 276us) service_pool.cc:224] Handling call
0925 01:50:04.474660 (+3626542us) ts_tablet_manager.cc:1151] Deleting tablet 80fe96946b294785b8d76564e0f5fa12
0925 01:50:04.474671 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.487175 (+ 12504us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.512541 (+ 25366us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.615503 (+102962us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99189,"tablet-delete.queue_time_us":3626367}
I20260925 01:50:04.616088 11946 tablet_replica.cc:333] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.616293 13068 raft_consensus.cc:2749] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.616371 11946 raft_consensus.cc:2243] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:50:04.616401 11314 leader_election.cc:343] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8c1abd3c2cb34915a595ea73a8d10743
I20260925 01:50:04.616441 13068 raft_consensus.cc:2749] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.616559 13068 consensus_queue.cc:1048] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:04.616590 11314 leader_election.cc:304] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.616772 11946 raft_consensus.cc:2272] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.617141 12933 raft_consensus.cc:3060] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.617473 11946 ts_tablet_manager.cc:1916] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.617529 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 80fe96946b294785b8d76564e0f5fa12 (table default.Table_6485a2bca5c748b2b999b93e8f115290 [id=1e8d3bfbc5bb4df7837d4178665e79eb]) successfully deleted
I20260925 01:50:04.623447 11754 tablet_bootstrap.cc:492] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.623612 11754 ts_tablet_manager.cc:1403] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.057s user 0.000s sys 0.004s
I20260925 01:50:04.623714 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 6091ed7d816a46958a6de343fe682292 (DEFAULT_TABLE table=default.Table_1ee75b9473fc4bd286125af7095cfc80 [id=8c7d3809c5f54912a6d06e8ef61f0fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.624888 11754 raft_consensus.cc:359] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.625257 11754 raft_consensus.cc:385] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.625365 11754 raft_consensus.cc:740] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.625633 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f (DEFAULT_TABLE table=default.Table_5867f948c3824f95a39d7ccbc8b319d4 [id=ebfa0206bada432092bb94e67f31fa23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.625640 11754 consensus_queue.cc:260] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.626210 11342 tablet_service.cc:1511] Processing CreateTablet for tablet a7e0abecec40457eb8f15a48117cf8e4 (DEFAULT_TABLE table=default.Table_286e8f931c00432a90bfebcf44f6154e [id=10e280ba493144fa8ae587d50827858a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.629563 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddb5961efcb4fb6838ee183b3211feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.630312 12933 raft_consensus.cc:2749] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.630821 11754 ts_tablet_manager.cc:1434] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.001s sys 0.002s
I20260925 01:50:04.632582 11946 ts_tablet_manager.cc:1929] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:04.632834 11946 log.cc:1199] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/7ee95aba7a8f4d8db4ed0b8a862dab63
I20260925 01:50:04.633507 11946 ts_tablet_manager.cc:1950] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.634533 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 541) took 3742 ms. Trace:
I20260925 01:50:04.634608 11754 tablet_bootstrap.cc:492] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.635720 11946 rpcz_store.cc:276] 0925 01:50:00.892240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.892292 (+ 52us) service_pool.cc:224] Handling call
0925 01:50:04.616036 (+3723744us) ts_tablet_manager.cc:1151] Deleting tablet 7ee95aba7a8f4d8db4ed0b8a862dab63
0925 01:50:04.616047 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.623749 (+ 7702us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.632468 (+ 8719us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.634511 (+ 2043us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3723568}
I20260925 01:50:04.636574 11755 tablet_bootstrap.cc:492] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:04.636531 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030]) successfully deleted
I20260925 01:50:04.637032 11946 tablet_replica.cc:333] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.637274 11946 raft_consensus.cc:2243] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.637584 11946 raft_consensus.cc:2272] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.645658 11212 tablet_service.cc:1511] Processing CreateTablet for tablet d7c44d814b1d4cb785f244f2eed90c09 (DEFAULT_TABLE table=default.Table_b28d944249da44c997013470672b2958 [id=696daf5edab2471889fa0661f9b204cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.646322 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c44d814b1d4cb785f244f2eed90c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.648780 11353 tablet_service.cc:1511] Processing CreateTablet for tablet d7c44d814b1d4cb785f244f2eed90c09 (DEFAULT_TABLE table=default.Table_b28d944249da44c997013470672b2958 [id=696daf5edab2471889fa0661f9b204cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.655046 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e0abecec40457eb8f15a48117cf8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.655619 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c44d814b1d4cb785f244f2eed90c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.641072 11753 tablet_bootstrap.cc:492] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.660049 11753 tablet_bootstrap.cc:654] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.660557 11754 tablet_bootstrap.cc:654] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.647367 11488 tablet_service.cc:1511] Processing CreateTablet for tablet d7c44d814b1d4cb785f244f2eed90c09 (DEFAULT_TABLE table=default.Table_b28d944249da44c997013470672b2958 [id=696daf5edab2471889fa0661f9b204cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.661247 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c44d814b1d4cb785f244f2eed90c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.665668 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 4ed1e103a0ec413494a46dad6c2ed006 (DEFAULT_TABLE table=default.Table_cd450609843b4948942124e3f99ce8b7 [id=09d93cd1238f4429a83b7d63be5b3b08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:04.669224 11946 ts_tablet_manager.cc:1916] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.670348 12933 raft_consensus.cc:493] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:04.670583 12933 raft_consensus.cc:515] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.671288 12933 leader_election.cc:290] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:50:04.672904 11314 leader_election.cc:343] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 0fa7a3941254478c800f9e366e3f7b06
W20260925 01:50:04.673372 11314 leader_election.cc:343] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 0fa7a3941254478c800f9e366e3f7b06
I20260925 01:50:04.673532 11314 leader_election.cc:304] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.674103 12933 raft_consensus.cc:2749] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:04.675040 11753 tablet_bootstrap.cc:492] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.675243 11753 ts_tablet_manager.cc:1403] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.001s
I20260925 01:50:04.676036 11753 raft_consensus.cc:359] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.676278 11753 raft_consensus.cc:385] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.676391 11753 raft_consensus.cc:740] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.676704 11753 consensus_queue.cc:260] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.677623 11753 ts_tablet_manager.cc:1434] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:04.678018 11753 tablet_bootstrap.cc:492] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.678014 11755 ts_tablet_manager.cc:1403] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.000s
I20260925 01:50:04.678761 11755 raft_consensus.cc:359] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.678973 11755 raft_consensus.cc:385] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.679055 11755 raft_consensus.cc:740] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.679343 11755 consensus_queue.cc:260] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.679708 11754 tablet_bootstrap.cc:492] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.679886 11754 ts_tablet_manager.cc:1403] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.001s
I20260925 01:50:04.680686 11753 tablet_bootstrap.cc:654] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.680691 11754 raft_consensus.cc:359] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.680924 11754 raft_consensus.cc:385] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.681005 11754 raft_consensus.cc:740] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.681062 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ed1e103a0ec413494a46dad6c2ed006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.681253 11754 consensus_queue.cc:260] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.682157 11754 ts_tablet_manager.cc:1434] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:04.682799 11754 tablet_bootstrap.cc:492] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.686136 11754 tablet_bootstrap.cc:654] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.694101 11946 ts_tablet_manager.cc:1929] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:04.694267 11946 log.cc:1199] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/3e3a033c9e7545479130c7a3c48ac254
I20260925 01:50:04.695346 11946 ts_tablet_manager.cc:1950] T 3e3a033c9e7545479130c7a3c48ac254 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.696214 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 542) took 3617 ms. Trace:
I20260925 01:50:04.696313 11946 rpcz_store.cc:276] 0925 01:50:01.078828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.078924 (+ 96us) service_pool.cc:224] Handling call
0925 01:50:04.636962 (+3558038us) ts_tablet_manager.cc:1151] Deleting tablet 3e3a033c9e7545479130c7a3c48ac254
0925 01:50:04.636977 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.681349 (+ 44372us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.688018 (+ 6669us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.696194 (+ 8176us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3557835}
I20260925 01:50:04.696904 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 3e3a033c9e7545479130c7a3c48ac254 (table default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c [id=603d80ba3d934fc69b60ff151671e75d]) successfully deleted
I20260925 01:50:04.698199 11753 tablet_bootstrap.cc:492] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.698395 11753 ts_tablet_manager.cc:1403] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260925 01:50:04.699326 11753 raft_consensus.cc:359] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.699689 11753 raft_consensus.cc:385] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.699788 11753 raft_consensus.cc:740] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.700098 11753 consensus_queue.cc:260] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.700891 11753 ts_tablet_manager.cc:1434] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:04.701252 11753 tablet_bootstrap.cc:492] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.703145 11753 tablet_bootstrap.cc:654] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.703367 11946 tablet_replica.cc:333] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.704329 11946 raft_consensus.cc:2243] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:04.704300 11667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.253:42889, user_credentials={real_user=slave}} blocked reactor thread for 67042.2us
I20260925 01:50:04.704558 11754 tablet_bootstrap.cc:492] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:04.704573 11946 raft_consensus.cc:2272] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.704730 11754 ts_tablet_manager.cc:1403] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.009s
I20260925 01:50:04.705111 11946 ts_tablet_manager.cc:1916] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.705500 12933 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:04.705677 11754 raft_consensus.cc:359] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.705773 12933 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.705935 11754 raft_consensus.cc:385] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.706007 11754 raft_consensus.cc:740] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.706668 11754 consensus_queue.cc:260] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.708570 11754 ts_tablet_manager.cc:1434] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260925 01:50:04.708837 11754 tablet_bootstrap.cc:492] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:04.713090 11753 tablet_bootstrap.cc:492] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.713241 11753 ts_tablet_manager.cc:1403] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260925 01:50:04.713930 11753 raft_consensus.cc:359] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.714152 11753 raft_consensus.cc:385] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.714217 11753 raft_consensus.cc:740] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.714457 11753 consensus_queue.cc:260] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.715098 11753 ts_tablet_manager.cc:1434] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:04.714738 11754 tablet_bootstrap.cc:654] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.717375 11946 ts_tablet_manager.cc:1929] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.717471 11946 log.cc:1199] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/90647937eb364a7a973d04ea69cbc9aa
W20260925 01:50:04.717609 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ef093a4a1134407ba94207137ce3e81 consensus state has no leader
I20260925 01:50:04.717814 11946 ts_tablet_manager.cc:1950] T 90647937eb364a7a973d04ea69cbc9aa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.718288 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_b90907533e8c44c197c71f7dc9266cfe [id=464edb71967c4016ae7592aaad5492d6] alter complete (version 4)
I20260925 01:50:04.718575 12885 raft_consensus.cc:493] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.718731 12885 raft_consensus.cc:515] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.719473 12885 leader_election.cc:290] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.720695 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c46e780d4a4987ad52619e4c3b46c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.720945 12689 tablet_replica.cc:333] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:04.721191 12689 raft_consensus.cc:2243] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.721335 12689 raft_consensus.cc:2272] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.721853 12689 ts_tablet_manager.cc:1916] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.722422 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9068770de0b473488bd8ea4752fb15d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.722599 11522 raft_consensus.cc:2468] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:04.723109 11176 leader_election.cc:304] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.723670 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ff85bac0d22416987e8e3b379154b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.723837 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.730201 12885 raft_consensus.cc:2804] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:04.730325 12885 raft_consensus.cc:493] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:04.730402 12885 raft_consensus.cc:3060] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.730945 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 93329036763146beb8e6a9b039cc1ec1 with delete_type TABLET_DATA_DELETED (replaced by tablet 1f1d2d998d834c21ab83694daae37520) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.731374 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet ccffbe61eea34333abdc6da94612c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:44 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.734191 12885 raft_consensus.cc:515] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.735663 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9068770de0b473488bd8ea4752fb15d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:04.735884 11522 raft_consensus.cc:3060] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.740046 11522 raft_consensus.cc:2468] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:04.740909 11176 leader_election.cc:304] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.741232 12996 raft_consensus.cc:2804] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:04.741358 12996 raft_consensus.cc:697] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:04.741636 12996 consensus_queue.cc:237] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.742111 12885 leader_election.cc:290] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.743641 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6091ed7d816a46958a6de343fe682292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.744202 12689 ts_tablet_manager.cc:1929] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.744352 12689 log.cc:1199] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a8c46e780d4a4987ad52619e4c3b46c9
I20260925 01:50:04.744756 12689 ts_tablet_manager.cc:1950] T a8c46e780d4a4987ad52619e4c3b46c9 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:04.746099 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a8c46e780d4a4987ad52619e4c3b46c9 (table default.Table_e973513b7c3d4c1dadf184056a92dad5 [id=a60aa9bcded3478f908ca2bdaafd1e41]) successfully deleted
I20260925 01:50:04.755844 11753 tablet_bootstrap.cc:492] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:04.756491 12689 tablet_replica.cc:333] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:04.756793 12689 raft_consensus.cc:2243] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.757125 12689 raft_consensus.cc:2272] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.757541 11753 tablet_bootstrap.cc:654] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.759069 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 543) took 3673 ms. Trace:
I20260925 01:50:04.759167 11946 rpcz_store.cc:276] 0925 01:50:01.085833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.087053 (+ 1220us) service_pool.cc:224] Handling call
0925 01:50:04.703322 (+3616269us) ts_tablet_manager.cc:1151] Deleting tablet 90647937eb364a7a973d04ea69cbc9aa
0925 01:50:04.703331 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.708492 (+ 5161us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.717323 (+ 8831us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.759032 (+ 41709us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3589614}
I20260925 01:50:04.759654 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 547) took 3319 ms. Trace:
I20260925 01:50:04.759663 12689 ts_tablet_manager.cc:1916] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.759749 11946 rpcz_store.cc:276] 0925 01:50:01.439843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.439887 (+ 44us) service_pool.cc:224] Handling call
0925 01:50:04.759482 (+3319595us) ts_tablet_manager.cc:1151] Deleting tablet 8036963ed28c4e0aae2c4a0bd8e9c99b
0925 01:50:04.759493 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.759627 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3319401}
I20260925 01:50:04.760102 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 548) took 3319 ms. Trace:
I20260925 01:50:04.760185 11946 rpcz_store.cc:276] 0925 01:50:01.440284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.440326 (+ 42us) service_pool.cc:224] Handling call
0925 01:50:04.760001 (+3319675us) ts_tablet_manager.cc:1151] Deleting tablet 716ad6cdf9864fc3b09d88753d45f45f
0925 01:50:04.760010 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.760083 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3319528}
I20260925 01:50:04.760567 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 549) took 3319 ms. Trace:
I20260925 01:50:04.760641 11946 rpcz_store.cc:276] 0925 01:50:01.440650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.440690 (+ 40us) service_pool.cc:224] Handling call
0925 01:50:04.760398 (+3319708us) ts_tablet_manager.cc:1151] Deleting tablet 252415635b5e4b3286948e91d421d6f1
0925 01:50:04.760407 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.760550 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3319580}
W20260925 01:50:04.760911 11314 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:04.760959 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 551) took 3299 ms. Trace:
I20260925 01:50:04.761019 11946 rpcz_store.cc:276] 0925 01:50:01.461574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.508640 (+ 47066us) service_pool.cc:224] Handling call
0925 01:50:04.760856 (+3252216us) ts_tablet_manager.cc:1151] Deleting tablet 406d31139e1e441aa6fe204168486e28
0925 01:50:04.760864 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.760932 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3251956}
I20260925 01:50:04.761250 11946 tablet_replica.cc:333] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.760524 12933 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:04.761440 11946 raft_consensus.cc:2243] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:04.761767 11946 raft_consensus.cc:2272] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.761719 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.761894 11522 raft_consensus.cc:2468] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:04.762377 11314 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.762917 12933 raft_consensus.cc:2804] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 01:50:04.763048 12933 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:04.763190 12933 raft_consensus.cc:3060] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Advancing to term 2
I20260925 01:50:04.763243 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 90647937eb364a7a973d04ea69cbc9aa (table default.Table_553188612c2849459f15c537d8a3e1fb [id=b28a5a591ec94b0f9a8987306d7eb24c]) successfully deleted
W20260925 01:50:04.763585 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8036963ed28c4e0aae2c4a0bd8e9c99b already in progress: creating tablet
W20260925 01:50:04.763844 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 716ad6cdf9864fc3b09d88753d45f45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 716ad6cdf9864fc3b09d88753d45f45f already in progress: creating tablet
W20260925 01:50:04.764145 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 252415635b5e4b3286948e91d421d6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 252415635b5e4b3286948e91d421d6f1 already in progress: creating tablet
W20260925 01:50:04.764398 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 406d31139e1e441aa6fe204168486e28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 406d31139e1e441aa6fe204168486e28 already in progress: creating tablet
I20260925 01:50:04.765265 11946 ts_tablet_manager.cc:1916] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.767551 11755 ts_tablet_manager.cc:1434] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.019s user 0.001s sys 0.000s
I20260925 01:50:04.767946 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:04.772967 12689 ts_tablet_manager.cc:1929] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.781148 11946 ts_tablet_manager.cc:1929] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:04.781081 12947 consensus_queue.cc:1048] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:04.781265 11946 log.cc:1199] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/4d9558462332400d92f7d61858bdeca2
I20260925 01:50:04.781672 11946 ts_tablet_manager.cc:1950] T 4d9558462332400d92f7d61858bdeca2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.789069 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 552) took 3280 ms. Trace:
I20260925 01:50:04.789175 11946 rpcz_store.cc:276] 0925 01:50:01.509119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.509452 (+ 333us) service_pool.cc:224] Handling call
0925 01:50:04.761210 (+3251758us) ts_tablet_manager.cc:1151] Deleting tablet 4d9558462332400d92f7d61858bdeca2
0925 01:50:04.761218 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.769784 (+ 8566us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.781085 (+ 11301us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.789042 (+ 7957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6443,"tablet-delete.queue_time_us":3251591}
I20260925 01:50:04.789610 12689 log.cc:1199] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/6ff85bac0d22416987e8e3b379154b09
I20260925 01:50:04.789702 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]) successfully deleted
I20260925 01:50:04.793951 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 553) took 3284 ms. Trace:
I20260925 01:50:04.794596 12689 ts_tablet_manager.cc:1950] T 6ff85bac0d22416987e8e3b379154b09 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:04.795554 11946 rpcz_store.cc:276] 0925 01:50:01.509845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.510001 (+ 156us) service_pool.cc:224] Handling call
0925 01:50:04.793795 (+3283794us) ts_tablet_manager.cc:1151] Deleting tablet 128be07ff230461ca7f998de7a02468f
0925 01:50:04.793806 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.793931 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3283610}
W20260925 01:50:04.796154 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 128be07ff230461ca7f998de7a02468f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 128be07ff230461ca7f998de7a02468f already in progress: creating tablet
I20260925 01:50:04.766891 12933 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:04.796474 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 6ff85bac0d22416987e8e3b379154b09 (table default.Table_1cdf240ece4148e88d0b728903d255df [id=6ea8e28751c84e1181aa299006fa643f]) successfully deleted
I20260925 01:50:04.796892 12933 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:04.796981 12689 tablet_replica.cc:333] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:04.797029 11946 tablet_replica.cc:333] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.797225 11946 raft_consensus.cc:2243] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.797394 12689 raft_consensus.cc:2243] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.797422 11946 raft_consensus.cc:2272] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.797724 12689 raft_consensus.cc:2272] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.798540 12689 ts_tablet_manager.cc:1916] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.799255 11953 ts_tablet_manager.cc:1929] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.799444 11953 log.cc:1199] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/02f9e96bcdf9418ea54dc73bf68a2be6
I20260925 01:50:04.803797 11946 ts_tablet_manager.cc:1916] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:04.805356 11314 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:04.806900 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7496a9eaa1714e9fa83d8c88bf1070fd" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:04.808254 12996 raft_consensus.cc:493] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.808423 12996 raft_consensus.cc:515] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:04.808648 11314 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:04.808748 11314 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:04.809098 12996 leader_election.cc:290] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.809209 12782 raft_consensus.cc:2749] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 01:50:04.809847 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9068770de0b473488bd8ea4752fb15d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.810175 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9068770de0b473488bd8ea4752fb15d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:04.810838 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf7f544827d4bca97aa6b63c0c48c0d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.811019 11522 raft_consensus.cc:2468] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:04.811533 11176 leader_election.cc:304] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.811882 12885 raft_consensus.cc:2804] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:04.812052 12885 raft_consensus.cc:493] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:04.812201 12885 raft_consensus.cc:3060] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.816592 12885 raft_consensus.cc:515] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.817621 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf7f544827d4bca97aa6b63c0c48c0d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:04.817781 11516 raft_consensus.cc:3060] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.820880 11516 raft_consensus.cc:2468] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:04.821676 11176 leader_election.cc:304] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.821848 12885 leader_election.cc:290] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.822021 12885 raft_consensus.cc:2804] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:50:04.822501 11177 leader_election.cc:343] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.823583 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf7f544827d4bca97aa6b63c0c48c0d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.823918 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf7f544827d4bca97aa6b63c0c48c0d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:04.827607 12689 ts_tablet_manager.cc:1929] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.828841 13066 raft_consensus.cc:493] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.828982 13066 raft_consensus.cc:515] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.829597 13066 leader_election.cc:290] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.830104 12885 raft_consensus.cc:697] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:04.830891 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d30f4940c44bcf900a8cf0de91a66d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:04.831072 11237 raft_consensus.cc:2468] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:04.831043 12885 consensus_queue.cc:237] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.831640 11456 leader_election.cc:304] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.831966 13066 raft_consensus.cc:2804] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:04.832060 13066 raft_consensus.cc:493] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:04.832180 13066 raft_consensus.cc:3060] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.832418 12689 log.cc:1199] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:04.832767 12689 ts_tablet_manager.cc:1950] T 2e96576354fe46bf9bfcde18f0a53390 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:04.833878 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 2e96576354fe46bf9bfcde18f0a53390 (table default.Table_901ce728b66a4e0aa595efc09462e77c [id=77342c106aac476884403421439b8f52]) successfully deleted
I20260925 01:50:04.835294 13066 raft_consensus.cc:515] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.836232 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d30f4940c44bcf900a8cf0de91a66d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:04.836432 11237 raft_consensus.cc:3060] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:04.837687 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet 3702f09e45a14c80af716d642d30cdfa from {username='slave'} at 127.0.0.1:60372
W20260925 01:50:04.838760 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db1339652d744cda9215d84e846d1e8e consensus state has no leader
I20260925 01:50:04.839906 11237 raft_consensus.cc:2468] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:04.840404 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f1256da336d043ccb47d410999361986" } new_table_name: "default.Table_086bf3a81e584116994b46acdf5be7bd" modify_external_catalogs: true
I20260925 01:50:04.840591 11456 leader_election.cc:304] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.840842 12964 raft_consensus.cc:2804] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:04.840930 12964 raft_consensus.cc:697] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:04.841150 12964 consensus_queue.cc:237] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.842108 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_58080518b0f64b68a150f6cd47e01c7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:04.843050 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58080518b0f64b68a150f6cd47e01c7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.843719 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0965c7825c014870988b8f3f46fd395f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:04.843952 13066 leader_election.cc:290] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.844486 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f23b8482c3ce4904a2a54bad0536a288"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:04.842132 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4dc2aafe1f934115beec31af1098d148"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:04.845705 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 17d628e46be942b3be3a69afd3f6968b
I20260925 01:50:04.846767 11672 catalog_manager.cc:6934] ReplaceTablet: tablet 17d628e46be942b3be3a69afd3f6968b deleted and replaced by tablet b81a0f0e096f4bdaaedb2122c3487079
W20260925 01:50:04.846818 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f23b8482c3ce4904a2a54bad0536a288 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:04.847815 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dc2aafe1f934115beec31af1098d148 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.848445 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d628e46be942b3be3a69afd3f6968b with delete_type TABLET_DATA_DELETED (replaced by tablet b81a0f0e096f4bdaaedb2122c3487079) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:04.848657 12996 raft_consensus.cc:493] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.848845 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d628e46be942b3be3a69afd3f6968b with delete_type TABLET_DATA_DELETED (replaced by tablet b81a0f0e096f4bdaaedb2122c3487079) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.848802 12996 raft_consensus.cc:515] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:04.849304 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0965c7825c014870988b8f3f46fd395f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:04.849341 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 17d628e46be942b3be3a69afd3f6968b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d628e46be942b3be3a69afd3f6968b already in progress: creating tablet
I20260925 01:50:04.849419 12996 leader_election.cc:290] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.854135 13066 raft_consensus.cc:493] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.854271 13066 raft_consensus.cc:515] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:04.855123 13066 leader_election.cc:290] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.855791 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d7b3c65d8a64734b2c432790dae07e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:47 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.855978 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 with delete_type TABLET_DATA_DELETED (replaced by tablet a8055cc9b06045449e6133298c8074e1) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:04.856700 11666 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 40c26580581e4e76ad9218958b3f9b78 (table default.Table_13f9ff413156494095a4ccdbc2d2b0e2 [id=03fe3bd58be64aa0941c740ea8fc7d21], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 40c26580581e4e76ad9218958b3f9b78 consensus state has no leader
I20260925 01:50:04.856897 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829d167dc0214890b722c0197500f159" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.857481 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.857695 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.857942 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fca09010f841c5a7b58678560065f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:04.857997 11456 leader_election.cc:343] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 927bc1194884470e9fc977ca870f1b0c
I20260925 01:50:04.858115 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.858242 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.858424 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e3a033c9e7545479130c7a3c48ac254 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:04.858583 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet a9068770de0b473488bd8ea4752fb15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:04.858824 11176 leader_election.cc:343] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.865813 11755 tablet_bootstrap.cc:492] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:04.870594 11953 ts_tablet_manager.cc:1950] T 02f9e96bcdf9418ea54dc73bf68a2be6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:04.872742 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 345) took 9436 ms. Trace:
I20260925 01:50:04.874742 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a162b1569eab48759aac0ea37c2056e7" } new_table_name: "default.Table_ef599a1535564aafa91d077e4d74ef35" modify_external_catalogs: true
I20260925 01:50:04.876333 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_17c3330e01fe42d2aabc2343b927861e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:04.876977 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17c3330e01fe42d2aabc2343b927861e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.877148 13066 consensus_queue.cc:1048] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:04.880983 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_32aa0edcb40b42d39d7a738c77b857fb" } modify_external_catalogs: true
I20260925 01:50:04.881235 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_32aa0edcb40b42d39d7a738c77b857fb" } modify_external_catalogs: true
I20260925 01:50:04.882999 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b956becceb424b008b027c67f8ffb52d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:04.883500 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b956becceb424b008b027c67f8ffb52d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:04.885295 13066 raft_consensus.cc:493] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.885443 13066 raft_consensus.cc:515] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.886147 13066 leader_election.cc:290] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.887019 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d23c5d52faa4b6da2996fabb16bd74a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:04.887573 11456 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.900341 11946 ts_tablet_manager.cc:1929] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:50:04.900484 11946 log.cc:1199] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:04.900928 11946 ts_tablet_manager.cc:1950] T 7496a9eaa1714e9fa83d8c88bf1070fd P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.901901 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 556) took 3389 ms. Trace:
I20260925 01:50:04.902015 11946 rpcz_store.cc:276] 0925 01:50:01.512627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.513002 (+ 375us) service_pool.cc:224] Handling call
0925 01:50:04.796977 (+3283975us) ts_tablet_manager.cc:1151] Deleting tablet 7496a9eaa1714e9fa83d8c88bf1070fd
0925 01:50:04.796987 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.807135 (+ 10148us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.900275 (+ 93140us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.901867 (+ 1592us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3226821}
I20260925 01:50:04.911715 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]) successfully deleted
I20260925 01:50:04.912524 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 546) took 3472 ms. Trace:
I20260925 01:50:04.916018 11946 rpcz_store.cc:276] 0925 01:50:01.439650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.439704 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:04.912382 (+3472678us) ts_tablet_manager.cc:1151] Deleting tablet 1ea85f72e10443229f5f927bcaf31cb3
0925 01:50:04.912394 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.912504 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3331149}
W20260925 01:50:04.916917 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1ea85f72e10443229f5f927bcaf31cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ea85f72e10443229f5f927bcaf31cb3 already in progress: creating tablet
I20260925 01:50:04.917394 11946 tablet_replica.cc:333] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.917927 11946 raft_consensus.cc:2243] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:04.918426 11946 raft_consensus.cc:2272] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.919605 11946 ts_tablet_manager.cc:1916] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:04.928529 11177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 106053us
W20260925 01:50:04.929670 11177 leader_election.cc:343] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:04.931983 11177 leader_election.cc:343] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:04.932756 11177 leader_election.cc:343] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.885823 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d628e46be942b3be3a69afd3f6968b with delete_type TABLET_DATA_DELETED (replaced by tablet b81a0f0e096f4bdaaedb2122c3487079) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:04.899005 11755 tablet_bootstrap.cc:654] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.941347 11946 ts_tablet_manager.cc:1929] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:04.941627 11953 rpcz_store.cc:276] 0925 01:49:55.436090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.436145 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:04.511563 (+9075418us) ts_tablet_manager.cc:1151] Deleting tablet 02f9e96bcdf9418ea54dc73bf68a2be6
0925 01:50:04.511575 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.696613 (+185038us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.799058 (+102445us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.872717 (+ 73659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9075190}
I20260925 01:50:04.941809 11946 log.cc:1199] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/927bc1194884470e9fc977ca870f1b0c
I20260925 01:50:04.942236 11946 ts_tablet_manager.cc:1950] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:04.942379 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 02f9e96bcdf9418ea54dc73bf68a2be6 (table default.Table_39b733d1fe004efdad259218984d60df [id=17ab86273b2440fe9c2568a7f15e9d5d]) successfully deleted
I20260925 01:50:04.942729 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 545) took 3503 ms. Trace:
I20260925 01:50:04.942809 11946 rpcz_store.cc:276] 0925 01:50:01.439526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.441048 (+ 1522us) service_pool.cc:224] Handling call
0925 01:50:04.917334 (+3476286us) ts_tablet_manager.cc:1151] Deleting tablet 927bc1194884470e9fc977ca870f1b0c
0925 01:50:04.917346 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.927210 (+ 9864us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.941251 (+ 14041us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:04.942708 (+ 1457us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3333793}
W20260925 01:50:04.913467 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 104813us
I20260925 01:50:04.930584 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829d167dc0214890b722c0197500f159" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.943300 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 927bc1194884470e9fc977ca870f1b0c (table default.Table_260512e222a64aae83a308a6de0b4843 [id=876adf51567e47859196d02efc6f89ce]) successfully deleted
W20260925 01:50:04.943682 11177 leader_election.cc:343] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.943876 11177 leader_election.cc:304] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:04.944217 12885 raft_consensus.cc:2749] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.946584 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 583) took 2969 ms. Trace:
I20260925 01:50:04.946993 11946 rpcz_store.cc:276] 0925 01:50:01.976674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.098507 (+121833us) service_pool.cc:224] Handling call
0925 01:50:04.946474 (+2847967us) ts_tablet_manager.cc:1151] Deleting tablet bc99f3613c354d68bfde33e04dc1e9ab
0925 01:50:04.946484 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.946568 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2847415}
W20260925 01:50:04.962644 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bc99f3613c354d68bfde33e04dc1e9ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc99f3613c354d68bfde33e04dc1e9ab already in progress: creating tablet
I20260925 01:50:04.963251 11946 tablet_replica.cc:333] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:04.963733 11946 raft_consensus.cc:2243] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:04.963907 13066 consensus_queue.cc:1048] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:04.965137 11946 raft_consensus.cc:2272] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:04.966106 11953 tablet_replica.cc:333] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:04.966868 11946 ts_tablet_manager.cc:1916] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:04.966863 11953 raft_consensus.cc:2243] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: Raft consensus shutting down.
W20260925 01:50:04.969228 11314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260925 01:50:04.970122 12885 raft_consensus.cc:493] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.970278 12885 raft_consensus.cc:515] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.970345 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d30f4940c44bcf900a8cf0de91a66d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:04.970855 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53d30f4940c44bcf900a8cf0de91a66d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:04.970971 12885 leader_election.cc:290] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.971027 11755 tablet_bootstrap.cc:492] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:04.971160 11755 ts_tablet_manager.cc:1403] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.158s user 0.003s sys 0.000s
I20260925 01:50:04.971351 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b306496f992f45a9b64b05b73712cb5b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:04.971747 11177 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.971781 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b306496f992f45a9b64b05b73712cb5b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.971832 11755 raft_consensus.cc:359] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:04.971999 11755 raft_consensus.cc:385] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.972059 11755 raft_consensus.cc:740] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.972276 11755 consensus_queue.cc:260] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:04.972580 11176 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.972707 11176 leader_election.cc:304] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:04.972868 11755 ts_tablet_manager.cc:1434] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:04.973299 12885 raft_consensus.cc:2749] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:04.973428 13066 raft_consensus.cc:493] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.973558 13066 raft_consensus.cc:515] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.974397 13066 leader_election.cc:290] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.973266 11755 tablet_bootstrap.cc:492] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:04.975093 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7944aa1ac8f4c5d8ea3aa2acae41257" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:04.975736 11456 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:04.976737 11755 tablet_bootstrap.cc:654] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:04.980525 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e has no consensus state
I20260925 01:50:04.984526 11755 tablet_bootstrap.cc:492] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:04.984658 11755 ts_tablet_manager.cc:1403] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20260925 01:50:04.985383 11755 raft_consensus.cc:359] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.985540 11755 raft_consensus.cc:385] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.985585 11755 raft_consensus.cc:740] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.989123 11755 consensus_queue.cc:260] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.989485 11753 tablet_bootstrap.cc:492] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:04.989632 11753 ts_tablet_manager.cc:1403] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.234s user 0.024s sys 0.011s
I20260925 01:50:04.992491 11755 ts_tablet_manager.cc:1434] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 01:50:04.992780 11755 tablet_bootstrap.cc:492] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:04.994179 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_71415b17dd35411f85245718ad9b25fd" } modify_external_catalogs: true
I20260925 01:50:04.994433 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_71415b17dd35411f85245718ad9b25fd" } modify_external_catalogs: true
I20260925 01:50:04.995110 11755 tablet_bootstrap.cc:654] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:04.995186 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_09785932e2864af7afe4554f30909290" } modify_external_catalogs: true
I20260925 01:50:04.995400 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_09785932e2864af7afe4554f30909290" } modify_external_catalogs: true
I20260925 01:50:04.996706 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2f72d02df1f14430b93be79f75e09cba" } modify_external_catalogs: true
I20260925 01:50:04.996951 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2f72d02df1f14430b93be79f75e09cba" } modify_external_catalogs: true
I20260925 01:50:04.997560 12885 raft_consensus.cc:493] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:04.997728 12885 raft_consensus.cc:515] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.998085 11753 raft_consensus.cc:359] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:04.998243 11753 raft_consensus.cc:385] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:04.998298 11753 raft_consensus.cc:740] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:04.998414 12885 leader_election.cc:290] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:04.999071 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fca09010f841c5a7b58678560065f3" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:04.999260 11522 raft_consensus.cc:2468] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:04.999689 11176 leader_election.cc:304] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:04.999722 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_508d50254458453d8ce5ae125aa65da5" } modify_external_catalogs: true
I20260925 01:50:04.999881 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_508d50254458453d8ce5ae125aa65da5" } modify_external_catalogs: true
I20260925 01:50:05.000066 12885 raft_consensus.cc:2804] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.000152 12885 raft_consensus.cc:493] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.000213 12885 raft_consensus.cc:3060] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.003104 12885 raft_consensus.cc:515] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.004066 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fca09010f841c5a7b58678560065f3" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:05.004221 11522 raft_consensus.cc:3060] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.004864 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fca09010f841c5a7b58678560065f3" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:05.005270 11177 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.005812 11953 pending_rounds.cc:70] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:50:05.005869 11953 pending_rounds.cc:77] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 2 index: 3 } timestamp: 7333072890032783360 op_type: NO_OP noop_request { }
I20260925 01:50:05.005983 11953 raft_consensus.cc:2889] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:05.006078 11953 raft_consensus.cc:2272] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.006608 11953 ts_tablet_manager.cc:1916] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.006955 11522 raft_consensus.cc:2468] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:05.007390 11176 leader_election.cc:304] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:05.007650 12996 raft_consensus.cc:2804] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:05.007766 12996 raft_consensus.cc:697] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:05.007993 12996 consensus_queue.cc:237] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.009117 12964 raft_consensus.cc:493] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.009238 12964 raft_consensus.cc:515] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.009497 12885 leader_election.cc:290] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.009768 12964 leader_election.cc:290] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.009953 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06fca09010f841c5a7b58678560065f3" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:05.010429 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:05.010486 11177 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:05.011440 11456 leader_election.cc:343] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.018159 11753 consensus_queue.cc:260] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.019805 11753 ts_tablet_manager.cc:1434] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260925 01:50:05.020123 11753 tablet_bootstrap.cc:492] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:05.023072 11753 tablet_bootstrap.cc:654] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.024919 11754 tablet_bootstrap.cc:492] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:05.025089 11754 ts_tablet_manager.cc:1403] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.316s user 0.021s sys 0.053s
I20260925 01:50:05.025839 11754 raft_consensus.cc:359] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.026038 11754 raft_consensus.cc:385] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.026139 11754 raft_consensus.cc:740] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.026254 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d23c5d52faa4b6da2996fabb16bd74a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.026355 11754 consensus_queue.cc:260] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.026842 11754 ts_tablet_manager.cc:1434] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:05.027225 11754 tablet_bootstrap.cc:492] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:05.027359 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7944aa1ac8f4c5d8ea3aa2acae41257" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.027829 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:05.028680 11314 consensus_peers.cc:597] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e3a033c9e7545479130c7a3c48ac254. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.028851 11754 tablet_bootstrap.cc:654] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:05.039045 11457 leader_election.cc:343] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:05.039646 11457 leader_election.cc:343] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:05.040096 11457 leader_election.cc:343] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Not found: Tablet not found: 927bc1194884470e9fc977ca870f1b0c
I20260925 01:50:05.040205 11457 leader_election.cc:304] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:05.040448 11457 raft_consensus.cc:2686] T 927bc1194884470e9fc977ca870f1b0c P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:05.042364 11457 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.042476 11457 leader_election.cc:304] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.042786 12964 raft_consensus.cc:2749] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:05.043280 12964 consensus_queue.cc:1048] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:50:05.044098 11457 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.044199 11457 leader_election.cc:304] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.044570 12964 raft_consensus.cc:2749] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:05.045032 11457 leader_election.cc:343] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.045158 11457 leader_election.cc:304] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.045550 12964 raft_consensus.cc:2749] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:05.067498 11754 tablet_bootstrap.cc:492] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:05.067687 11754 ts_tablet_manager.cc:1403] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.008s
W20260925 01:50:05.068707 11314 consensus_peers.cc:597] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8152c9e0b0af4ab2a18c5a0080e22ffc. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.072719 11946 ts_tablet_manager.cc:1929] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.072860 11946 log.cc:1199] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/93329036763146beb8e6a9b039cc1ec1
I20260925 01:50:05.073254 11946 ts_tablet_manager.cc:1950] T 93329036763146beb8e6a9b039cc1ec1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:05.074137 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 598) took 2967 ms. Trace:
I20260925 01:50:05.074226 11946 rpcz_store.cc:276] 0925 01:50:02.107118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.107167 (+ 49us) service_pool.cc:224] Handling call
0925 01:50:04.963193 (+2856026us) ts_tablet_manager.cc:1151] Deleting tablet 93329036763146beb8e6a9b039cc1ec1
0925 01:50:04.963205 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:04.978283 (+ 15078us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.072646 (+ 94363us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.074115 (+ 1469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2855837}
I20260925 01:50:05.077732 11754 raft_consensus.cc:359] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.077955 11754 raft_consensus.cc:385] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.078019 11754 raft_consensus.cc:740] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.078282 11754 consensus_queue.cc:260] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.084311 12885 raft_consensus.cc:493] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.084472 12885 raft_consensus.cc:515] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.085142 12885 leader_election.cc:290] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.086022 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cd89d238bf4220a48ecdf59cca5e6d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.086164 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cd89d238bf4220a48ecdf59cca5e6d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.086244 11522 raft_consensus.cc:2468] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:05.086786 11176 leader_election.cc:304] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:50:05.087188 11177 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.087550 12885 raft_consensus.cc:2804] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.087627 12885 raft_consensus.cc:493] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.087692 12885 raft_consensus.cc:3060] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.090911 12885 raft_consensus.cc:515] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.091943 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cd89d238bf4220a48ecdf59cca5e6d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:05.092133 11522 raft_consensus.cc:3060] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.095024 11522 raft_consensus.cc:2468] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:05.095227 11953 ts_tablet_manager.cc:1929] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20260925 01:50:05.095672 11176 leader_election.cc:304] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:05.096312 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 93329036763146beb8e6a9b039cc1ec1 (table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]) successfully deleted
W20260925 01:50:05.096863 11664 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.252:44823, user_credentials={real_user=slave}} blocked reactor thread for 44542us
I20260925 01:50:05.098344 12885 leader_election.cc:290] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.098660 12885 raft_consensus.cc:2804] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:05.099121 13122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.159.253:42889 every 8 connection(s)
I20260925 01:50:05.099658 12885 raft_consensus.cc:697] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:05.100008 12828 rpc_server.cc:307] RPC server started. Bound to: 127.10.159.253:42889
I20260925 01:50:05.100059 12885 consensus_queue.cc:237] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.102608 11754 ts_tablet_manager.cc:1434] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.035s user 0.003s sys 0.000s
I20260925 01:50:05.103206 11754 tablet_bootstrap.cc:492] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:05.104946 11754 tablet_bootstrap.cc:654] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.106215 11946 tablet_replica.cc:333] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:05.106828 12828 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/master-1/data/info.pb
I20260925 01:50:05.106859 11946 raft_consensus.cc:2243] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.110247 11946 raft_consensus.cc:2272] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:05.112830 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db20c20da0ec4785a2a3a18aba109b8f consensus state has no leader
I20260925 01:50:05.114111 11946 ts_tablet_manager.cc:1916] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.116089 10879 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskAIg11R/build/asan/bin/kudu as pid 12828
I20260925 01:50:05.119145 11754 tablet_bootstrap.cc:492] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:05.119314 11754 ts_tablet_manager.cc:1403] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260925 01:50:05.120182 11754 raft_consensus.cc:359] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.120402 11754 raft_consensus.cc:385] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.120452 11754 raft_consensus.cc:740] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.133639 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c8efaeef1cd64670bcbf63eb0b401737" } new_table_name: "default.Table_1e3f80cd5aa543bc9e981407c57d1d71" modify_external_catalogs: true
I20260925 01:50:05.135983 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6485a2bca5c748b2b999b93e8f115290" } new_table_name: "default.Table_97757461ab5b4c0886d1e0ea85ddfaa9" modify_external_catalogs: true
I20260925 01:50:05.143392 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e26b1dc65fc84629a72029519919ae23 (table default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]). Expected version 1 got 0
I20260925 01:50:05.146157 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e26b1dc65fc84629a72029519919ae23 (table default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]). Expected version 1 got 0
I20260925 01:50:05.146482 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 519d954b6a214d0b8e960e128cfcea10 (table default.Table_126b13b368c348bea98d7d87748aaf1c [id=3e31f69b151b4dd69a3ac8be6e2bc48d]). Expected version 1 got 0
I20260925 01:50:05.146589 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 404247565a9445ebb53916f9e634e9c1 (DEFAULT_TABLE table=default.Table_8d4c17a642b345df81ff7b46604af4f5 [id=0769b4e16b8f4e07af815a7f2b2ef11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.147046 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404247565a9445ebb53916f9e634e9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.150342 11488 tablet_service.cc:1511] Processing CreateTablet for tablet f80d6254999842c18601b1cdb66fa790 (DEFAULT_TABLE table=default.Table_3dbae4f2663d46e2bc77afddcd09fed2 [id=06a49973430844bbb941b3f583b8495f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.150744 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80d6254999842c18601b1cdb66fa790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.154942 11208 tablet_service.cc:1511] Processing CreateTablet for tablet f80d6254999842c18601b1cdb66fa790 (DEFAULT_TABLE table=default.Table_3dbae4f2663d46e2bc77afddcd09fed2 [id=06a49973430844bbb941b3f583b8495f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.155064 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 404247565a9445ebb53916f9e634e9c1 (DEFAULT_TABLE table=default.Table_8d4c17a642b345df81ff7b46604af4f5 [id=0769b4e16b8f4e07af815a7f2b2ef11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.155323 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80d6254999842c18601b1cdb66fa790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.155506 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b9496066fd384ed5a55cddc646c482f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.156652 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9496066fd384ed5a55cddc646c482f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.157722 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404247565a9445ebb53916f9e634e9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.161437 11215 tablet_service.cc:1511] Processing CreateTablet for tablet f1e89d9f87104c768839104c80614f5e (DEFAULT_TABLE table=default.Table_0f02542b67804eb896581e58a3fdfe80 [id=313c06566da6438b8374411724805d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.161789 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e89d9f87104c768839104c80614f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.163033 11753 tablet_bootstrap.cc:492] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:05.163239 11753 ts_tablet_manager.cc:1403] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.143s user 0.008s sys 0.019s
I20260925 01:50:05.164063 11753 raft_consensus.cc:359] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.164294 13126 sys_catalog.cc:263] Verifying existing consensus state
I20260925 01:50:05.164417 11753 raft_consensus.cc:385] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.164556 11753 raft_consensus.cc:740] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.165542 11753 consensus_queue.cc:260] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.166121 11753 ts_tablet_manager.cc:1434] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:05.166453 11753 tablet_bootstrap.cc:492] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:05.177843 11457 consensus_peers.cc:597] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:05.180423 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 246aafd66334407895ce235e4b2ca7f4 consensus state has no leader
I20260925 01:50:05.180775 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet 6439ba0b0468416d9798a6ac1ee7fddd from {username='slave'} at 127.0.0.1:60372
W20260925 01:50:05.181916 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 835e96fe1cfc41c6b8e5edfac07d28fd consensus state has no leader
I20260925 01:50:05.185415 11753 tablet_bootstrap.cc:654] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.185993 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 41c58f974b1c4334852b7e17b4da7867 (DEFAULT_TABLE table=default.Table_785304ebf8394910b4bd62dbfe8381f0 [id=552ad3e19ac5469395668c3452049b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.186520 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c58f974b1c4334852b7e17b4da7867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.187502 11492 tablet_service.cc:1511] Processing CreateTablet for tablet e529742a5f0e48cd80d3be43a633f165 (DEFAULT_TABLE table=default.Table_ee767a4b9d33413aa7a46e7a97833b4b [id=1d2aa275cbaf462da6113d6edc7315cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.187822 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e529742a5f0e48cd80d3be43a633f165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.187912 11215 tablet_service.cc:1511] Processing CreateTablet for tablet e529742a5f0e48cd80d3be43a633f165 (DEFAULT_TABLE table=default.Table_ee767a4b9d33413aa7a46e7a97833b4b [id=1d2aa275cbaf462da6113d6edc7315cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.188376 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e529742a5f0e48cd80d3be43a633f165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.199409 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 41c58f974b1c4334852b7e17b4da7867 (DEFAULT_TABLE table=default.Table_785304ebf8394910b4bd62dbfe8381f0 [id=552ad3e19ac5469395668c3452049b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.200248 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c58f974b1c4334852b7e17b4da7867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.204391 11488 tablet_service.cc:1511] Processing CreateTablet for tablet f1e89d9f87104c768839104c80614f5e (DEFAULT_TABLE table=default.Table_0f02542b67804eb896581e58a3fdfe80 [id=313c06566da6438b8374411724805d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.204896 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e89d9f87104c768839104c80614f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.212708 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9b75b12794fa4f4fa53156c212632cdc
I20260925 01:50:05.213539 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 62eeb75b322e45a5bdbd63dbd4c6e582
I20260925 01:50:05.214493 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet ae05900043cb49d29f528fcbe4c8ada0
I20260925 01:50:05.214608 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.215415 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b97f703869d4471cb940ef654203ec2b
W20260925 01:50:05.215775 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62eeb75b322e45a5bdbd63dbd4c6e582 already in progress: creating tablet
I20260925 01:50:05.216391 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.216531 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet b97f703869d4471cb940ef654203ec2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.216719 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet ae05900043cb49d29f528fcbe4c8ada0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.217935 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet ae05900043cb49d29f528fcbe4c8ada0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.218116 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet b97f703869d4471cb940ef654203ec2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:05.218550 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b97f703869d4471cb940ef654203ec2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97f703869d4471cb940ef654203ec2b already in progress: creating tablet
W20260925 01:50:05.218801 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet ae05900043cb49d29f528fcbe4c8ada0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae05900043cb49d29f528fcbe4c8ada0 already in progress: creating tablet
I20260925 01:50:05.219870 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b75b12794fa4f4fa53156c212632cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:05.220685 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9b75b12794fa4f4fa53156c212632cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b75b12794fa4f4fa53156c212632cdc already in progress: creating tablet
I20260925 01:50:05.222594 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b75b12794fa4f4fa53156c212632cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.226692 11215 tablet_service.cc:1511] Processing CreateTablet for tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e (DEFAULT_TABLE table=default.Table_086bf3a81e584116994b46acdf5be7bd [id=13516106bc6d4253b6f94fd6e73b2023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.227226 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.230536 11501 tablet_service.cc:1511] Processing CreateTablet for tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e (DEFAULT_TABLE table=default.Table_086bf3a81e584116994b46acdf5be7bd [id=13516106bc6d4253b6f94fd6e73b2023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.230965 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.231366 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:05.233422 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:05.234275 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 1bdfb70a86da4674b27e9d8efd689716 (DEFAULT_TABLE table=default.Table_bd28b864a15442ddbc1f52dcbf3f6915 [id=1dc7cfeb0e484f7da900eba4909e8bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.234613 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdfb70a86da4674b27e9d8efd689716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.237859 12996 raft_consensus.cc:493] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.237984 12996 raft_consensus.cc:515] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.238981 12996 leader_election.cc:290] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.240621 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f97ead49634bf6b03e292544af4d07" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.240793 11522 raft_consensus.cc:2468] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:05.241285 11176 leader_election.cc:304] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:05.246222 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 1bdfb70a86da4674b27e9d8efd689716 (DEFAULT_TABLE table=default.Table_bd28b864a15442ddbc1f52dcbf3f6915 [id=1dc7cfeb0e484f7da900eba4909e8bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.246641 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdfb70a86da4674b27e9d8efd689716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.251832 11753 tablet_bootstrap.cc:492] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:05.251973 11753 ts_tablet_manager.cc:1403] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.001s
I20260925 01:50:05.252712 11753 raft_consensus.cc:359] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.253010 11753 raft_consensus.cc:385] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.253068 11753 raft_consensus.cc:740] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.253477 12885 raft_consensus.cc:2804] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.253288 11753 consensus_queue.cc:260] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.253573 12885 raft_consensus.cc:493] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.253641 12885 raft_consensus.cc:3060] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.254025 11753 ts_tablet_manager.cc:1434] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:05.254307 11753 tablet_bootstrap.cc:492] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:05.255853 11753 tablet_bootstrap.cc:654] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.256778 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:05.257860 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 39f05ebd3e4e4e968ccc158e33089361 (DEFAULT_TABLE table=default.Table_343ef1b070164793ac65033e6aabf977 [id=d4027659491140a78a4dcdb2b39dc920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.258342 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f05ebd3e4e4e968ccc158e33089361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.263518 13126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Bootstrap starting.
I20260925 01:50:05.264986 12894 consensus_queue.cc:1048] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:05.275291 12885 raft_consensus.cc:515] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.280189 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 39f05ebd3e4e4e968ccc158e33089361 (DEFAULT_TABLE table=default.Table_343ef1b070164793ac65033e6aabf977 [id=d4027659491140a78a4dcdb2b39dc920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.283252 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f97ead49634bf6b03e292544af4d07" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:05.283437 11516 raft_consensus.cc:3060] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.286455 11516 raft_consensus.cc:2468] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:05.286999 11176 leader_election.cc:304] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:05.287819 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a93395123070480ca376c5c7828846f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:05.287997 12894 raft_consensus.cc:2804] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:50:05.288517 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a93395123070480ca376c5c7828846f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.289386 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_58080518b0f64b68a150f6cd47e01c7a" } new_table_name: "default.Table_d3b5e1eb785749939261859f4fb504a9" modify_external_catalogs: true
I20260925 01:50:05.290799 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f2b587e2f7a544ce9cbf186e3d68e345"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.291352 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2b587e2f7a544ce9cbf186e3d68e345 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.292516 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9f053c2667d241f3b0349162a44be758" } new_table_name: "default.Table_d2dd74fad2ae48618715864d80d042f8" modify_external_catalogs: true
I20260925 01:50:05.296180 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4b66e20f55e04eaf8ea162d732c1e929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.296710 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b66e20f55e04eaf8ea162d732c1e929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.296718 11215 tablet_service.cc:1511] Processing CreateTablet for tablet aa69c2a4cdc64c36a01830ccbe188e1d (DEFAULT_TABLE table=default.Table_0f1bffe2143d4a17b283c6fa0b3aa0e8 [id=97ab96d9cd9b4a248f6c1e5ebc1cc8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.297693 11489 tablet_service.cc:1511] Processing CreateTablet for tablet aa69c2a4cdc64c36a01830ccbe188e1d (DEFAULT_TABLE table=default.Table_0f1bffe2143d4a17b283c6fa0b3aa0e8 [id=97ab96d9cd9b4a248f6c1e5ebc1cc8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.298113 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 3d867e7f58554c1196e837346b0b37d3 (DEFAULT_TABLE table=default.Table_3ecdc7c64ae449629e81d8bb5f1257e3 [id=c736bcc5ce644072916a3a0546942f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.298691 12885 leader_election.cc:290] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.300819 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 3d867e7f58554c1196e837346b0b37d3 (DEFAULT_TABLE table=default.Table_3ecdc7c64ae449629e81d8bb5f1257e3 [id=c736bcc5ce644072916a3a0546942f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.301203 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 532e290a0db34fbfab0328ca8f8d1e6c (DEFAULT_TABLE table=default.Table_8331a7db9b06422182b4638dc448ae50 [id=29783c53f71445f79f0a2779f99fb0e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.299794 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa69c2a4cdc64c36a01830ccbe188e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.303180 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 532e290a0db34fbfab0328ca8f8d1e6c (DEFAULT_TABLE table=default.Table_8331a7db9b06422182b4638dc448ae50 [id=29783c53f71445f79f0a2779f99fb0e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.303678 11219 tablet_service.cc:1511] Processing CreateTablet for tablet e52692f8a09c44b4b8c13a9a388c2094 (DEFAULT_TABLE table=default.Table_9c9ea2d22ad643308cc531459234f13b [id=64dd7a8e1bae46f1af686e0c9490f4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.304823 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52692f8a09c44b4b8c13a9a388c2094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.304953 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_1a17bc9d97f7458e8ec979b4728fa9e5 [id=1a5a59e2daad4fb78689dd25363b7086] alter complete (version 1)
I20260925 01:50:05.309674 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:05.310325 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532e290a0db34fbfab0328ca8f8d1e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.311326 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dd2ebcec56d34289bf2ac59023ae3ea8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.311911 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd2ebcec56d34289bf2ac59023ae3ea8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.314345 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d867e7f58554c1196e837346b0b37d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.316535 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet dfde700aff8049f4b10c46059da6907f
I20260925 01:50:05.320129 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f9584e223de240118d5403df64e4aa15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.320726 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9584e223de240118d5403df64e4aa15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.321218 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa69c2a4cdc64c36a01830ccbe188e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.321817 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532e290a0db34fbfab0328ca8f8d1e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.322238 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d867e7f58554c1196e837346b0b37d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.322131 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_072303d9dad749568fb97c9451238de1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:05.322441 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f05ebd3e4e4e968ccc158e33089361. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:05.322634 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_072303d9dad749568fb97c9451238de1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.323661 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d6444607e23045e5a39e6f44fa353f7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.324091 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6444607e23045e5a39e6f44fa353f7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.324404 13066 raft_consensus.cc:493] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.324520 13066 raft_consensus.cc:515] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.325074 13066 leader_election.cc:290] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.325856 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26b1dc65fc84629a72029519919ae23" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:05.326026 11239 raft_consensus.cc:2468] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:05.326517 11456 leader_election.cc:304] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:05.326759 13066 raft_consensus.cc:2804] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.326823 13066 raft_consensus.cc:493] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.326876 13066 raft_consensus.cc:3060] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.329368 13066 raft_consensus.cc:515] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.330129 13066 leader_election.cc:290] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.330699 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26b1dc65fc84629a72029519919ae23" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:05.330861 11239 raft_consensus.cc:3060] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.331938 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fca09010f841c5a7b58678560065f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.332199 12689 tablet_replica.cc:333] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.332458 12689 raft_consensus.cc:2243] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:05.332711 12689 pending_rounds.cc:70] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:05.332757 12689 pending_rounds.cc:77] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072916515074048 op_type: NO_OP noop_request { }
I20260925 01:50:05.332831 12689 raft_consensus.cc:2889] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:05.332927 12689 raft_consensus.cc:2272] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.333323 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.333678 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.333855 12689 ts_tablet_manager.cc:1916] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.333933 11239 raft_consensus.cc:2468] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:05.334046 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet a9068770de0b473488bd8ea4752fb15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.334167 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 53d30f4940c44bcf900a8cf0de91a66d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.334344 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet d3150980bb72435886486156aa98d342 with delete_type TABLET_DATA_DELETED (replaced by tablet 49692d2824a34f48a4dcefad8c89618b) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.334534 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f778b87d307483b9edb17dce7355a65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.334693 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.334694 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet dfde700aff8049f4b10c46059da6907f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.335108 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 829d167dc0214890b722c0197500f159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.335270 11456 leader_election.cc:304] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:05.335317 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet dfde700aff8049f4b10c46059da6907f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.336241 13066 raft_consensus.cc:2804] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:05.336606 13066 raft_consensus.cc:697] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:05.336915 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet b306496f992f45a9b64b05b73712cb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.336967 13066 consensus_queue.cc:237] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.337369 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet fcb56153a802427aaebbf55a8193d62b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.341799 12689 ts_tablet_manager.cc:1929] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.341977 12689 log.cc:1199] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/06fca09010f841c5a7b58678560065f3
I20260925 01:50:05.342406 12689 ts_tablet_manager.cc:1950] T 06fca09010f841c5a7b58678560065f3 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:05.343101 12689 tablet_replica.cc:333] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.343372 12689 raft_consensus.cc:2243] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.343591 12689 raft_consensus.cc:2272] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.343902 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 06fca09010f841c5a7b58678560065f3 (table default.Table_ef187190ed9e4b7d910df53df764f469 [id=4d572d97dbaa43e5879f88f200a962ba]) successfully deleted
I20260925 01:50:05.344277 12689 ts_tablet_manager.cc:1916] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:05.356555 11177 consensus_peers.cc:597] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.366127 12894 raft_consensus.cc:697] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:05.366577 12894 consensus_queue.cc:237] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:05.374470 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf0e934eb63145808ac05234a33f42be consensus state has no leader
I20260925 01:50:05.374891 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e1addda8d0d543b7be2ee34ace5d76c8" } new_table_name: "default.Table_2acb569f713d487da8be7cc978604605" modify_external_catalogs: true
I20260925 01:50:05.376060 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_17e80afce4044b87b69f9e75284121f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.376680 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17e80afce4044b87b69f9e75284121f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.379514 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 6439ba0b0468416d9798a6ac1ee7fddd
I20260925 01:50:05.380072 11672 catalog_manager.cc:6934] ReplaceTablet: tablet 6439ba0b0468416d9798a6ac1ee7fddd deleted and replaced by tablet ab8682686f894beaaa58f4818c0651c4
I20260925 01:50:05.380493 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_03285c55385442afa6e0ae96bdd74716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.381062 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03285c55385442afa6e0ae96bdd74716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:05.382920 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e86bd9a65dd46f09d87ddd831552b59 has no consensus state
I20260925 01:50:05.384320 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4965b53b04c441ae89a4ce1b076ef463" } new_table_name: "default.Table_7f70c2fc29aa4f669210f6722e500768" modify_external_catalogs: true
I20260925 01:50:05.110389 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24cd89d238bf4220a48ecdf59cca5e6d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:05.137143 11374 raft_consensus.cc:3060] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.379523 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:05.388801 11680 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7da55c488da540048a94324fa347c1ef (table default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17]). Expected version 5 got 0
I20260925 01:50:05.152376 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1abd3c2cb34915a595ea73a8d10743 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.390380 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 6439ba0b0468416d9798a6ac1ee7fddd with delete_type TABLET_DATA_DELETED (replaced by tablet ab8682686f894beaaa58f4818c0651c4) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:05.390699 11177 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.153918 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet a9944a1422d14ae2b22451e67c477d5b with delete_type TABLET_DATA_DELETED (replaced by tablet c86a78873e8847fa95bead4774bea606) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.154618 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 96b68399843a422b8da3ddfab2c522e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.156092 11342 tablet_service.cc:1511] Processing CreateTablet for tablet f1e89d9f87104c768839104c80614f5e (DEFAULT_TABLE table=default.Table_0f02542b67804eb896581e58a3fdfe80 [id=313c06566da6438b8374411724805d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.391119 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_92b2426cff01456aa879fd65bc0e112e" } new_table_name: "default.Table_2493c350936041619beadfaad71f362d" modify_external_catalogs: true
I20260925 01:50:05.159657 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet c28c8f00a8634ef89e4773b62e095b74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.160406 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 404247565a9445ebb53916f9e634e9c1 (DEFAULT_TABLE table=default.Table_8d4c17a642b345df81ff7b46604af4f5 [id=0769b4e16b8f4e07af815a7f2b2ef11c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.160779 11358 tablet_service.cc:1511] Processing CreateTablet for tablet f80d6254999842c18601b1cdb66fa790 (DEFAULT_TABLE table=default.Table_3dbae4f2663d46e2bc77afddcd09fed2 [id=06a49973430844bbb941b3f583b8495f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.183332 13101 raft_consensus.cc:493] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.391661 13101 raft_consensus.cc:515] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.392334 13101 leader_election.cc:290] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.187361 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 41c58f974b1c4334852b7e17b4da7867 (DEFAULT_TABLE table=default.Table_785304ebf8394910b4bd62dbfe8381f0 [id=552ad3e19ac5469395668c3452049b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.188062 11341 tablet_service.cc:1511] Processing CreateTablet for tablet e529742a5f0e48cd80d3be43a633f165 (DEFAULT_TABLE table=default.Table_ee767a4b9d33413aa7a46e7a97833b4b [id=1d2aa275cbaf462da6113d6edc7315cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.202826 12933 raft_consensus.cc:493] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.393771 12933 raft_consensus.cc:515] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:05.394301 11314 leader_election.cc:343] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 347a144e18ab4f6e834551044a2ac4ae
I20260925 01:50:05.214332 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b75b12794fa4f4fa53156c212632cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.217589 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.217728 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet ae05900043cb49d29f528fcbe4c8ada0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.217813 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet b97f703869d4471cb940ef654203ec2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.225553 12947 raft_consensus.cc:493] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.394996 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60706e2087b4ec7b63f6747534a4b0f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.395093 12947 raft_consensus.cc:515] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.395650 12947 leader_election.cc:290] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.228809 11355 tablet_service.cc:1511] Processing CreateTablet for tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e (DEFAULT_TABLE table=default.Table_086bf3a81e584116994b46acdf5be7bd [id=13516106bc6d4253b6f94fd6e73b2023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.233073 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
W20260925 01:50:05.396484 11314 leader_election.cc:343] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 9cd2e1bf7d3e4459a84235b9c3f5383c
W20260925 01:50:05.396713 11314 leader_election.cc:343] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 347a144e18ab4f6e834551044a2ac4ae
I20260925 01:50:05.396788 11314 leader_election.cc:304] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.397200 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60706e2087b4ec7b63f6747534a4b0f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:05.240353 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 1bdfb70a86da4674b27e9d8efd689716 (DEFAULT_TABLE table=default.Table_bd28b864a15442ddbc1f52dcbf3f6915 [id=1dc7cfeb0e484f7da900eba4909e8bf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.240417 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f97ead49634bf6b03e292544af4d07" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.262979 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 39f05ebd3e4e4e968ccc158e33089361 (DEFAULT_TABLE table=default.Table_343ef1b070164793ac65033e6aabf977 [id=d4027659491140a78a4dcdb2b39dc920]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.394332 12933 leader_election.cc:290] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:05.398931 11177 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.399053 12933 raft_consensus.cc:2749] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:05.400020 11314 leader_election.cc:343] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 9cd2e1bf7d3e4459a84235b9c3f5383c
I20260925 01:50:05.400116 11314 leader_election.cc:304] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.400377 13101 raft_consensus.cc:2749] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:05.400513 11314 leader_election.cc:304] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.285302 11755 tablet_bootstrap.cc:492] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:05.401753 11755 ts_tablet_manager.cc:1403] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.409s user 0.040s sys 0.040s
I20260925 01:50:05.404021 12689 ts_tablet_manager.cc:1929] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:05.404156 12689 log.cc:1199] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:50:05.404549 12689 ts_tablet_manager.cc:1950] T 01d50e428bfc46caa130f96ccc7e8f40 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:05.295984 11372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f97ead49634bf6b03e292544af4d07" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:05.297971 11359 tablet_service.cc:1511] Processing CreateTablet for tablet aa69c2a4cdc64c36a01830ccbe188e1d (DEFAULT_TABLE table=default.Table_0f1bffe2143d4a17b283c6fa0b3aa0e8 [id=97ab96d9cd9b4a248f6c1e5ebc1cc8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.298894 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 3d867e7f58554c1196e837346b0b37d3 (DEFAULT_TABLE table=default.Table_3ecdc7c64ae449629e81d8bb5f1257e3 [id=c736bcc5ce644072916a3a0546942f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.405939 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 01d50e428bfc46caa130f96ccc7e8f40 (table default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]) successfully deleted
I20260925 01:50:05.301985 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 532e290a0db34fbfab0328ca8f8d1e6c (DEFAULT_TABLE table=default.Table_8331a7db9b06422182b4638dc448ae50 [id=29783c53f71445f79f0a2779f99fb0e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.318663 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet dfde700aff8049f4b10c46059da6907f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.335816 11376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26b1dc65fc84629a72029519919ae23" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.336172 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26b1dc65fc84629a72029519919ae23" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:05.407275 11177 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:05.407375 11457 leader_election.cc:343] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:05.407721 11457 leader_election.cc:343] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.408020 12947 raft_consensus.cc:493] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.408159 12947 raft_consensus.cc:515] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.408257 13101 raft_consensus.cc:2749] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:05.408334 12689 tablet_replica.cc:333] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.408763 12947 leader_election.cc:290] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.408946 12689 raft_consensus.cc:2243] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:05.409204 12689 pending_rounds.cc:70] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:05.409286 12689 pending_rounds.cc:77] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072916895875072 op_type: NO_OP noop_request { }
I20260925 01:50:05.409397 12689 raft_consensus.cc:2889] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:05.409495 12689 raft_consensus.cc:2272] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.410238 12933 raft_consensus.cc:493] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.410355 12933 raft_consensus.cc:515] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.410997 12933 leader_election.cc:290] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:05.411789 11314 leader_election.cc:343] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 596f8ddbcd16458aa4f287f4f11282a1
W20260925 01:50:05.412448 11314 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 38082c23d99148bb916b0ae74fd474b8
W20260925 01:50:05.412695 11314 leader_election.cc:343] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 596f8ddbcd16458aa4f287f4f11282a1
I20260925 01:50:05.412798 11314 leader_election.cc:304] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.413295 12933 raft_consensus.cc:2749] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:05.405612 11755 raft_consensus.cc:359] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:05.417388 11314 leader_election.cc:343] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 38082c23d99148bb916b0ae74fd474b8
I20260925 01:50:05.417505 11314 leader_election.cc:304] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.417775 12933 raft_consensus.cc:2749] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:05.422374 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet b306496f992f45a9b64b05b73712cb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.424202 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:05.425341 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 829d167dc0214890b722c0197500f159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.425995 11673 catalog_manager.cc:5838] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:05.417786 11755 raft_consensus.cc:385] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.428462 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 7da55c488da540048a94324fa347c1ef (table default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17]). Expected version 5 got 0
I20260925 01:50:05.429154 11755 raft_consensus.cc:740] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
W20260925 01:50:05.435010 11456 consensus_peers.cc:597] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01d50e428bfc46caa130f96ccc7e8f40. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.442124 12947 raft_consensus.cc:493] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.445228 12947 raft_consensus.cc:515] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.445865 12947 leader_election.cc:290] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:05.446996 11314 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: ca17585cd523440ca1e9b754f3aedf8a
W20260925 01:50:05.447191 11314 leader_election.cc:343] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:50:05.447263 11314 leader_election.cc:304] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.447677 12947 raft_consensus.cc:2749] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:05.447677 12689 ts_tablet_manager.cc:1916] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:05.453744 11457 consensus_peers.cc:597] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.459089 11953 log.cc:1199] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/86079f22abb74d438c61ecc2a7379cbd
I20260925 01:50:05.478550 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e529742a5f0e48cd80d3be43a633f165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.478766 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e89d9f87104c768839104c80614f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.481285 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b18554efa4ef45df951e50be20d806b6" } modify_external_catalogs: true
I20260925 01:50:05.481500 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b18554efa4ef45df951e50be20d806b6" } modify_external_catalogs: true
I20260925 01:50:05.481632 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f05ebd3e4e4e968ccc158e33089361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.482158 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80d6254999842c18601b1cdb66fa790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.482550 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 532e290a0db34fbfab0328ca8f8d1e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.482707 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c58f974b1c4334852b7e17b4da7867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.483018 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404247565a9445ebb53916f9e634e9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.483201 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f7b427ed4a7346fbbfaba8281fbfd929" } modify_external_catalogs: true
I20260925 01:50:05.483400 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f7b427ed4a7346fbbfaba8281fbfd929" } modify_external_catalogs: true
I20260925 01:50:05.483438 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d867e7f58554c1196e837346b0b37d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.483891 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdfb70a86da4674b27e9d8efd689716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.484273 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.484637 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa69c2a4cdc64c36a01830ccbe188e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.484817 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_785304ebf8394910b4bd62dbfe8381f0" } modify_external_catalogs: true
I20260925 01:50:05.484997 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_785304ebf8394910b4bd62dbfe8381f0" } modify_external_catalogs: true
I20260925 01:50:05.486393 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0c39d486ee7c4893bed0f1ee98d35b81" } modify_external_catalogs: true
I20260925 01:50:05.486558 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0c39d486ee7c4893bed0f1ee98d35b81" } modify_external_catalogs: true
I20260925 01:50:05.489826 11754 consensus_queue.cc:260] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:05.490097 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2efc66011a0c42b4a55d2f97d7cb6813 consensus state has no leader
I20260925 01:50:05.490103 13139 raft_consensus.cc:493] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.490226 13139 raft_consensus.cc:515] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:05.491060 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6599a18283614e759cf3886d72c8250b consensus state has no leader
I20260925 01:50:05.491294 11953 ts_tablet_manager.cc:1950] T 86079f22abb74d438c61ecc2a7379cbd P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:05.491505 13139 leader_election.cc:290] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.491851 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7944aa1ac8f4c5d8ea3aa2acae41257" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.492003 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7944aa1ac8f4c5d8ea3aa2acae41257" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.492060 11522 raft_consensus.cc:2468] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:05.492489 11176 leader_election.cc:304] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:50:05.492609 11177 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.437068 11755 consensus_queue.cc:260] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.502570 11755 ts_tablet_manager.cc:1434] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.101s user 0.007s sys 0.000s
I20260925 01:50:05.502964 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 6439ba0b0468416d9798a6ac1ee7fddd with delete_type TABLET_DATA_DELETED (replaced by tablet ab8682686f894beaaa58f4818c0651c4) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.507143 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7ad519d103e644e1b78ce540d623cbcb
I20260925 01:50:05.507580 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 6439ba0b0468416d9798a6ac1ee7fddd with delete_type TABLET_DATA_DELETED (replaced by tablet ab8682686f894beaaa58f4818c0651c4) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.508694 12964 raft_consensus.cc:493] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.508821 12964 raft_consensus.cc:515] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.509434 12964 leader_election.cc:290] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.511023 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ad519d103e644e1b78ce540d623cbcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.511168 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 41c58f974b1c4334852b7e17b4da7867
I20260925 01:50:05.512089 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b0e27b81d39240efa5136ed668822d35
I20260925 01:50:05.512216 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c58f974b1c4334852b7e17b4da7867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.512418 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c58f974b1c4334852b7e17b4da7867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.512717 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b306496f992f45a9b64b05b73712cb5b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:05.513281 11457 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.513798 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet b0e27b81d39240efa5136ed668822d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.513898 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b306496f992f45a9b64b05b73712cb5b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:05.514122 11239 raft_consensus.cc:2468] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:05.514326 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 38603da7b4b14ce5835646c330b1f0ce
I20260925 01:50:05.514581 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet b0e27b81d39240efa5136ed668822d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.514971 11456 leader_election.cc:304] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:05.515173 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9a1ac178d194c818bf71116f3d44dfc consensus state has no leader
I20260925 01:50:05.515369 12964 raft_consensus.cc:2804] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.515447 12964 raft_consensus.cc:493] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.515437 13139 raft_consensus.cc:2804] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.515512 12964 raft_consensus.cc:3060] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.515512 13139 raft_consensus.cc:493] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.515578 13139 raft_consensus.cc:3060] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.518517 13139 raft_consensus.cc:515] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.519146 13139 leader_election.cc:290] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.519585 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 38603da7b4b14ce5835646c330b1f0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.520041 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 95ac080782664fca8661c188ab822e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.520190 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7944aa1ac8f4c5d8ea3aa2acae41257" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:05.520080 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 38603da7b4b14ce5835646c330b1f0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.520460 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7944aa1ac8f4c5d8ea3aa2acae41257" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:05.520605 11522 raft_consensus.cc:3060] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:05.520678 11177 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.523307 11522 raft_consensus.cc:2468] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:05.490432 11754 ts_tablet_manager.cc:1434] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.371s user 0.003s sys 0.000s
I20260925 01:50:05.528542 11176 leader_election.cc:304] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:05.529469 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fca09010f841c5a7b58678560065f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.530026 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:05.530117 11754 tablet_bootstrap.cc:492] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:05.529443 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f97ead49634bf6b03e292544af4d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.531862 11754 tablet_bootstrap.cc:654] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.535220 12964 raft_consensus.cc:515] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.536430 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b306496f992f45a9b64b05b73712cb5b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:05.536712 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:05.536986 11457 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.536991 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b306496f992f45a9b64b05b73712cb5b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:05.537133 11239 raft_consensus.cc:3060] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.536393 12964 leader_election.cc:290] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.540170 11239 raft_consensus.cc:2468] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:05.540786 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c58f974b1c4334852b7e17b4da7867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.543082 11456 leader_election.cc:304] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:05.553442 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ad519d103e644e1b78ce540d623cbcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.554452 12964 raft_consensus.cc:2804] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:05.554701 12964 raft_consensus.cc:697] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:05.555254 12964 consensus_queue.cc:237] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.557910 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_56311785b95e4e71a49b965b97bd7ca3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.558979 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56311785b95e4e71a49b965b97bd7ca3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.557499 12689 ts_tablet_manager.cc:1929] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.559685 12689 log.cc:1199] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/24cd89d238bf4220a48ecdf59cca5e6d
I20260925 01:50:05.560086 12689 ts_tablet_manager.cc:1950] T 24cd89d238bf4220a48ecdf59cca5e6d P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:05.560367 12782 raft_consensus.cc:493] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:05.560506 12782 raft_consensus.cc:515] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.561391 12782 leader_election.cc:290] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:05.562177 11314 leader_election.cc:343] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 96b68399843a422b8da3ddfab2c522e6
I20260925 01:50:05.563506 11350 tablet_service.cc:1511] Processing CreateTablet for tablet e52692f8a09c44b4b8c13a9a388c2094 (DEFAULT_TABLE table=default.Table_9c9ea2d22ad643308cc531459234f13b [id=64dd7a8e1bae46f1af686e0c9490f4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.566581 11345 tablet_service.cc:1511] Processing CreateTablet for tablet e01435f740804edb994653a42b1a164f (DEFAULT_TABLE table=default.Table_323f0bc0c8e145b3a67223de2f37adcb [id=6beb9100cc9646bbbd88ab9ca2bc1f6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.572182 11212 tablet_service.cc:1511] Processing CreateTablet for tablet e01435f740804edb994653a42b1a164f (DEFAULT_TABLE table=default.Table_323f0bc0c8e145b3a67223de2f37adcb [id=6beb9100cc9646bbbd88ab9ca2bc1f6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.572664 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01435f740804edb994653a42b1a164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.575003 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52692f8a09c44b4b8c13a9a388c2094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.588653 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 346) took 10104 ms. Trace:
I20260925 01:50:05.588850 11953 rpcz_store.cc:276] 0925 01:49:55.484397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.484465 (+ 68us) service_pool.cc:224] Handling call
0925 01:50:04.966032 (+9481567us) ts_tablet_manager.cc:1151] Deleting tablet 86079f22abb74d438c61ecc2a7379cbd
0925 01:50:04.966043 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.091885 (+125842us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.095166 (+ 3281us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.588633 (+493467us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9481310}
I20260925 01:50:05.589640 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3b54278b3e5c4b4d9e47c490f39d4e9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.590340 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b54278b3e5c4b4d9e47c490f39d4e9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.590674 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 352) took 9837 ms. Trace:
I20260925 01:50:05.590803 11953 rpcz_store.cc:276] 0925 01:49:55.753356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.753422 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:05.589343 (+9835921us) ts_tablet_manager.cc:1151] Deleting tablet 31ffb404d93a4436ba9e624b45650fe1
0925 01:50:05.590400 (+ 1057us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.590649 (+ 249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9835574}
I20260925 01:50:05.591253 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e9d27af68a134e74b9ab639ff0ebd044"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.591751 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9d27af68a134e74b9ab639ff0ebd044 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.591812 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 86079f22abb74d438c61ecc2a7379cbd (table default.Table_acb7d558d3a9463e9cef61036b44d1c1 [id=0d689fa6870547f3a57c6b6149b94754]) successfully deleted
W20260925 01:50:05.592100 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 31ffb404d93a4436ba9e624b45650fe1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ffb404d93a4436ba9e624b45650fe1 already in progress: creating tablet
I20260925 01:50:05.592907 12894 raft_consensus.cc:2804] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:05.593092 12894 raft_consensus.cc:697] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:05.593351 12894 consensus_queue.cc:237] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.594368 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1a17bc9d97f7458e8ec979b4728fa9e5" } new_table_name: "default.Table_3adbf2cf7ef74941a8667f2eb134df79" modify_external_catalogs: true
W20260925 01:50:05.595287 11177 consensus_peers.cc:597] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.596200 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_2a41cecc90bc4f7caeca09f31a429af3" } new_table_name: "default.Table_79ff8c3f0c5c47c1bdad50d0d0804f35" modify_external_catalogs: true
I20260925 01:50:05.596408 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4ce55b42ce4e4e239d303411e27c68dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.596948 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ce55b42ce4e4e239d303411e27c68dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.602216 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 38603da7b4b14ce5835646c330b1f0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.606228 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 71339adb55e34645b947c0a9ba8984fb (DEFAULT_TABLE table=default.Table_6fd1a490f7b14d32891655ef19ec0616 [id=444fd89a1cb64649994db88b39dc002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.607816 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet b0e27b81d39240efa5136ed668822d35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.610029 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 71339adb55e34645b947c0a9ba8984fb (DEFAULT_TABLE table=default.Table_6fd1a490f7b14d32891655ef19ec0616 [id=444fd89a1cb64649994db88b39dc002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.610324 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 353) took 9816 ms. Trace:
I20260925 01:50:05.610526 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71339adb55e34645b947c0a9ba8984fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.610432 11953 rpcz_store.cc:276] 0925 01:49:55.793895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.793957 (+ 62us) service_pool.cc:224] Handling call
0925 01:50:05.591153 (+9797196us) ts_tablet_manager.cc:1151] Deleting tablet d12d2cf8c4744858bf0967eeec72f381
0925 01:50:05.610164 (+ 19011us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.610302 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9796859}
I20260925 01:50:05.611614 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 355) took 9764 ms. Trace:
W20260925 01:50:05.611670 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae1cd01418cd44828560b260dd2c9577 consensus state has no leader
I20260925 01:50:05.611696 11953 rpcz_store.cc:276] 0925 01:49:55.847611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.847689 (+ 78us) service_pool.cc:224] Handling call
0925 01:50:05.610728 (+9763039us) ts_tablet_manager.cc:1151] Deleting tablet b61b1bf5a8d446918edc6d166b7712ef
0925 01:50:05.611139 (+ 411us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.611593 (+ 454us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9660629}
I20260925 01:50:05.615803 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0f02542b67804eb896581e58a3fdfe80" } modify_external_catalogs: true
I20260925 01:50:05.616006 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0f02542b67804eb896581e58a3fdfe80" } modify_external_catalogs: true
W20260925 01:50:05.619602 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d12d2cf8c4744858bf0967eeec72f381 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d12d2cf8c4744858bf0967eeec72f381 already in progress: creating tablet
W20260925 01:50:05.619872 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b61b1bf5a8d446918edc6d166b7712ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b61b1bf5a8d446918edc6d166b7712ef already in progress: creating tablet
I20260925 01:50:05.619985 11337 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 235) took 1017 ms. Trace:
I20260925 01:50:05.620079 11337 rpcz_store.cc:276] 0925 01:50:04.602965 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.606147 (+ 3182us) service_pool.cc:224] Handling call
0925 01:50:04.925290 (+319143us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x616000133354. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:50:05.619961 (+694671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540527360}
I20260925 01:50:05.627164 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01435f740804edb994653a42b1a164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.627385 11755 tablet_bootstrap.cc:492] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:05.629079 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ad519d103e644e1b78ce540d623cbcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.629456 11755 tablet_bootstrap.cc:654] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.631843 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71339adb55e34645b947c0a9ba8984fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:05.635661 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 75466.5us
W20260925 01:50:05.635188 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 92115.1us
I20260925 01:50:05.637794 11492 tablet_service.cc:1511] Processing CreateTablet for tablet e52692f8a09c44b4b8c13a9a388c2094 (DEFAULT_TABLE table=default.Table_9c9ea2d22ad643308cc531459234f13b [id=64dd7a8e1bae46f1af686e0c9490f4ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.639348 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96b68399843a422b8da3ddfab2c522e6" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.639249 11679 catalog_manager.cc:5838] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:05.639658 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e52692f8a09c44b4b8c13a9a388c2094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.639709 11679 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e26b1dc65fc84629a72029519919ae23 (table default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]). Expected version 1 got 0
I20260925 01:50:05.642025 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 770ebdbd355142ba86fd9eb8eaa844f4 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:05.642571 11494 tablet_service.cc:1511] Processing CreateTablet for tablet e01435f740804edb994653a42b1a164f (DEFAULT_TABLE table=default.Table_323f0bc0c8e145b3a67223de2f37adcb [id=6beb9100cc9646bbbd88ab9ca2bc1f6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.642920 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01435f740804edb994653a42b1a164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.647198 11314 leader_election.cc:304] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.648087 11374 raft_consensus.cc:3060] T b60706e2087b4ec7b63f6747534a4b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.648185 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 357) took 9760 ms. Trace:
I20260925 01:50:05.648294 11953 rpcz_store.cc:276] 0925 01:49:55.888123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.888359 (+ 236us) service_pool.cc:224] Handling call
0925 01:50:05.611919 (+9723560us) ts_tablet_manager.cc:1151] Deleting tablet d3150980bb72435886486156aa98d342
0925 01:50:05.648022 (+ 36103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.648160 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9652864}
I20260925 01:50:05.648940 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 359) took 9685 ms. Trace:
I20260925 01:50:05.649036 11953 rpcz_store.cc:276] 0925 01:49:55.963800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:55.963877 (+ 77us) service_pool.cc:224] Handling call
0925 01:50:05.648789 (+9684912us) ts_tablet_manager.cc:1151] Deleting tablet 236db241476a4a609869aad539fee426
0925 01:50:05.648798 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.648919 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9684470}
I20260925 01:50:05.649638 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 380) took 9057 ms. Trace:
W20260925 01:50:05.649760 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 236db241476a4a609869aad539fee426 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 236db241476a4a609869aad539fee426 already in progress: creating tablet
I20260925 01:50:05.649717 11953 rpcz_store.cc:276] 0925 01:49:56.592223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.592299 (+ 76us) service_pool.cc:224] Handling call
0925 01:50:05.649473 (+9057174us) ts_tablet_manager.cc:1151] Deleting tablet 4f117df272c342b6b4ea5e5a4d7fd137
0925 01:50:05.649482 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.649621 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9056869}
I20260925 01:50:05.650168 11953 tablet_replica.cc:333] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:05.650354 11953 raft_consensus.cc:2243] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.650491 11953 pending_rounds.cc:70] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:50:05.650528 11953 pending_rounds.cc:77] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072889257906176 op_type: NO_OP noop_request { }
I20260925 01:50:05.650614 11953 raft_consensus.cc:2889] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:05.650693 11953 raft_consensus.cc:2272] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.651228 11953 ts_tablet_manager.cc:1916] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.654577 11946 ts_tablet_manager.cc:1929] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.654800 11946 log.cc:1199] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/784de8c6e6e1434a91106dd19cd9262a
I20260925 01:50:05.655341 11946 ts_tablet_manager.cc:1950] T 784de8c6e6e1434a91106dd19cd9262a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:05.656342 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 586) took 3554 ms. Trace:
I20260925 01:50:05.656481 11753 tablet_bootstrap.cc:492] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:05.656520 11946 rpcz_store.cc:276] 0925 01:50:02.101453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.117872 (+ 16419us) service_pool.cc:224] Handling call
0925 01:50:05.106137 (+2988265us) ts_tablet_manager.cc:1151] Deleting tablet 784de8c6e6e1434a91106dd19cd9262a
0925 01:50:05.106153 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.486024 (+379871us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.654508 (+168484us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.656320 (+ 1812us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2987815}
I20260925 01:50:05.657100 11946 tablet_replica.cc:333] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:05.657337 11946 raft_consensus.cc:2243] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:05.657785 11946 raft_consensus.cc:2272] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.659595 11946 ts_tablet_manager.cc:1916] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.659970 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 784de8c6e6e1434a91106dd19cd9262a (table default.Table_3bcedabba6c244178b5f3479e7996282 [id=5405c0f51c3b4db8a58b97b60ea65777]) successfully deleted
I20260925 01:50:05.660811 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f1e89d9f87104c768839104c80614f5e
I20260925 01:50:05.661741 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 770ebdbd355142ba86fd9eb8eaa844f4
I20260925 01:50:05.661839 12689 tablet_replica.cc:333] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.662083 12689 raft_consensus.cc:2243] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:05.662415 12689 pending_rounds.cc:70] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:05.662425 11675 catalog_manager.cc:6934] ReplaceTablet: tablet 770ebdbd355142ba86fd9eb8eaa844f4 deleted and replaced by tablet 06f81b111fc9477bafd4889d40d08dd3
I20260925 01:50:05.662467 12689 pending_rounds.cc:77] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072915426906112 op_type: NO_OP noop_request { }
I20260925 01:50:05.662572 12689 raft_consensus.cc:2889] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:05.662652 12689 raft_consensus.cc:2272] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.662925 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 770ebdbd355142ba86fd9eb8eaa844f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 06f81b111fc9477bafd4889d40d08dd3) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.663344 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet f1e89d9f87104c768839104c80614f5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.663457 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 770ebdbd355142ba86fd9eb8eaa844f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 06f81b111fc9477bafd4889d40d08dd3) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.663925 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 24cd89d238bf4220a48ecdf59cca5e6d (table default.Table_9704bbf8ddbe4f129bccb5a8e30be536 [id=462de86042324bc49bf8949a13d0fec2]) successfully deleted
I20260925 01:50:05.664320 12689 ts_tablet_manager.cc:1916] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.665266 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 5276072bbeca403fb06566b4a43489a0 (DEFAULT_TABLE table=default.Table_91f5d26231524dd6ad91b6d49e5e9d14 [id=0e4222a25e1a4a659209cc1904587c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.665674 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5276072bbeca403fb06566b4a43489a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.667135 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9faca745994fa7944e2232049a2105 (DEFAULT_TABLE table=default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51 [id=63171538e0ac47ce9572edcc3b1ea05b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.667519 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9faca745994fa7944e2232049a2105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.656670 11753 ts_tablet_manager.cc:1403] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.402s user 0.023s sys 0.019s
I20260925 01:50:05.672490 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9faca745994fa7944e2232049a2105 (DEFAULT_TABLE table=default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51 [id=63171538e0ac47ce9572edcc3b1ea05b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.672950 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9faca745994fa7944e2232049a2105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.677861 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet 770ebdbd355142ba86fd9eb8eaa844f4 with delete_type TABLET_DATA_DELETED (replaced by tablet 06f81b111fc9477bafd4889d40d08dd3) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.679176 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 5276072bbeca403fb06566b4a43489a0 (DEFAULT_TABLE table=default.Table_91f5d26231524dd6ad91b6d49e5e9d14 [id=0e4222a25e1a4a659209cc1904587c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.679831 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5276072bbeca403fb06566b4a43489a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.682741 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 5276072bbeca403fb06566b4a43489a0 (DEFAULT_TABLE table=default.Table_91f5d26231524dd6ad91b6d49e5e9d14 [id=0e4222a25e1a4a659209cc1904587c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.683363 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5276072bbeca403fb06566b4a43489a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.686959 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet f1e89d9f87104c768839104c80614f5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.687832 11753 raft_consensus.cc:359] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.688112 11753 raft_consensus.cc:385] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.688207 11753 raft_consensus.cc:740] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.688372 13139 consensus_queue.cc:1048] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:05.688473 11753 consensus_queue.cc:260] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.689097 11753 ts_tablet_manager.cc:1434] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260925 01:50:05.689371 11753 tablet_bootstrap.cc:492] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:05.692453 11753 tablet_bootstrap.cc:654] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.696235 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d4944bbe1b814196b7692b4ce51d11a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:05.696321 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b8457e024a154480817c8b2d97e1e398"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.697121 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8457e024a154480817c8b2d97e1e398 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:05.697116 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4944bbe1b814196b7692b4ce51d11a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.700606 12689 ts_tablet_manager.cc:1929] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.700739 12689 log.cc:1199] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a9068770de0b473488bd8ea4752fb15d
I20260925 01:50:05.701009 12782 raft_consensus.cc:493] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.701182 12689 ts_tablet_manager.cc:1950] T a9068770de0b473488bd8ea4752fb15d P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:05.701177 12782 raft_consensus.cc:515] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.701875 12782 leader_election.cc:290] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.701859 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a9068770de0b473488bd8ea4752fb15d (table default.Table_bb67fea9df444e16a94bb2a276fc99be [id=b527a6ca23af495195c09be2d49de223]) successfully deleted
W20260925 01:50:05.703878 11314 leader_election.cc:343] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a9944a1422d14ae2b22451e67c477d5b
I20260925 01:50:05.709726 13101 raft_consensus.cc:2749] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:05.711156 12689 tablet_replica.cc:333] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.711369 12689 raft_consensus.cc:2243] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.711517 12689 raft_consensus.cc:2272] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.712067 12689 ts_tablet_manager.cc:1916] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.717866 13101 raft_consensus.cc:493] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.718011 13101 raft_consensus.cc:515] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.718698 13101 leader_election.cc:290] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:05.719907 11314 leader_election.cc:343] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 85d859207bbc4aefb26c726dce404c44
I20260925 01:50:05.723425 12689 ts_tablet_manager.cc:1929] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:05.723552 12689 log.cc:1199] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/53d30f4940c44bcf900a8cf0de91a66d
I20260925 01:50:05.723884 12689 ts_tablet_manager.cc:1950] T 53d30f4940c44bcf900a8cf0de91a66d P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:05.725132 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 53d30f4940c44bcf900a8cf0de91a66d (table default.Table_fd114e03807f4a78964e4057de720bfa [id=a2353cff823048a2bfedf7ef1c58975b]) successfully deleted
I20260925 01:50:05.725564 12689 tablet_replica.cc:333] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.725811 12689 raft_consensus.cc:2243] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.726034 12689 raft_consensus.cc:2272] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.726694 12689 ts_tablet_manager.cc:1916] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.733912 11754 tablet_bootstrap.cc:492] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:05.734241 11754 ts_tablet_manager.cc:1403] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.205s user 0.004s sys 0.003s
I20260925 01:50:05.735172 11754 raft_consensus.cc:359] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.735512 11754 raft_consensus.cc:385] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.735648 11754 raft_consensus.cc:740] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.735985 11754 consensus_queue.cc:260] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.732909 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 03487a3fa9574fd583d9c95d0624203c (DEFAULT_TABLE table=default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.737673 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03487a3fa9574fd583d9c95d0624203c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.738967 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7b8aaa9dead44c7a88716274828db980"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.739784 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b8aaa9dead44c7a88716274828db980 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.742324 11355 tablet_service.cc:1511] Processing CreateTablet for tablet a93acc6987404ffaaf580d0ad2519df8 (DEFAULT_TABLE table=default.Table_5623ddf2e68941919d8ba2a5c6e50b5f [id=1e1efb30deed4ebb977fbc21bf7d63b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.742713 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93acc6987404ffaaf580d0ad2519df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.744834 11953 ts_tablet_manager.cc:1929] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.744956 11953 log.cc:1199] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/bfa2e2d4bfe14b5db5b1dfd67e19f11c
I20260925 01:50:05.745606 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dc930962532b405ea882720e38cde06c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.746335 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc930962532b405ea882720e38cde06c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.746519 11755 tablet_bootstrap.cc:492] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:05.746642 11755 ts_tablet_manager.cc:1403] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.119s user 0.005s sys 0.000s
I20260925 01:50:05.749994 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1ff7d1bdc46449e9adbec517b976a6bb" } new_table_name: "default.Table_fdbe7f8ff5014bca943f18e3c965224d" modify_external_catalogs: true
I20260925 01:50:05.752527 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_75bca35046524ed68a35b985cdb07db5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.753111 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75bca35046524ed68a35b985cdb07db5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.756297 11755 raft_consensus.cc:359] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.756472 11755 raft_consensus.cc:385] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.756531 11755 raft_consensus.cc:740] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.756807 11755 consensus_queue.cc:260] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.757390 11755 ts_tablet_manager.cc:1434] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260925 01:50:05.757685 11755 tablet_bootstrap.cc:492] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:05.762396 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c48a0c5780c147a49cd23624e0868842"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.763098 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c48a0c5780c147a49cd23624e0868842 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.763525 11953 ts_tablet_manager.cc:1950] T bfa2e2d4bfe14b5db5b1dfd67e19f11c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:05.763819 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 382) took 9165 ms. Trace:
I20260925 01:50:05.763891 11953 rpcz_store.cc:276] 0925 01:49:56.598272 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.598425 (+ 153us) service_pool.cc:224] Handling call
0925 01:50:05.650124 (+9051699us) ts_tablet_manager.cc:1151] Deleting tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c
0925 01:50:05.650133 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.672529 (+ 22396us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.744780 (+ 72251us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.763805 (+ 19025us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9051458}
I20260925 01:50:05.764261 11953 tablet_replica.cc:333] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:05.764441 11953 raft_consensus.cc:2243] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.764451 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet bfa2e2d4bfe14b5db5b1dfd67e19f11c (table default.Table_5853dcaed91a4f87b5d7b36db7a61965 [id=1b2a20dc907c4e3ca2a5c4a41fd46378]) successfully deleted
I20260925 01:50:05.764578 11953 pending_rounds.cc:70] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:50:05.764613 11953 pending_rounds.cc:77] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072887340593152 op_type: NO_OP noop_request { }
I20260925 01:50:05.765828 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c13ddf2cd0284738a0d781b7a2ccf761" } new_table_name: "default.Table_38133c6cf6c2446cac65d84dc214f99e" modify_external_catalogs: true
I20260925 01:50:05.698999 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9faca745994fa7944e2232049a2105 (DEFAULT_TABLE table=default.Table_7a8aa77bf76d4b6f8c371fc7c233ba51 [id=63171538e0ac47ce9572edcc3b1ea05b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.699651 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet f1e89d9f87104c768839104c80614f5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.699839 13066 raft_consensus.cc:493] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.767248 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9faca745994fa7944e2232049a2105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.767169 13066 raft_consensus.cc:515] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.768000 13066 leader_election.cc:290] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.710693 11946 ts_tablet_manager.cc:1929] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.768215 11946 log.cc:1199] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/45a794ad0d87475a88efc02f5ae080f4
I20260925 01:50:05.768695 11946 ts_tablet_manager.cc:1950] T 45a794ad0d87475a88efc02f5ae080f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:05.769057 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 584) took 3667 ms. Trace:
I20260925 01:50:05.769148 11946 rpcz_store.cc:276] 0925 01:50:02.101281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.118356 (+ 17075us) service_pool.cc:224] Handling call
0925 01:50:05.657050 (+3538694us) ts_tablet_manager.cc:1151] Deleting tablet 45a794ad0d87475a88efc02f5ae080f4
0925 01:50:05.657063 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.683435 (+ 26372us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.710630 (+ 27195us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.769033 (+ 58403us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3538491}
I20260925 01:50:05.769531 11946 tablet_replica.cc:333] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:05.769765 11946 raft_consensus.cc:2243] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.764693 11953 raft_consensus.cc:2889] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:05.769956 11953 raft_consensus.cc:2272] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.769973 11946 raft_consensus.cc:2272] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.745280 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 03487a3fa9574fd583d9c95d0624203c (DEFAULT_TABLE table=default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.770390 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03487a3fa9574fd583d9c95d0624203c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.770526 11953 ts_tablet_manager.cc:1916] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.748210 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9944a1422d14ae2b22451e67c477d5b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.774174 11519 raft_consensus.cc:2468] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:05.775372 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 45a794ad0d87475a88efc02f5ae080f4 (table default.Table_bc79315e26e64754b7ae9ce08ba0a88d [id=b96d7b3ebf9544a0867e0ab08c072648]) successfully deleted
I20260925 01:50:05.776245 11946 ts_tablet_manager.cc:1916] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.781327 11495 tablet_service.cc:1511] Processing CreateTablet for tablet b0e27b81d39240efa5136ed668822d35 (DEFAULT_TABLE table=default.Table_f7b427ed4a7346fbbfaba8281fbfd929 [id=b0e9acd2b19244ca8d7dfc346344a74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.781703 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e27b81d39240efa5136ed668822d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.787563 11946 ts_tablet_manager.cc:1929] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:05.787760 11946 log.cc:1199] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ba378e9d37c64a8ebd56894b2101ed8f
I20260925 01:50:05.788193 11946 ts_tablet_manager.cc:1950] T ba378e9d37c64a8ebd56894b2101ed8f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:05.787278 11355 tablet_service.cc:1511] Processing CreateTablet for tablet b0e27b81d39240efa5136ed668822d35 (DEFAULT_TABLE table=default.Table_f7b427ed4a7346fbbfaba8281fbfd929 [id=b0e9acd2b19244ca8d7dfc346344a74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.788494 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e27b81d39240efa5136ed668822d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.788584 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 585) took 3687 ms. Trace:
I20260925 01:50:05.788728 11946 rpcz_store.cc:276] 0925 01:50:02.101372 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.118582 (+ 17210us) service_pool.cc:224] Handling call
0925 01:50:05.769478 (+3650896us) ts_tablet_manager.cc:1151] Deleting tablet ba378e9d37c64a8ebd56894b2101ed8f
0925 01:50:05.769489 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.783634 (+ 14145us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.787514 (+ 3880us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.788569 (+ 1055us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3650722}
I20260925 01:50:05.789145 11946 tablet_replica.cc:333] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:05.789867 11946 raft_consensus.cc:2243] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:05.789870 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]) successfully deleted
I20260925 01:50:05.790452 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad519d103e644e1b78ce540d623cbcb (DEFAULT_TABLE table=default.Table_0c39d486ee7c4893bed0f1ee98d35b81 [id=26ecc006320e4f01bf49736054cc5c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.790714 11946 raft_consensus.cc:2272] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:05.761917 11457 consensus_peers.cc:597] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.790841 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad519d103e644e1b78ce540d623cbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.741281 11208 tablet_service.cc:1511] Processing CreateTablet for tablet a93acc6987404ffaaf580d0ad2519df8 (DEFAULT_TABLE table=default.Table_5623ddf2e68941919d8ba2a5c6e50b5f [id=1e1efb30deed4ebb977fbc21bf7d63b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.792954 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93acc6987404ffaaf580d0ad2519df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.794634 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad519d103e644e1b78ce540d623cbcb (DEFAULT_TABLE table=default.Table_0c39d486ee7c4893bed0f1ee98d35b81 [id=26ecc006320e4f01bf49736054cc5c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.789539 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 71339adb55e34645b947c0a9ba8984fb (DEFAULT_TABLE table=default.Table_6fd1a490f7b14d32891655ef19ec0616 [id=444fd89a1cb64649994db88b39dc002e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.797216 11946 ts_tablet_manager.cc:1916] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.797533 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71339adb55e34645b947c0a9ba8984fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.797713 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_13eaf05cb87449d98c6212a88e7147e7" } modify_external_catalogs: true
I20260925 01:50:05.797962 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_13eaf05cb87449d98c6212a88e7147e7" } modify_external_catalogs: true
I20260925 01:50:05.744200 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 03487a3fa9574fd583d9c95d0624203c (DEFAULT_TABLE table=default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.749202 12689 ts_tablet_manager.cc:1929] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:50:05.766222 11177 consensus_peers.cc:597] T bdf7f544827d4bca97aa6b63c0c48c0d P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:05.775033 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3150980bb72435886486156aa98d342" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:05.798738 12689 log.cc:1199] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/829d167dc0214890b722c0197500f159
I20260925 01:50:05.799091 12689 ts_tablet_manager.cc:1950] T 829d167dc0214890b722c0197500f159 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:05.799345 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03487a3fa9574fd583d9c95d0624203c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.799970 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_35c4ed0e87a84f229968365f06717746" } modify_external_catalogs: true
I20260925 01:50:05.800182 12689 tablet_replica.cc:333] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.800140 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 829d167dc0214890b722c0197500f159 (table default.Table_5ee00c6a9b644c778e571ff1952327d1 [id=83d275d67d4340e985a5c6a6e3354c45]) successfully deleted
I20260925 01:50:05.800160 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_35c4ed0e87a84f229968365f06717746" } modify_external_catalogs: true
I20260925 01:50:05.800387 12689 raft_consensus.cc:2243] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.800546 12689 raft_consensus.cc:2272] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:05.800652 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet dfde700aff8049f4b10c46059da6907f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfde700aff8049f4b10c46059da6907f already in progress: creating tablet
I20260925 01:50:05.801096 12689 ts_tablet_manager.cc:1916] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.788839 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 7ad519d103e644e1b78ce540d623cbcb (DEFAULT_TABLE table=default.Table_0c39d486ee7c4893bed0f1ee98d35b81 [id=26ecc006320e4f01bf49736054cc5c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.806977 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad519d103e644e1b78ce540d623cbcb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:05.810992 11456 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.811712 13066 raft_consensus.cc:493] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.811833 13066 raft_consensus.cc:515] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.812399 13066 leader_election.cc:290] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.814644 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad519d103e644e1b78ce540d623cbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.818861 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_45e7213362f74039a9576e25db157d24" } modify_external_catalogs: true
I20260925 01:50:05.819100 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_45e7213362f74039a9576e25db157d24" } modify_external_catalogs: true
I20260925 01:50:05.820803 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_072303d9dad749568fb97c9451238de1" } new_table_name: "default.Table_6554cdebbe834c79b745a3509dfd52ca" modify_external_catalogs: true
I20260925 01:50:05.821398 11754 ts_tablet_manager.cc:1434] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.087s user 0.001s sys 0.001s
I20260925 01:50:05.821693 11754 tablet_bootstrap.cc:492] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:05.823630 11754 tablet_bootstrap.cc:654] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.825364 11753 tablet_bootstrap.cc:492] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:05.825431 11314 leader_election.cc:343] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 85d859207bbc4aefb26c726dce404c44
I20260925 01:50:05.825605 11753 ts_tablet_manager.cc:1403] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.136s user 0.003s sys 0.000s
I20260925 01:50:05.825634 12782 raft_consensus.cc:493] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.825873 12782 raft_consensus.cc:515] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.826493 11753 raft_consensus.cc:359] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.826647 11314 leader_election.cc:304] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.827143 12947 raft_consensus.cc:2749] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:05.828142 11314 leader_election.cc:304] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.828434 12947 raft_consensus.cc:2804] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.828522 12947 raft_consensus.cc:493] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.828588 12947 raft_consensus.cc:3060] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.830690 12782 leader_election.cc:290] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.833359 11212 tablet_service.cc:1511] Processing CreateTablet for tablet b0e27b81d39240efa5136ed668822d35 (DEFAULT_TABLE table=default.Table_f7b427ed4a7346fbbfaba8281fbfd929 [id=b0e9acd2b19244ca8d7dfc346344a74c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:05.836966 12782 raft_consensus.cc:493] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.837093 12782 raft_consensus.cc:515] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.845148 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3150980bb72435886486156aa98d342" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.845625 13101 raft_consensus.cc:493] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.845746 13101 raft_consensus.cc:515] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.846388 13101 leader_election.cc:290] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.848176 13139 raft_consensus.cc:493] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.848202 12947 raft_consensus.cc:515] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.848438 13139 raft_consensus.cc:515] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.848860 12947 leader_election.cc:290] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.850274 13139 leader_election.cc:290] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.850705 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ac080782664fca8661c188ab822e89" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:05.851282 11177 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:05.852371 11314 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: e2b9df8d98e5414186ef23b8b7f9cb61
W20260925 01:50:05.852620 11314 leader_election.cc:343] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 17352fd6ea4e4ed9a178f1510edf4f6d
W20260925 01:50:05.852807 11314 leader_election.cc:343] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a8c46e780d4a4987ad52619e4c3b46c9
W20260925 01:50:05.852995 11314 leader_election.cc:343] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a9944a1422d14ae2b22451e67c477d5b
I20260925 01:50:05.853850 12782 leader_election.cc:290] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:05.854293 11755 tablet_bootstrap.cc:654] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.855229 11753 raft_consensus.cc:385] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.855312 11753 raft_consensus.cc:740] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.855635 11753 consensus_queue.cc:260] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.856343 11753 ts_tablet_manager.cc:1434] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.031s user 0.001s sys 0.000s
I20260925 01:50:05.856755 11753 tablet_bootstrap.cc:492] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:05.792315 11501 tablet_service.cc:1511] Processing CreateTablet for tablet a93acc6987404ffaaf580d0ad2519df8 (DEFAULT_TABLE table=default.Table_5623ddf2e68941919d8ba2a5c6e50b5f [id=1e1efb30deed4ebb977fbc21bf7d63b7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:05.834043 11456 leader_election.cc:343] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 829d167dc0214890b722c0197500f159
I20260925 01:50:05.858475 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93acc6987404ffaaf580d0ad2519df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.853816 11946 ts_tablet_manager.cc:1929] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.859066 11946 log.cc:1199] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/96b68399843a422b8da3ddfab2c522e6
I20260925 01:50:05.859467 11946 ts_tablet_manager.cc:1950] T 96b68399843a422b8da3ddfab2c522e6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:05.860285 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 600) took 3700 ms. Trace:
I20260925 01:50:05.859545 11753 tablet_bootstrap.cc:654] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:05.860666 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ac080782664fca8661c188ab822e89" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.860426 11946 rpcz_store.cc:276] 0925 01:50:02.159340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.159738 (+ 398us) service_pool.cc:224] Handling call
0925 01:50:05.789101 (+3629363us) ts_tablet_manager.cc:1151] Deleting tablet 96b68399843a422b8da3ddfab2c522e6
0925 01:50:05.789111 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.807574 (+ 18463us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.853747 (+ 46173us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.860267 (+ 6520us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3629159}
I20260925 01:50:05.863834 11519 raft_consensus.cc:2468] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:05.864308 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 96b68399843a422b8da3ddfab2c522e6 (table default.Table_7ad0a76f459148b29a5a3c029573cc5b [id=74fd2e729fe648ab90e6e4e9876d28f0]) successfully deleted
I20260925 01:50:05.864821 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 601) took 3705 ms. Trace:
I20260925 01:50:05.864943 11946 rpcz_store.cc:276] 0925 01:50:02.159446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.159976 (+ 530us) service_pool.cc:224] Handling call
0925 01:50:05.864708 (+3704732us) ts_tablet_manager.cc:1151] Deleting tablet 3541e17b47bc47f5b69add361877a2bf
0925 01:50:05.864717 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.864806 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3704611}
W20260925 01:50:05.867262 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3541e17b47bc47f5b69add361877a2bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3541e17b47bc47f5b69add361877a2bf already in progress: creating tablet
I20260925 01:50:05.867760 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 602) took 3708 ms. Trace:
I20260925 01:50:05.867897 11946 rpcz_store.cc:276] 0925 01:50:02.159560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.160119 (+ 559us) service_pool.cc:224] Handling call
0925 01:50:05.867659 (+3707540us) ts_tablet_manager.cc:1151] Deleting tablet ab8d5af739854f939ab585d943e7b7ca
0925 01:50:05.867668 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.867746 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3707423}
W20260925 01:50:05.868461 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ab8d5af739854f939ab585d943e7b7ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab8d5af739854f939ab585d943e7b7ca already in progress: creating tablet
I20260925 01:50:05.868856 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 599) took 3709 ms. Trace:
I20260925 01:50:05.868888 11953 ts_tablet_manager.cc:1929] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.868978 11946 rpcz_store.cc:276] 0925 01:50:02.159175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.160248 (+ 1073us) service_pool.cc:224] Handling call
0925 01:50:05.868749 (+3708501us) ts_tablet_manager.cc:1151] Deleting tablet c2fa459a53a54f47be961067736d2d16
0925 01:50:05.868760 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.868839 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3708397}
I20260925 01:50:05.869390 11953 log.cc:1199] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/55e9d52e3f79408a99216250aefc45c8
W20260925 01:50:05.869639 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet c2fa459a53a54f47be961067736d2d16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2fa459a53a54f47be961067736d2d16 already in progress: creating tablet
I20260925 01:50:05.869943 11946 tablet_replica.cc:333] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:05.870214 11946 raft_consensus.cc:2243] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.870469 11946 raft_consensus.cc:2272] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.871490 11946 ts_tablet_manager.cc:1916] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.882766 11953 ts_tablet_manager.cc:1950] T 55e9d52e3f79408a99216250aefc45c8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:05.884168 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 383) took 9285 ms. Trace:
I20260925 01:50:05.884479 11953 rpcz_store.cc:276] 0925 01:49:56.598370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.598705 (+ 335us) service_pool.cc:224] Handling call
0925 01:50:05.764212 (+9165507us) ts_tablet_manager.cc:1151] Deleting tablet 55e9d52e3f79408a99216250aefc45c8
0925 01:50:05.764223 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.793095 (+ 28872us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.868830 (+ 75735us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.884145 (+ 15315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9165300}
I20260925 01:50:05.885185 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 55e9d52e3f79408a99216250aefc45c8 (table default.Table_0523f9d0a4ec4762bf166dafb16b6f9b [id=4d6a2bc9d7f44b26bc9ca526a34f4687]) successfully deleted
I20260925 01:50:05.885599 11953 tablet_replica.cc:333] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:05.885885 11953 raft_consensus.cc:2243] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:05.886251 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet bd594870fa6a4ba190a18a48d821d72c (table default.Table_8041861b60a24a3c974d0e20742fc1ac [id=c5063b64da5341b9a9e9282585d74695], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet bd594870fa6a4ba190a18a48d821d72c consensus state has no leader
I20260925 01:50:05.886682 11953 raft_consensus.cc:2272] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.887415 11946 ts_tablet_manager.cc:1929] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:05.887976 11953 ts_tablet_manager.cc:1916] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.889302 11176 leader_election.cc:304] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:05.889739 12894 raft_consensus.cc:2804] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:05.889765 11946 log.cc:1199] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/fcb56153a802427aaebbf55a8193d62b
I20260925 01:50:05.889827 12894 raft_consensus.cc:493] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:05.889899 12894 raft_consensus.cc:3060] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.891254 11946 ts_tablet_manager.cc:1950] T fcb56153a802427aaebbf55a8193d62b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:05.892117 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 606) took 3718 ms. Trace:
I20260925 01:50:05.892549 11946 rpcz_store.cc:276] 0925 01:50:02.173702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.175434 (+ 1732us) service_pool.cc:224] Handling call
0925 01:50:05.869903 (+3694469us) ts_tablet_manager.cc:1151] Deleting tablet fcb56153a802427aaebbf55a8193d62b
0925 01:50:05.869911 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.879290 (+ 9379us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.887358 (+ 8068us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.892100 (+ 4742us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3694322}
I20260925 01:50:05.892730 12894 raft_consensus.cc:515] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.893023 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet fcb56153a802427aaebbf55a8193d62b (table default.Table_408d8b2c40464a69b5427f4713abff09 [id=ab32966818e7462982dc4ecfb0d662db]) successfully deleted
I20260925 01:50:05.893597 11946 tablet_replica.cc:333] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:05.893815 12894 leader_election.cc:290] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:05.894346 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c44007cb7eb4263a9209cb3989d4a25 consensus state has no leader
I20260925 01:50:05.894393 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ac080782664fca8661c188ab822e89" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:05.896697 11177 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.897464 13066 raft_consensus.cc:493] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:05.898101 13066 raft_consensus.cc:515] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.898350 12689 ts_tablet_manager.cc:1929] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:05.898440 12689 log.cc:1199] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b306496f992f45a9b64b05b73712cb5b
I20260925 01:50:05.898734 12689 ts_tablet_manager.cc:1950] T b306496f992f45a9b64b05b73712cb5b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:05.898833 13066 leader_election.cc:290] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:05.898854 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d6b0a7ae71724ba385371d3b772b067c
I20260925 01:50:05.899113 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e27b81d39240efa5136ed668822d35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:05.899749 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_092ac523caf349c98af50bb4a26b2978" } modify_external_catalogs: true
I20260925 01:50:05.899955 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_092ac523caf349c98af50bb4a26b2978" } modify_external_catalogs: true
I20260925 01:50:05.902163 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fbd4b231f89a48e59e5eb3cf3976385a
I20260925 01:50:05.902863 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet fbd4b231f89a48e59e5eb3cf3976385a from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:05.903422 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8453c4651b1f4ac8afd25ece798e9bc1" } new_table_name: "default.Table_a9bdcb0034c84520a7d9881bc8927159" modify_external_catalogs: true
I20260925 01:50:05.904843 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet d6b0a7ae71724ba385371d3b772b067c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.905663 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet d6b0a7ae71724ba385371d3b772b067c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.905676 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ac080782664fca8661c188ab822e89" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:05.905838 11519 raft_consensus.cc:3060] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.905864 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet fbd4b231f89a48e59e5eb3cf3976385a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.906170 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:05.906219 11456 leader_election.cc:343] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a8c46e780d4a4987ad52619e4c3b46c9
I20260925 01:50:05.906962 11754 tablet_bootstrap.cc:492] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:05.907156 11754 ts_tablet_manager.cc:1403] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.000s
I20260925 01:50:05.908125 11754 raft_consensus.cc:359] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.908392 11754 raft_consensus.cc:385] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:05.908594 11754 raft_consensus.cc:740] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.908535 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_34acdfc8c4114f2faf38426ee11720cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:05.909188 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f778b87d307483b9edb17dce7355a65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.909188 11754 consensus_queue.cc:260] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.911136 11519 raft_consensus.cc:2468] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:05.911772 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9c9ea2d22ad643308cc531459234f13b" } new_table_name: "default.Table_a1c3833ec39641b5bc0225f22def98c9" modify_external_catalogs: true
I20260925 01:50:05.913352 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e7b218fb25c34d70b618138a743d1070"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:05.913964 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet fbd4b231f89a48e59e5eb3cf3976385a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:05.914271 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7b218fb25c34d70b618138a743d1070 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.915138 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829d167dc0214890b722c0197500f159" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.915423 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet fbd4b231f89a48e59e5eb3cf3976385a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:05.916009 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 45925c3a3dca4f0c88c0a5c52f2b4d6e consensus state has no leader
I20260925 01:50:05.916548 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e787a9a0909645f19a441b5e7c22cc16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.917192 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e787a9a0909645f19a441b5e7c22cc16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.918344 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet d6b0a7ae71724ba385371d3b772b067c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.908535 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7aa08be59d354d23b4bcdd766febd19c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:05.919299 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7aa08be59d354d23b4bcdd766febd19c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:05.920042 11946 raft_consensus.cc:2243] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:05.920272 11946 raft_consensus.cc:2272] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.920679 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet d253f8b1e4ac41388a885178f2ed0f40 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:05.924293 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c46e780d4a4987ad52619e4c3b46c9" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:05.924539 11370 raft_consensus.cc:2468] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:05.925457 11946 ts_tablet_manager.cc:1916] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:05.929538 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34acdfc8c4114f2faf38426ee11720cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:05.938673 11457 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.939109 11457 leader_election.cc:304] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.939640 13066 raft_consensus.cc:2749] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:05.940903 11457 leader_election.cc:343] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:05.941996 11457 leader_election.cc:304] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:05.942552 13066 raft_consensus.cc:2749] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:05.943202 11457 leader_election.cc:304] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:05.943830 11457 raft_consensus.cc:2686] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:05.949536 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bfc152df745b46fb84aec1c9fa017ba5
I20260925 01:50:05.950767 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet bfc152df745b46fb84aec1c9fa017ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:05.954403 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 064c6cbe77d0405abe16a9a53d842590 has no consensus state
I20260925 01:50:05.957355 11953 ts_tablet_manager.cc:1929] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:50:05.957506 11953 log.cc:1199] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/0fa7a3941254478c800f9e366e3f7b06
I20260925 01:50:05.957903 11953 ts_tablet_manager.cc:1950] T 0fa7a3941254478c800f9e366e3f7b06 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:05.958802 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet bfc152df745b46fb84aec1c9fa017ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.959203 11679 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e26b1dc65fc84629a72029519919ae23 (table default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]). Expected version 1 got 0
I20260925 01:50:05.959785 11679 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7da55c488da540048a94324fa347c1ef (table default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17]). Expected version 5 got 0
I20260925 01:50:05.960083 11679 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:05.965770 11671 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 519d954b6a214d0b8e960e128cfcea10 (table default.Table_126b13b368c348bea98d7d87748aaf1c [id=3e31f69b151b4dd69a3ac8be6e2bc48d]). Expected version 1 got 0
I20260925 01:50:05.966663 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_eb7ce1a2a7094b9a948582c38d8958a3" } modify_external_catalogs: true
I20260925 01:50:05.966952 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_eb7ce1a2a7094b9a948582c38d8958a3" } modify_external_catalogs: true
I20260925 01:50:05.967941 11753 tablet_bootstrap.cc:492] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:05.968156 11753 ts_tablet_manager.cc:1403] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.112s user 0.014s sys 0.002s
I20260925 01:50:05.969770 11753 raft_consensus.cc:359] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:05.970026 11753 raft_consensus.cc:385] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:05.970075 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e52692f8a09c44b4b8c13a9a388c2094 consensus state has no leader
I20260925 01:50:05.970165 11753 raft_consensus.cc:740] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:05.970432 11753 consensus_queue.cc:260] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:05.970582 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9feb00f881ed4518a32e08d170080a46 consensus state has no leader
I20260925 01:50:05.971159 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 22a335062caa48139e1cd4bca7bd4e2b
I20260925 01:50:05.971194 11753 ts_tablet_manager.cc:1434] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:50:05.972019 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a335062caa48139e1cd4bca7bd4e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:05.913368 11176 leader_election.cc:304] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:05.972870 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 59535.5us
I20260925 01:50:05.972919 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a335062caa48139e1cd4bca7bd4e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:05.966017 12689 tablet_replica.cc:333] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:05.974151 12689 raft_consensus.cc:2243] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:05.974255 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b306496f992f45a9b64b05b73712cb5b (table default.Table_04449fc82e9a480cbd1dfa613ef87dbd [id=5fff99035f0e4089bf06b22ac548e8d2]) successfully deleted
I20260925 01:50:05.974607 12689 raft_consensus.cc:2272] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:05.914211 13166 tablet.cc:1751] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:05.973896 13140 raft_consensus.cc:2804] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:05.975435 13140 raft_consensus.cc:697] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:05.975685 13140 consensus_queue.cc:237] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:05.978192 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a335062caa48139e1cd4bca7bd4e2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:05.978417 12689 ts_tablet_manager.cc:1916] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:05.979840 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c46e780d4a4987ad52619e4c3b46c9" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:05.982518 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9944a1422d14ae2b22451e67c477d5b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:05.982717 11521 raft_consensus.cc:3060] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:05.985441 11521 raft_consensus.cc:2468] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:05.986469 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:05.994123 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet bfc152df745b46fb84aec1c9fa017ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.000442 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d253f8b1e4ac41388a885178f2ed0f40
I20260925 01:50:06.001046 11676 catalog_manager.cc:6934] ReplaceTablet: tablet d253f8b1e4ac41388a885178f2ed0f40 deleted and replaced by tablet 92cadafa2a624e08a4d98faf842cfcf0
I20260925 01:50:06.002782 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet d253f8b1e4ac41388a885178f2ed0f40 with delete_type TABLET_DATA_DELETED (replaced by tablet 92cadafa2a624e08a4d98faf842cfcf0) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:06.003016 11456 consensus_peers.cc:597] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53d30f4940c44bcf900a8cf0de91a66d. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:06.004768 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 381) took 9406 ms. Trace:
I20260925 01:50:06.004863 11953 rpcz_store.cc:276] 0925 01:49:56.598105 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.598940 (+ 835us) service_pool.cc:224] Handling call
0925 01:50:05.885538 (+9286598us) ts_tablet_manager.cc:1151] Deleting tablet 0fa7a3941254478c800f9e366e3f7b06
0925 01:50:05.885551 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:05.940979 (+ 55428us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:05.957299 (+ 16320us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.004750 (+ 47451us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9286408}
I20260925 01:50:06.005294 11953 tablet_replica.cc:333] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:06.005520 11953 raft_consensus.cc:2243] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:06.005508 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 0fa7a3941254478c800f9e366e3f7b06 (table default.Table_dfa39c6eba50463f9580070cbfd7f2c9 [id=25512a7f4c4741d4aba6f86f1497dca4]) successfully deleted
I20260925 01:50:06.005823 11953 raft_consensus.cc:2272] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.006203 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet d253f8b1e4ac41388a885178f2ed0f40 with delete_type TABLET_DATA_DELETED (replaced by tablet 92cadafa2a624e08a4d98faf842cfcf0) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.006794 11677 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:06.007143 11953 ts_tablet_manager.cc:1916] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.007218 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet d253f8b1e4ac41388a885178f2ed0f40 with delete_type TABLET_DATA_DELETED (replaced by tablet 92cadafa2a624e08a4d98faf842cfcf0) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.009228 13166 tablet.cc:1751] T 7da55c488da540048a94324fa347c1ef P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:50:06.010253 11753 tablet_bootstrap.cc:492] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.012280 11753 tablet_bootstrap.cc:654] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.013290 11755 tablet_bootstrap.cc:492] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:06.013447 11755 ts_tablet_manager.cc:1403] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.256s user 0.005s sys 0.000s
I20260925 01:50:06.014433 11755 raft_consensus.cc:359] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.014638 11755 raft_consensus.cc:385] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.014709 11755 raft_consensus.cc:740] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.015074 11755 consensus_queue.cc:260] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:06.018143 11314 leader_election.cc:343] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:06.018262 11314 leader_election.cc:304] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.018682 12782 raft_consensus.cc:2749] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:06.019438 11314 leader_election.cc:343] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 17352fd6ea4e4ed9a178f1510edf4f6d
I20260925 01:50:06.019538 11314 leader_election.cc:304] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.019906 12782 raft_consensus.cc:2749] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:06.020568 11314 leader_election.cc:343] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:50:06.020673 11314 leader_election.cc:304] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.021016 12782 raft_consensus.cc:2749] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:06.021458 11314 leader_election.cc:304] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.021744 12782 raft_consensus.cc:2804] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.021855 12782 raft_consensus.cc:697] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:06.022145 12782 consensus_queue.cc:237] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.032440 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 257e6f224f99427eb68fd61fa1aadae0 with delete_type TABLET_DATA_DELETED (replaced by tablet df5dcf3b6d134065be92ec6ea8caffc7) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.036199 12689 ts_tablet_manager.cc:1929] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.037062 12689 log.cc:1199] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/fcb56153a802427aaebbf55a8193d62b
I20260925 01:50:06.037672 12689 ts_tablet_manager.cc:1950] T fcb56153a802427aaebbf55a8193d62b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:06.038857 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet fcb56153a802427aaebbf55a8193d62b (table default.Table_408d8b2c40464a69b5427f4713abff09 [id=ab32966818e7462982dc4ecfb0d662db]) successfully deleted
W20260925 01:50:06.040275 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 6439ba0b0468416d9798a6ac1ee7fddd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6439ba0b0468416d9798a6ac1ee7fddd already in progress: creating tablet
I20260925 01:50:05.910665 11754 ts_tablet_manager.cc:1434] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260925 01:50:06.041702 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 41c58f974b1c4334852b7e17b4da7867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41c58f974b1c4334852b7e17b4da7867 already in progress: creating tablet
W20260925 01:50:06.042630 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b0e27b81d39240efa5136ed668822d35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0e27b81d39240efa5136ed668822d35 already in progress: creating tablet
I20260925 01:50:06.043125 12689 tablet_replica.cc:333] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:06.043383 11754 tablet_bootstrap.cc:492] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.046825 11753 tablet_bootstrap.cc:492] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.050240 11753 ts_tablet_manager.cc:1403] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.001s
I20260925 01:50:06.050760 11754 tablet_bootstrap.cc:654] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.051092 11753 raft_consensus.cc:359] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.054363 11753 raft_consensus.cc:385] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.057056 11753 raft_consensus.cc:740] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.054261 11946 ts_tablet_manager.cc:1929] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.057456 11946 log.cc:1199] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a8c46e780d4a4987ad52619e4c3b46c9
I20260925 01:50:06.057893 11946 ts_tablet_manager.cc:1950] T a8c46e780d4a4987ad52619e4c3b46c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.058785 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_22675d05bfd1432b9c80db3a21a31625"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.059434 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dec4d5d1dd154b1e89b802e5587f1dbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.059619 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22675d05bfd1432b9c80db3a21a31625 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:06.059962 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dec4d5d1dd154b1e89b802e5587f1dbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.058128 11753 consensus_queue.cc:260] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.061753 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 607) took 3845 ms. Trace:
I20260925 01:50:06.061884 11946 rpcz_store.cc:276] 0925 01:50:02.215953 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.216018 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:05.893547 (+3677529us) ts_tablet_manager.cc:1151] Deleting tablet a8c46e780d4a4987ad52619e4c3b46c9
0925 01:50:05.893559 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.021401 (+127842us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.054191 (+ 32790us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.061731 (+ 7540us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3979,"tablet-delete.queue_time_us":3677326}
I20260925 01:50:06.065793 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a8c46e780d4a4987ad52619e4c3b46c9 (table default.Table_e973513b7c3d4c1dadf184056a92dad5 [id=a60aa9bcded3478f908ca2bdaafd1e41]) successfully deleted
I20260925 01:50:06.066308 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 621) took 3434 ms. Trace:
I20260925 01:50:06.066681 11946 rpcz_store.cc:276] 0925 01:50:02.631951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.632125 (+ 174us) service_pool.cc:224] Handling call
0925 01:50:06.066170 (+3434045us) ts_tablet_manager.cc:1151] Deleting tablet 501f41a3ee1d440bb07033e29c38bc7a
0925 01:50:06.066179 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.066288 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3425073}
W20260925 01:50:06.067425 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 501f41a3ee1d440bb07033e29c38bc7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 501f41a3ee1d440bb07033e29c38bc7a already in progress: creating tablet
I20260925 01:50:06.062502 11753 ts_tablet_manager.cc:1434] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260925 01:50:06.061564 13172 tablet.cc:1751] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:06.067968 11753 tablet_bootstrap.cc:492] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.071235 11753 tablet_bootstrap.cc:654] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.069340 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 622) took 3437 ms. Trace:
I20260925 01:50:06.072443 11946 rpcz_store.cc:276] 0925 01:50:02.632079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.642655 (+ 10576us) service_pool.cc:224] Handling call
0925 01:50:06.069227 (+3426572us) ts_tablet_manager.cc:1151] Deleting tablet bd594870fa6a4ba190a18a48d821d72c
0925 01:50:06.069236 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.069322 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3426366}
I20260925 01:50:06.072844 11755 ts_tablet_manager.cc:1434] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.059s user 0.001s sys 0.001s
I20260925 01:50:06.072896 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 623) took 3429 ms. Trace:
I20260925 01:50:06.073091 11946 rpcz_store.cc:276] 0925 01:50:02.643089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.643343 (+ 254us) service_pool.cc:224] Handling call
0925 01:50:06.072785 (+3429442us) ts_tablet_manager.cc:1151] Deleting tablet bf8bd1bfa4db4706b545829d6d26b660
0925 01:50:06.072794 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.072879 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3429282}
W20260925 01:50:06.073200 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bd594870fa6a4ba190a18a48d821d72c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd594870fa6a4ba190a18a48d821d72c already in progress: creating tablet
I20260925 01:50:06.073233 11755 tablet_bootstrap.cc:492] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:06.073652 11946 tablet_replica.cc:333] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:06.073868 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bf8bd1bfa4db4706b545829d6d26b660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf8bd1bfa4db4706b545829d6d26b660 already in progress: creating tablet
I20260925 01:50:06.074103 11946 raft_consensus.cc:2243] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:06.074718 11946 pending_rounds.cc:70] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:06.075489 11755 tablet_bootstrap.cc:654] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:06.077072 11314 consensus_peers.cc:597] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 784de8c6e6e1434a91106dd19cd9262a. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:06.080703 12689 raft_consensus.cc:2243] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:06.081293 12689 pending_rounds.cc:70] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:06.081355 12689 pending_rounds.cc:77] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072920478736384 op_type: NO_OP noop_request { }
I20260925 01:50:06.081471 12689 raft_consensus.cc:2889] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:06.081578 12689 raft_consensus.cc:2272] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.078114 13171 tablet.cc:1751] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:50:06.085139 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f37b8469a497ba3fe504cb21105d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:06.087893 11946 pending_rounds.cc:77] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072915831410688 op_type: NO_OP noop_request { }
I20260925 01:50:06.088462 11946 raft_consensus.cc:2889] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:06.088896 11946 raft_consensus.cc:2272] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.093547 12689 ts_tablet_manager.cc:1916] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.093940 11946 ts_tablet_manager.cc:1916] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.095435 11953 ts_tablet_manager.cc:1929] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:06.095659 11953 log.cc:1199] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/3c5021ab79dc4eaf9ed612f7125a6dca
I20260925 01:50:06.096167 11953 ts_tablet_manager.cc:1950] T 3c5021ab79dc4eaf9ed612f7125a6dca P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:06.096535 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 384) took 9332 ms. Trace:
I20260925 01:50:06.096668 11953 rpcz_store.cc:276] 0925 01:49:56.764191 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.764251 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:06.005245 (+9240994us) ts_tablet_manager.cc:1151] Deleting tablet 3c5021ab79dc4eaf9ed612f7125a6dca
0925 01:50:06.005255 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.019454 (+ 14199us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.095370 (+ 75916us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.096519 (+ 1149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9173121}
I20260925 01:50:06.097146 11953 tablet_replica.cc:333] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:06.097391 11953 raft_consensus.cc:2243] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:06.097359 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 3c5021ab79dc4eaf9ed612f7125a6dca (table default.Table_17cf387aca9e4b949195e91a5101157e [id=2b2ff147f85b437fb7bc6a9f3ddd70d6]) successfully deleted
I20260925 01:50:06.097878 11953 raft_consensus.cc:2272] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.105796 11754 tablet_bootstrap.cc:492] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.106076 11754 ts_tablet_manager.cc:1403] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.000s
I20260925 01:50:06.106894 11754 raft_consensus.cc:359] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.109916 11754 raft_consensus.cc:385] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.110451 11754 raft_consensus.cc:740] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.111614 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 5ef093a4a1134407ba94207137ce3e81 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:06.111250 11754 consensus_queue.cc:260] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.115468 11754 ts_tablet_manager.cc:1434] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260925 01:50:06.117363 11754 tablet_bootstrap.cc:492] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.118513 11953 ts_tablet_manager.cc:1916] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.126808 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f272b10ac9224db48f3c16d93a0ea84e" } new_table_name: "default.Table_920a1f0630944775bfdfcd94c318a3f3" modify_external_catalogs: true
I20260925 01:50:06.126895 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_69e8886705ed402ebb51426039c18caf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.127633 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69e8886705ed402ebb51426039c18caf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.111795 11340 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 236) took 1042 ms. Trace:
I20260925 01:50:06.130187 11340 rpcz_store.cc:276] 0925 01:50:05.069489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.083430 (+ 13941us) service_pool.cc:224] Handling call
0925 01:50:05.894608 (+811178us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x6160001b3454. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:50:06.111769 (+217161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25018752}
I20260925 01:50:06.133802 12947 raft_consensus.cc:493] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.133983 12947 raft_consensus.cc:515] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.134724 12947 leader_election.cc:290] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.138447 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_af127cdb830b4a768749a38a1651365c" } modify_external_catalogs: true
I20260925 01:50:06.138698 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_af127cdb830b4a768749a38a1651365c" } modify_external_catalogs: true
I20260925 01:50:06.139834 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_79a1a30d8d93482aa7135607c46b5b7e" } modify_external_catalogs: true
I20260925 01:50:06.140054 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_79a1a30d8d93482aa7135607c46b5b7e" } modify_external_catalogs: true
I20260925 01:50:06.140858 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff85bac0d22416987e8e3b379154b09" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.141062 11516 raft_consensus.cc:2468] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
W20260925 01:50:06.142694 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a4219ce09e54d268c55c19f7b5cbc7d consensus state has no leader
I20260925 01:50:06.144742 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1a4908e115b54320999343cc2a52f8b7" } new_table_name: "default.Table_d10a845bf44e48a091bfd078a1a436d7" modify_external_catalogs: true
I20260925 01:50:06.144862 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3a09c19d055e4424be5eb589bf3b541a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.145021 11754 tablet_bootstrap.cc:654] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:06.145530 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a09c19d055e4424be5eb589bf3b541a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.147313 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6985e5ccae48472cbdb3cb8d3b387f4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.147955 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6985e5ccae48472cbdb3cb8d3b387f4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.148898 12689 ts_tablet_manager.cc:1929] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.150027 12689 log.cc:1199] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/95ac080782664fca8661c188ab822e89
I20260925 01:50:06.154384 11946 ts_tablet_manager.cc:1929] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.155010 11753 tablet_bootstrap.cc:492] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.155215 11753 ts_tablet_manager.cc:1403] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.008s
I20260925 01:50:06.155273 11946 log.cc:1199] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/53d30f4940c44bcf900a8cf0de91a66d
I20260925 01:50:06.158475 11753 raft_consensus.cc:359] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.158764 13162 consensus_queue.cc:1048] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:06.158872 11946 ts_tablet_manager.cc:1950] T 53d30f4940c44bcf900a8cf0de91a66d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.158890 11753 raft_consensus.cc:385] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.159763 11753 raft_consensus.cc:740] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.160041 11753 consensus_queue.cc:260] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.160632 11753 ts_tablet_manager.cc:1434] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260925 01:50:06.161046 11753 tablet_bootstrap.cc:492] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.163690 11753 tablet_bootstrap.cc:654] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.163383 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 624) took 3520 ms. Trace:
I20260925 01:50:06.165357 11946 rpcz_store.cc:276] 0925 01:50:02.643206 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.643537 (+ 331us) service_pool.cc:224] Handling call
0925 01:50:06.073546 (+3430009us) ts_tablet_manager.cc:1151] Deleting tablet 53d30f4940c44bcf900a8cf0de91a66d
0925 01:50:06.073555 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.121740 (+ 48185us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.150649 (+ 28909us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.163270 (+ 12621us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3429888}
I20260925 01:50:06.166045 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 53d30f4940c44bcf900a8cf0de91a66d (table default.Table_fd114e03807f4a78964e4057de720bfa [id=a2353cff823048a2bfedf7ef1c58975b]) successfully deleted
I20260925 01:50:06.169246 11946 tablet_replica.cc:333] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.169533 11946 raft_consensus.cc:2243] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.170423 11946 raft_consensus.cc:2272] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.171061 11946 ts_tablet_manager.cc:1916] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:06.175156 11314 leader_election.cc:343] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 6ff85bac0d22416987e8e3b379154b09
I20260925 01:50:06.175750 11314 leader_election.cc:304] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.176333 12782 raft_consensus.cc:2804] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.176525 12782 raft_consensus.cc:493] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 01:50:06.176692 11457 consensus_peers.cc:597] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:06.176762 12782 raft_consensus.cc:3060] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.177209 11754 tablet_bootstrap.cc:492] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.177584 11754 ts_tablet_manager.cc:1403] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.003s
I20260925 01:50:06.179339 11754 raft_consensus.cc:359] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.179787 11754 raft_consensus.cc:385] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.179991 11754 raft_consensus.cc:740] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.180754 11754 consensus_queue.cc:260] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.183976 12782 raft_consensus.cc:515] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.183023 11946 ts_tablet_manager.cc:1929] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.185374 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_31382de7dc454cf59b1075bd3d55ac9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.185804 11946 log.cc:1199] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c28c8f00a8634ef89e4773b62e095b74
I20260925 01:50:06.186273 11946 ts_tablet_manager.cc:1950] T c28c8f00a8634ef89e4773b62e095b74 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:06.186187 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31382de7dc454cf59b1075bd3d55ac9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.186626 11754 ts_tablet_manager.cc:1434] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260925 01:50:06.187600 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 625) took 3544 ms. Trace:
I20260925 01:50:06.188369 11754 tablet_bootstrap.cc:492] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.188459 11753 tablet_bootstrap.cc:492] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.188607 11753 ts_tablet_manager.cc:1403] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.007s
I20260925 01:50:06.189522 11753 raft_consensus.cc:359] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.189781 11753 raft_consensus.cc:385] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.191210 11753 raft_consensus.cc:740] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.191610 11753 consensus_queue.cc:260] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.192247 11753 ts_tablet_manager.cc:1434] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:06.192564 11753 tablet_bootstrap.cc:492] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.194455 11946 rpcz_store.cc:276] 0925 01:50:02.643299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.655788 (+ 12489us) service_pool.cc:224] Handling call
0925 01:50:06.169183 (+3513395us) ts_tablet_manager.cc:1151] Deleting tablet c28c8f00a8634ef89e4773b62e095b74
0925 01:50:06.169194 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.177312 (+ 8118us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.182966 (+ 5654us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.187581 (+ 4615us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3513200}
I20260925 01:50:06.195395 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c28c8f00a8634ef89e4773b62e095b74 (table default.Table_6a8f6bbf5d5d430f89f28a60bf15e379 [id=bb36d144a12e4176974ca7119a4681c3]) successfully deleted
I20260925 01:50:06.195704 11754 tablet_bootstrap.cc:654] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.196102 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 626) took 3539 ms. Trace:
W20260925 01:50:06.196156 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c4f1e725fe84552943563aa95687842 consensus state has no leader
I20260925 01:50:06.196580 11946 rpcz_store.cc:276] 0925 01:50:02.656187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.658021 (+ 1834us) service_pool.cc:224] Handling call
0925 01:50:06.195964 (+3537943us) ts_tablet_manager.cc:1151] Deleting tablet bd22b1eb643f4229a65566493e21d96c
0925 01:50:06.195973 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.196084 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3537757}
W20260925 01:50:06.197238 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bd22b1eb643f4229a65566493e21d96c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd22b1eb643f4229a65566493e21d96c already in progress: creating tablet
I20260925 01:50:06.197618 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 627) took 3539 ms. Trace:
I20260925 01:50:06.197686 11946 rpcz_store.cc:276] 0925 01:50:02.658441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.658750 (+ 309us) service_pool.cc:224] Handling call
0925 01:50:06.197502 (+3538752us) ts_tablet_manager.cc:1151] Deleting tablet 98a94b6345ca427180e8f4e4b279efcf
0925 01:50:06.197511 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.197603 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3538613}
W20260925 01:50:06.198122 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 98a94b6345ca427180e8f4e4b279efcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98a94b6345ca427180e8f4e4b279efcf already in progress: creating tablet
I20260925 01:50:06.199009 11753 tablet_bootstrap.cc:654] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.199064 11672 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 92cadafa2a624e08a4d98faf842cfcf0
I20260925 01:50:06.199496 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6554cdebbe834c79b745a3509dfd52ca" } modify_external_catalogs: true
I20260925 01:50:06.199354 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 639) took 3232 ms. Trace:
I20260925 01:50:06.199791 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6554cdebbe834c79b745a3509dfd52ca" } modify_external_catalogs: true
I20260925 01:50:06.199923 11946 rpcz_store.cc:276] 0925 01:50:02.967380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.973378 (+ 5998us) service_pool.cc:224] Handling call
0925 01:50:06.199233 (+3225855us) ts_tablet_manager.cc:1151] Deleting tablet 1575d0eb9ed64653b317edefd24f7dfd
0925 01:50:06.199242 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.199336 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3225648}
W20260925 01:50:06.200712 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1575d0eb9ed64653b317edefd24f7dfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1575d0eb9ed64653b317edefd24f7dfd already in progress: creating tablet
I20260925 01:50:06.201184 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a1c3833ec39641b5bc0225f22def98c9" } new_table_name: "default.Table_7e712547f2e04932ac7d5263ba66daba" modify_external_catalogs: true
I20260925 01:50:06.201617 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 640) took 3221 ms. Trace:
I20260925 01:50:06.201736 11946 rpcz_store.cc:276] 0925 01:50:02.980433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.980482 (+ 49us) service_pool.cc:224] Handling call
0925 01:50:06.201514 (+3221032us) ts_tablet_manager.cc:1151] Deleting tablet 7a5c9dac783d4ef3a24cb65275ff484f
0925 01:50:06.201523 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.201601 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3220857}
W20260925 01:50:06.202368 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7a5c9dac783d4ef3a24cb65275ff484f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a5c9dac783d4ef3a24cb65275ff484f already in progress: creating tablet
I20260925 01:50:06.203281 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 638) took 3236 ms. Trace:
I20260925 01:50:06.203440 12689 ts_tablet_manager.cc:1950] T 95ac080782664fca8661c188ab822e89 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:06.203400 11946 rpcz_store.cc:276] 0925 01:50:02.967245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.998095 (+ 30850us) service_pool.cc:224] Handling call
0925 01:50:06.203100 (+3205005us) ts_tablet_manager.cc:1151] Deleting tablet 0c01195f07b84b359a974fab5ed52582
0925 01:50:06.203108 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.203268 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3204787}
W20260925 01:50:06.204097 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 0c01195f07b84b359a974fab5ed52582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c01195f07b84b359a974fab5ed52582 already in progress: creating tablet
I20260925 01:50:06.204486 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 642) took 3196 ms. Trace:
I20260925 01:50:06.204628 11946 rpcz_store.cc:276] 0925 01:50:03.007703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.008072 (+ 369us) service_pool.cc:224] Handling call
0925 01:50:06.204375 (+3196303us) ts_tablet_manager.cc:1151] Deleting tablet 018f68f800c9489a846c3b1b3ee3fa2d
0925 01:50:06.204383 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.204468 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3169913}
W20260925 01:50:06.205379 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 018f68f800c9489a846c3b1b3ee3fa2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018f68f800c9489a846c3b1b3ee3fa2d already in progress: creating tablet
I20260925 01:50:06.205884 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_69442eece38448df85a566c510504769" } new_table_name: "default.Table_fbec59b2447b4db3bcb49c05c2d6921d" modify_external_catalogs: true
I20260925 01:50:06.206634 11946 tablet_replica.cc:333] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.206861 11946 raft_consensus.cc:2243] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.207053 11946 raft_consensus.cc:2272] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.207580 11946 ts_tablet_manager.cc:1916] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.208355 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 95ac080782664fca8661c188ab822e89 (table default.Table_40519dcfbe2e470ca48f0351bf0ea7cd [id=9bdac40ff34c4ea8aa4fa8da91357cbf]) successfully deleted
I20260925 01:50:06.208447 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0d0d9ed21e9a4d94a35dffea244c87a8" } new_table_name: "default.Table_0ce57c47f5db4f6da04a799567d656fe" modify_external_catalogs: true
W20260925 01:50:06.210361 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 38603da7b4b14ce5835646c330b1f0ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38603da7b4b14ce5835646c330b1f0ce already in progress: creating tablet
W20260925 01:50:06.212358 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 06fca09010f841c5a7b58678560065f3 because the tablet was not found. No further retry: Not found: Tablet not found: 06fca09010f841c5a7b58678560065f3
I20260925 01:50:06.217948 12782 leader_election.cc:290] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.218719 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ff85bac0d22416987e8e3b379154b09" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:06.219065 11946 ts_tablet_manager.cc:1929] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.219110 12689 tablet_replica.cc:333] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
W20260925 01:50:06.219556 11314 leader_election.cc:343] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 6ff85bac0d22416987e8e3b379154b09
W20260925 01:50:06.219863 11314 leader_election.cc:343] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:06.220006 11314 leader_election.cc:304] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.220649 11753 tablet_bootstrap.cc:492] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.220887 11753 ts_tablet_manager.cc:1403] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.004s
I20260925 01:50:06.221673 11754 tablet_bootstrap.cc:492] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.221968 11754 ts_tablet_manager.cc:1403] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.000s
I20260925 01:50:06.222308 11753 raft_consensus.cc:359] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.222707 12782 raft_consensus.cc:2749] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:06.222544 11753 raft_consensus.cc:385] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.222960 11753 raft_consensus.cc:740] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.223264 11753 consensus_queue.cc:260] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.223469 11754 raft_consensus.cc:359] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.223837 11754 raft_consensus.cc:385] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.223930 11753 ts_tablet_manager.cc:1434] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:06.224179 11753 tablet_bootstrap.cc:492] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.224061 11754 raft_consensus.cc:740] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.225585 11754 consensus_queue.cc:260] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.226133 11753 tablet_bootstrap.cc:654] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.220274 12689 raft_consensus.cc:2243] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:06.227296 12689 pending_rounds.cc:70] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:06.227171 11946 log.cc:1199] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/6ff85bac0d22416987e8e3b379154b09
I20260925 01:50:06.227273 11754 ts_tablet_manager.cc:1434] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:06.227437 12689 pending_rounds.cc:77] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072917985075200 op_type: NO_OP noop_request { }
I20260925 01:50:06.227881 11946 ts_tablet_manager.cc:1950] T 6ff85bac0d22416987e8e3b379154b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.227933 12689 raft_consensus.cc:2889] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:06.228778 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 643) took 3207 ms. Trace:
I20260925 01:50:06.228433 12689 raft_consensus.cc:2272] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.228919 11754 tablet_bootstrap.cc:492] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.228952 11946 rpcz_store.cc:276] 0925 01:50:03.021290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.034506 (+ 13216us) service_pool.cc:224] Handling call
0925 01:50:06.206592 (+3172086us) ts_tablet_manager.cc:1151] Deleting tablet 6ff85bac0d22416987e8e3b379154b09
0925 01:50:06.206601 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.211012 (+ 4411us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.219008 (+ 7996us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.228755 (+ 9747us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3163737}
I20260925 01:50:06.229053 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7d5f8540137149d6ac35dd7be073315f" } modify_external_catalogs: true
I20260925 01:50:06.229238 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7d5f8540137149d6ac35dd7be073315f" } modify_external_catalogs: true
I20260925 01:50:06.229606 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 6ff85bac0d22416987e8e3b379154b09 (table default.Table_1cdf240ece4148e88d0b728903d255df [id=6ea8e28751c84e1181aa299006fa643f]) successfully deleted
I20260925 01:50:06.230086 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 648) took 2780 ms. Trace:
I20260925 01:50:06.230216 11946 rpcz_store.cc:276] 0925 01:50:03.449519 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.449852 (+ 333us) service_pool.cc:224] Handling call
0925 01:50:06.229927 (+2780075us) ts_tablet_manager.cc:1151] Deleting tablet ea10c9a7e20b48c69eb5f24631403e93
0925 01:50:06.229937 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.230040 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2779822}
W20260925 01:50:06.230738 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ea10c9a7e20b48c69eb5f24631403e93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea10c9a7e20b48c69eb5f24631403e93 already in progress: creating tablet
I20260925 01:50:06.231081 11946 tablet_replica.cc:333] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.231310 11946 raft_consensus.cc:2243] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.231498 11946 raft_consensus.cc:2272] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.232035 11946 ts_tablet_manager.cc:1916] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.232962 12689 ts_tablet_manager.cc:1916] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.236363 11754 tablet_bootstrap.cc:654] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.241910 11753 tablet_bootstrap.cc:492] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.242175 11753 ts_tablet_manager.cc:1403] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.005s
I20260925 01:50:06.242750 13162 raft_consensus.cc:493] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.242875 13162 raft_consensus.cc:515] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.243459 13162 leader_election.cc:290] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.244117 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:06.244410 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:06.244638 11457 leader_election.cc:343] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:06.245054 11456 leader_election.cc:343] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.245169 11456 leader_election.cc:304] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.245517 13149 raft_consensus.cc:2749] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:06.246294 11753 raft_consensus.cc:359] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:06.246522 11753 raft_consensus.cc:385] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.246652 11753 raft_consensus.cc:740] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.247085 11753 consensus_queue.cc:260] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:06.247663 11753 ts_tablet_manager.cc:1434] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:06.248458 11753 tablet_bootstrap.cc:492] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:06.249439 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e52692f8a09c44b4b8c13a9a388c2094 consensus state has no leader
I20260925 01:50:06.250031 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_32d3c6acd9044e7ea09f6dfae4086ed1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.251076 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32d3c6acd9044e7ea09f6dfae4086ed1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.252332 11754 tablet_bootstrap.cc:492] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.252684 11754 ts_tablet_manager.cc:1403] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.003s
I20260925 01:50:06.253944 11753 tablet_bootstrap.cc:654] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.254205 11754 raft_consensus.cc:359] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.254612 11754 raft_consensus.cc:385] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.254786 11754 raft_consensus.cc:740] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.255345 11754 consensus_queue.cc:260] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.256613 12689 ts_tablet_manager.cc:1929] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.257099 12689 log.cc:1199] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:06.257052 11754 ts_tablet_manager.cc:1434] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:06.258477 11754 tablet_bootstrap.cc:492] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.258849 12689 ts_tablet_manager.cc:1950] T d7f97ead49634bf6b03e292544af4d07 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:06.260607 11946 ts_tablet_manager.cc:1929] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.260713 11946 log.cc:1199] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/24cd89d238bf4220a48ecdf59cca5e6d
I20260925 01:50:06.260977 11946 ts_tablet_manager.cc:1950] T 24cd89d238bf4220a48ecdf59cca5e6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.261829 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 649) took 2790 ms. Trace:
I20260925 01:50:06.261955 11946 rpcz_store.cc:276] 0925 01:50:03.471714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.472312 (+ 598us) service_pool.cc:224] Handling call
0925 01:50:06.231034 (+2758722us) ts_tablet_manager.cc:1151] Deleting tablet 24cd89d238bf4220a48ecdf59cca5e6d
0925 01:50:06.231043 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.235828 (+ 4785us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.260557 (+ 24729us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.261810 (+ 1253us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2758528}
I20260925 01:50:06.262516 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 24cd89d238bf4220a48ecdf59cca5e6d (table default.Table_9704bbf8ddbe4f129bccb5a8e30be536 [id=462de86042324bc49bf8949a13d0fec2]) successfully deleted
I20260925 01:50:06.262866 11946 tablet_replica.cc:333] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.263072 11946 raft_consensus.cc:2243] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.263239 11946 raft_consensus.cc:2272] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.263376 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet d7f97ead49634bf6b03e292544af4d07 (table default.Table_0e71b8f12efa4591b712a486be4752b9 [id=a0cfa508705d43c0b763a35cf3b1f3c4]) successfully deleted
I20260925 01:50:06.264196 12689 tablet_replica.cc:333] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:06.264463 11946 ts_tablet_manager.cc:1916] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.265182 12689 raft_consensus.cc:2243] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:06.266539 12689 pending_rounds.cc:70] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:06.266844 11754 tablet_bootstrap.cc:654] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.266757 12689 pending_rounds.cc:77] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072918913302528 op_type: NO_OP noop_request { }
W20260925 01:50:06.267133 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e42dc54d78bb4a6b9b870543b6f1bc0d has no consensus state
I20260925 01:50:06.267284 12689 raft_consensus.cc:2889] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:06.267669 12689 raft_consensus.cc:2272] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.268332 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_25da9be7f25c439ea91214ed02f5bd2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.269505 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25da9be7f25c439ea91214ed02f5bd2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.270015 12689 ts_tablet_manager.cc:1916] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.267730 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_853886350ca941199d022640a1251fd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.271797 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_853886350ca941199d022640a1251fd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.275842 11946 ts_tablet_manager.cc:1929] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.277050 11946 log.cc:1199] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8c1abd3c2cb34915a595ea73a8d10743
I20260925 01:50:06.277585 11946 ts_tablet_manager.cc:1950] T 8c1abd3c2cb34915a595ea73a8d10743 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.279904 11953 ts_tablet_manager.cc:1929] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:06.279953 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 650) took 2807 ms. Trace:
I20260925 01:50:06.280098 11953 log.cc:1199] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c4eb584e929c46f891d28ad01e6d78ae
I20260925 01:50:06.280663 11953 ts_tablet_manager.cc:1950] T c4eb584e929c46f891d28ad01e6d78ae P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:06.280861 11946 rpcz_store.cc:276] 0925 01:50:03.472312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.472872 (+ 560us) service_pool.cc:224] Handling call
0925 01:50:06.262820 (+2789948us) ts_tablet_manager.cc:1151] Deleting tablet 8c1abd3c2cb34915a595ea73a8d10743
0925 01:50:06.262829 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.267720 (+ 4891us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.275795 (+ 8075us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.279930 (+ 4135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2789785}
I20260925 01:50:06.281709 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 386) took 9477 ms. Trace:
I20260925 01:50:06.281747 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8c1abd3c2cb34915a595ea73a8d10743 (table default.Table_5036ab1f1580484c8b9367dfab1a8a84 [id=a7cc09b27b1b463a982f1f4266bdf7fd]) successfully deleted
I20260925 01:50:06.281832 11953 rpcz_store.cc:276] 0925 01:49:56.804367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.804629 (+ 262us) service_pool.cc:224] Handling call
0925 01:50:06.097090 (+9292461us) ts_tablet_manager.cc:1151] Deleting tablet c4eb584e929c46f891d28ad01e6d78ae
0925 01:50:06.097100 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.121893 (+ 24793us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.279838 (+157945us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.281685 (+ 1847us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9264569}
I20260925 01:50:06.282239 11946 tablet_replica.cc:333] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.282291 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 385) took 9517 ms. Trace:
I20260925 01:50:06.282401 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c4eb584e929c46f891d28ad01e6d78ae (table default.Table_5986aa81fd204416899fc953566bd2ba [id=cde938f51c1d4ea8a32a3f9b684c510b]) successfully deleted
I20260925 01:50:06.282528 11953 rpcz_store.cc:276] 0925 01:49:56.764390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:56.764454 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:06.282150 (+9517696us) ts_tablet_manager.cc:1151] Deleting tablet a86ac7e553854304ba7b3b1d38c86c53
0925 01:50:06.282160 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.282272 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9370136}
I20260925 01:50:06.282864 11946 raft_consensus.cc:2243] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.282941 11953 tablet_replica.cc:333] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:06.283162 11953 raft_consensus.cc:2243] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.283305 11946 raft_consensus.cc:2272] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:06.283550 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a86ac7e553854304ba7b3b1d38c86c53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a86ac7e553854304ba7b3b1d38c86c53 already in progress: creating tablet
I20260925 01:50:06.284162 11946 ts_tablet_manager.cc:1916] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.286230 11953 raft_consensus.cc:2272] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.292471 12689 ts_tablet_manager.cc:1929] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.293035 12689 log.cc:1199] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/c7944aa1ac8f4c5d8ea3aa2acae41257
I20260925 01:50:06.294848 12689 ts_tablet_manager.cc:1950] T c7944aa1ac8f4c5d8ea3aa2acae41257 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:06.296669 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet c7944aa1ac8f4c5d8ea3aa2acae41257 (table default.Table_467dcbd96d384165bd59850e07759dae [id=454ea19fdacb465b93f5761ffcdf4ff2]) successfully deleted
W20260925 01:50:06.298623 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 7ad519d103e644e1b78ce540d623cbcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ad519d103e644e1b78ce540d623cbcb already in progress: creating tablet
W20260925 01:50:06.300086 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f1e89d9f87104c768839104c80614f5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1e89d9f87104c768839104c80614f5e already in progress: creating tablet
I20260925 01:50:06.302459 12689 tablet_replica.cc:333] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:06.303731 12689 raft_consensus.cc:2243] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.304522 12689 raft_consensus.cc:2272] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.306694 13172 tablet.cc:1751] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:06.306962 11953 ts_tablet_manager.cc:1916] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.308112 13173 tablet.cc:1751] T e26b1dc65fc84629a72029519919ae23 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:06.313097 12689 ts_tablet_manager.cc:1916] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.319630 11754 tablet_bootstrap.cc:492] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.319737 12782 raft_consensus.cc:493] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.319983 12782 raft_consensus.cc:515] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.319972 11754 ts_tablet_manager.cc:1403] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.009s
I20260925 01:50:06.320756 12782 leader_election.cc:290] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.321638 11754 raft_consensus.cc:359] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.322046 11754 raft_consensus.cc:385] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.322265 11754 raft_consensus.cc:740] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:50:06.322418 11314 leader_election.cc:343] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 19c718c83cfe49b9a745e06314e24409
I20260925 01:50:06.322679 11754 consensus_queue.cc:260] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:06.323050 11314 leader_election.cc:343] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 19c718c83cfe49b9a745e06314e24409
I20260925 01:50:06.323172 11314 leader_election.cc:304] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.323413 12782 raft_consensus.cc:2749] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:06.324432 11754 ts_tablet_manager.cc:1434] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:06.331513 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a7a72b74c92b448598d04690c8785cfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.332332 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7a72b74c92b448598d04690c8785cfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.333685 12689 ts_tablet_manager.cc:1929] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.333928 12689 log.cc:1199] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/770ebdbd355142ba86fd9eb8eaa844f4
I20260925 01:50:06.334712 12689 ts_tablet_manager.cc:1950] T 770ebdbd355142ba86fd9eb8eaa844f4 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:06.338231 11754 tablet_bootstrap.cc:492] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.339751 11754 tablet_bootstrap.cc:654] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.339969 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_802f781d29a44950921e75c254835e2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.340544 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_802f781d29a44950921e75c254835e2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.341061 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet 811b957c4e6647ccaa688d7273ec9eeb from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:06.342383 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c85d24f369ed472bb3f0817e03b0eb7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.343353 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c85d24f369ed472bb3f0817e03b0eb7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.350214 11946 ts_tablet_manager.cc:1929] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.350353 11946 log.cc:1199] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8152c9e0b0af4ab2a18c5a0080e22ffc
I20260925 01:50:06.350816 11946 ts_tablet_manager.cc:1950] T 8152c9e0b0af4ab2a18c5a0080e22ffc P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.351171 11754 tablet_bootstrap.cc:492] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.351366 11754 ts_tablet_manager.cc:1403] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260925 01:50:06.352319 11754 raft_consensus.cc:359] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.352553 11754 raft_consensus.cc:385] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.352643 11754 raft_consensus.cc:740] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.352900 11754 consensus_queue.cc:260] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.353585 11754 ts_tablet_manager.cc:1434] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:06.354553 11754 tablet_bootstrap.cc:492] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.354553 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 651) took 2881 ms. Trace:
I20260925 01:50:06.354676 11946 rpcz_store.cc:276] 0925 01:50:03.472858 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.473174 (+ 316us) service_pool.cc:224] Handling call
0925 01:50:06.282193 (+2809019us) ts_tablet_manager.cc:1151] Deleting tablet 8152c9e0b0af4ab2a18c5a0080e22ffc
0925 01:50:06.282202 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.291281 (+ 9079us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.350137 (+ 58856us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.354531 (+ 4394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2808902}
I20260925 01:50:06.355146 11946 tablet_replica.cc:333] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.355330 11946 raft_consensus.cc:2243] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.355487 11946 raft_consensus.cc:2272] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.356472 11946 ts_tablet_manager.cc:1916] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.356660 11754 tablet_bootstrap.cc:654] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.360291 11953 ts_tablet_manager.cc:1929] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.360487 11953 log.cc:1199] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/039ee80a2822417898c1d1d779f52867
I20260925 01:50:06.360950 11953 ts_tablet_manager.cc:1950] T 039ee80a2822417898c1d1d779f52867 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:06.361989 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 389) took 9345 ms. Trace:
I20260925 01:50:06.366994 13173 tablet.cc:1751] T f0157a45817246cfaa0b016afdbd59cb P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:50:06.368182 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 770ebdbd355142ba86fd9eb8eaa844f4 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]) successfully deleted
I20260925 01:50:06.366792 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_421b97be134b46779be6e3914d46271c" } new_table_name: "default.Table_bed8402d21684713ae4ef26319f8d2b2" modify_external_catalogs: true
W20260925 01:50:06.369661 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d6b0a7ae71724ba385371d3b772b067c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6b0a7ae71724ba385371d3b772b067c already in progress: creating tablet
W20260925 01:50:06.370553 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet fbd4b231f89a48e59e5eb3cf3976385a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fbd4b231f89a48e59e5eb3cf3976385a already in progress: creating tablet
I20260925 01:50:06.370935 12689 tablet_replica.cc:333] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:06.371297 12689 raft_consensus.cc:2243] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.371542 12689 raft_consensus.cc:2272] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.372371 12689 ts_tablet_manager.cc:1916] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.351796 11753 tablet_bootstrap.cc:492] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.374876 11753 ts_tablet_manager.cc:1403] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.019s
I20260925 01:50:06.376093 11753 raft_consensus.cc:359] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.376459 11753 raft_consensus.cc:385] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.376593 11753 raft_consensus.cc:740] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.376948 11753 consensus_queue.cc:260] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.377938 11753 ts_tablet_manager.cc:1434] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:06.390604 11754 tablet_bootstrap.cc:492] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.390805 11754 ts_tablet_manager.cc:1403] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20260925 01:50:06.391664 11754 raft_consensus.cc:359] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.391847 11754 raft_consensus.cc:385] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.391932 11754 raft_consensus.cc:740] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:50:06.392604 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad0a13f4c9af48aa8b2b18cbb5c00c23 consensus state has no leader
I20260925 01:50:06.393031 11754 consensus_queue.cc:260] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.393702 11754 ts_tablet_manager.cc:1434] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:06.373980 13192 tablet.cc:1751] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:50:06.399318 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5b919c91b3c64811b8fe08b683e9d6e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.400077 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b919c91b3c64811b8fe08b683e9d6e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.408696 11754 tablet_bootstrap.cc:492] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.410518 11754 tablet_bootstrap.cc:654] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.412897 11755 tablet_bootstrap.cc:492] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:06.413044 11755 ts_tablet_manager.cc:1403] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.340s user 0.022s sys 0.001s
I20260925 01:50:06.413785 11755 raft_consensus.cc:359] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.413988 11755 raft_consensus.cc:385] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.414077 11755 raft_consensus.cc:740] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.414335 11755 consensus_queue.cc:260] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.414984 11755 ts_tablet_manager.cc:1434] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:06.415263 11755 tablet_bootstrap.cc:492] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:06.416759 11755 tablet_bootstrap.cc:654] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.417686 11753 tablet_bootstrap.cc:492] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.419744 11753 tablet_bootstrap.cc:654] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.419872 11953 rpcz_store.cc:276] 0925 01:49:57.016053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.016138 (+ 85us) service_pool.cc:224] Handling call
0925 01:50:06.282893 (+9266755us) ts_tablet_manager.cc:1151] Deleting tablet 039ee80a2822417898c1d1d779f52867
0925 01:50:06.282903 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.326758 (+ 43855us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.360223 (+ 33465us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.361964 (+ 1741us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9266323}
I20260925 01:50:06.420538 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 039ee80a2822417898c1d1d779f52867 (table default.Table_de50999ba7d245feb33ce6cd4a90bc03 [id=b011ff7009fc4e419f245e75f8fec10d]) successfully deleted
I20260925 01:50:06.421006 11953 tablet_replica.cc:333] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:06.421301 11953 raft_consensus.cc:2243] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.421530 11953 raft_consensus.cc:2272] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.422190 11953 ts_tablet_manager.cc:1916] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.422189 13140 raft_consensus.cc:493] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.422358 13140 raft_consensus.cc:515] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.423228 13140 leader_election.cc:290] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.424132 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87128b8baef4f9d80341f6980da519d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.425002 11521 raft_consensus.cc:2468] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:06.425474 11176 leader_election.cc:304] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:06.424731 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87128b8baef4f9d80341f6980da519d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:06.426396 11177 leader_election.cc:343] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.426795 13140 raft_consensus.cc:2804] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.426879 13140 raft_consensus.cc:493] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.426960 13140 raft_consensus.cc:3060] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.430336 13140 raft_consensus.cc:515] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.431584 13172 tablet.cc:1751] T f0157a45817246cfaa0b016afdbd59cb P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:50:06.432260 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87128b8baef4f9d80341f6980da519d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:06.434629 11177 leader_election.cc:343] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.439764 13140 leader_election.cc:290] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.439788 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87128b8baef4f9d80341f6980da519d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:06.439992 11516 raft_consensus.cc:3060] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:06.454701 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 70918.7us
I20260925 01:50:06.455298 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:06.457973 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_23c2c72963784e6b91bed0595827abe2" } new_table_name: "default.Table_e10285445830461881be6093e5bc1b9c" modify_external_catalogs: true
I20260925 01:50:06.452756 11516 raft_consensus.cc:2468] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:06.460129 11176 leader_election.cc:304] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.460646 12885 raft_consensus.cc:493] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.460788 12885 raft_consensus.cc:515] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.461549 12885 leader_election.cc:290] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.461695 12885 raft_consensus.cc:2804] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.461797 12885 raft_consensus.cc:697] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:06.462078 12885 consensus_queue.cc:237] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.463966 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8234c4d0c72541158826416e40f34031" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:06.465185 11177 leader_election.cc:343] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.468397 13101 raft_consensus.cc:493] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.468550 13101 raft_consensus.cc:515] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.469168 11946 ts_tablet_manager.cc:1929] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.469193 13101 leader_election.cc:290] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.469281 11946 log.cc:1199] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/257e6f224f99427eb68fd61fa1aadae0
I20260925 01:50:06.469589 11946 ts_tablet_manager.cc:1950] T 257e6f224f99427eb68fd61fa1aadae0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:06.471051 11314 leader_election.cc:343] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 257e6f224f99427eb68fd61fa1aadae0
I20260925 01:50:06.471750 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:06.478703 11953 ts_tablet_manager.cc:1929] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.478891 11953 log.cc:1199] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/331380a2be9a4893927c9b94a2c3e08b
I20260925 01:50:06.479278 11953 ts_tablet_manager.cc:1950] T 331380a2be9a4893927c9b94a2c3e08b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:06.483892 11754 tablet_bootstrap.cc:492] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.484163 11754 ts_tablet_manager.cc:1403] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.076s user 0.006s sys 0.005s
I20260925 01:50:06.484943 11754 raft_consensus.cc:359] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.485128 11754 raft_consensus.cc:385] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.485185 11754 raft_consensus.cc:740] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.485457 11754 consensus_queue.cc:260] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.486284 11754 ts_tablet_manager.cc:1434] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:06.487402 11754 tablet_bootstrap.cc:492] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.470160 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "257e6f224f99427eb68fd61fa1aadae0" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.476569 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8234c4d0c72541158826416e40f34031" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.477700 11753 tablet_bootstrap.cc:492] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:06.488554 11314 leader_election.cc:343] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:06.488684 11314 leader_election.cc:304] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.489096 13101 raft_consensus.cc:2749] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:06.488271 11753 ts_tablet_manager.cc:1403] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.000s
I20260925 01:50:06.488229 11516 raft_consensus.cc:2468] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:06.489926 11176 leader_election.cc:304] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.490278 11753 raft_consensus.cc:359] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.490399 13140 raft_consensus.cc:2804] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.490473 13140 raft_consensus.cc:493] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.490541 13140 raft_consensus.cc:3060] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.493222 13140 raft_consensus.cc:515] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.494297 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8234c4d0c72541158826416e40f34031" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:06.494885 11177 leader_election.cc:343] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.489377 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 390) took 9473 ms. Trace:
I20260925 01:50:06.495196 11953 rpcz_store.cc:276] 0925 01:49:57.016176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.016234 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:06.420949 (+9404715us) ts_tablet_manager.cc:1151] Deleting tablet 331380a2be9a4893927c9b94a2c3e08b
0925 01:50:06.420961 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.429441 (+ 8480us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.478644 (+ 49203us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.489359 (+ 10715us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":399,"tablet-delete.queue_time_us":9404361}
I20260925 01:50:06.495826 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 331380a2be9a4893927c9b94a2c3e08b (table default.Table_695a3148371f44738e7ed17a0f5d2ba1 [id=e59a426273844acdbd1ce81acc4132b5]) successfully deleted
I20260925 01:50:06.496147 13140 leader_election.cc:290] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.496205 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8234c4d0c72541158826416e40f34031" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:06.496376 11521 raft_consensus.cc:3060] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.497640 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 387) took 9487 ms. Trace:
I20260925 01:50:06.497783 11953 rpcz_store.cc:276] 0925 01:49:57.009858 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.017603 (+ 7745us) service_pool.cc:224] Handling call
0925 01:50:06.497045 (+9479442us) ts_tablet_manager.cc:1151] Deleting tablet b4e5d28d466741a0a085a4f9938fffd1
0925 01:50:06.497520 (+ 475us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.497621 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9475117}
W20260925 01:50:06.498391 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b4e5d28d466741a0a085a4f9938fffd1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4e5d28d466741a0a085a4f9938fffd1 already in progress: creating tablet
I20260925 01:50:06.498790 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 402) took 9320 ms. Trace:
I20260925 01:50:06.499002 11953 rpcz_store.cc:276] 0925 01:49:57.178706 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.178783 (+ 77us) service_pool.cc:224] Handling call
0925 01:50:06.498700 (+9319917us) ts_tablet_manager.cc:1151] Deleting tablet b306496f992f45a9b64b05b73712cb5b
0925 01:50:06.498709 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.498775 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9319639}
I20260925 01:50:06.499468 11521 raft_consensus.cc:2468] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:06.499505 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b306496f992f45a9b64b05b73712cb5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b306496f992f45a9b64b05b73712cb5b already in progress: creating tablet
I20260925 01:50:06.499811 11953 tablet_replica.cc:333] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:06.500041 11176 leader_election.cc:304] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.500528 13140 raft_consensus.cc:2804] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.502333 11953 raft_consensus.cc:2243] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:06.502724 11953 raft_consensus.cc:2272] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.503320 11953 ts_tablet_manager.cc:1916] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.488811 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 652) took 3015 ms. Trace:
I20260925 01:50:06.503628 11946 rpcz_store.cc:276] 0925 01:50:03.473370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.473708 (+ 338us) service_pool.cc:224] Handling call
0925 01:50:06.355088 (+2881380us) ts_tablet_manager.cc:1151] Deleting tablet 257e6f224f99427eb68fd61fa1aadae0
0925 01:50:06.355100 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.385586 (+ 30486us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.469107 (+ 83521us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.488792 (+ 19685us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2881246}
I20260925 01:50:06.504192 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 257e6f224f99427eb68fd61fa1aadae0 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]) successfully deleted
I20260925 01:50:06.504300 11946 tablet_replica.cc:333] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.504484 11946 raft_consensus.cc:2243] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.504639 11946 raft_consensus.cc:2272] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.505218 11946 ts_tablet_manager.cc:1916] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.510758 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fbb2f99ff1e94b04ac906f20c094f645" } modify_external_catalogs: true
I20260925 01:50:06.510968 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fbb2f99ff1e94b04ac906f20c094f645" } modify_external_catalogs: true
I20260925 01:50:06.517431 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 519d954b6a214d0b8e960e128cfcea10 (table default.Table_126b13b368c348bea98d7d87748aaf1c [id=3e31f69b151b4dd69a3ac8be6e2bc48d]). Expected version 1 got 0
I20260925 01:50:06.519006 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17] alter complete (version 5)
I20260925 01:50:06.519196 11754 tablet_bootstrap.cc:654] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:06.520076 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e90b7aae9cc41a3a795f601e784d34c consensus state has no leader
I20260925 01:50:06.520780 11221 tablet_service.cc:1511] Processing CreateTablet for tablet b3efeab722734837a8930b3db62039e3 (DEFAULT_TABLE table=default.Table_d4944bbe1b814196b7692b4ce51d11a1 [id=66a135f06c804f3ea2d019ec08608445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.521159 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3efeab722734837a8930b3db62039e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.522307 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 47e533afa7f147339393cc952bc1a16a (DEFAULT_TABLE table=default.Table_4ce55b42ce4e4e239d303411e27c68dd [id=169d5ec1bd014013a72ced907e820da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.522660 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e533afa7f147339393cc952bc1a16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.525266 11755 tablet_bootstrap.cc:492] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:06.525388 11755 ts_tablet_manager.cc:1403] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.110s user 0.009s sys 0.004s
I20260925 01:50:06.525710 11494 tablet_service.cc:1511] Processing CreateTablet for tablet b3efeab722734837a8930b3db62039e3 (DEFAULT_TABLE table=default.Table_d4944bbe1b814196b7692b4ce51d11a1 [id=66a135f06c804f3ea2d019ec08608445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.526109 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3efeab722734837a8930b3db62039e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.526043 11755 raft_consensus.cc:359] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.526230 11755 raft_consensus.cc:385] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.526276 11755 raft_consensus.cc:740] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.526523 11755 consensus_queue.cc:260] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.527089 11755 ts_tablet_manager.cc:1434] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:06.529922 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e151170fc7c54353aef81e4be2335941"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.530316 11755 tablet_bootstrap.cc:492] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:50:06.530594 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e151170fc7c54353aef81e4be2335941 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.531684 11755 tablet_bootstrap.cc:654] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.538849 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2515048189c844839baa558b149e5b60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.539503 11754 tablet_bootstrap.cc:492] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
W20260925 01:50:06.539484 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2515048189c844839baa558b149e5b60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.539628 11754 ts_tablet_manager.cc:1403] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260925 01:50:06.541193 11754 raft_consensus.cc:359] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.541350 11754 raft_consensus.cc:385] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.541400 11754 raft_consensus.cc:740] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.530009 11953 ts_tablet_manager.cc:1929] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:06.541471 11344 tablet_service.cc:1511] Processing CreateTablet for tablet b3efeab722734837a8930b3db62039e3 (DEFAULT_TABLE table=default.Table_d4944bbe1b814196b7692b4ce51d11a1 [id=66a135f06c804f3ea2d019ec08608445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.541841 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3efeab722734837a8930b3db62039e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.541611 11953 log.cc:1199] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/3e3a033c9e7545479130c7a3c48ac254
I20260925 01:50:06.543409 11953 ts_tablet_manager.cc:1950] T 3e3a033c9e7545479130c7a3c48ac254 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:06.543383 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_0ce57c47f5db4f6da04a799567d656fe [id=c3bda2bcc66f4f4ea55f4a7066905c87] alter complete (version 5)
I20260925 01:50:06.543727 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 403) took 9364 ms. Trace:
I20260925 01:50:06.543792 11953 rpcz_store.cc:276] 0925 01:49:57.179022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.179086 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:06.499769 (+9320683us) ts_tablet_manager.cc:1151] Deleting tablet 3e3a033c9e7545479130c7a3c48ac254
0925 01:50:06.499778 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.517780 (+ 18002us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.529889 (+ 12109us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.543712 (+ 13823us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9320480}
I20260925 01:50:06.544178 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 401) took 9365 ms. Trace:
I20260925 01:50:06.544243 11953 rpcz_store.cc:276] 0925 01:49:57.178440 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.179562 (+ 1122us) service_pool.cc:224] Handling call
0925 01:50:06.544070 (+9364508us) ts_tablet_manager.cc:1151] Deleting tablet 4930edeb2edd4e7494dbf1761b5d20c0
0925 01:50:06.544078 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.544164 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9364297}
I20260925 01:50:06.544502 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 400) took 9366 ms. Trace:
I20260925 01:50:06.544559 11953 rpcz_store.cc:276] 0925 01:49:57.178147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.178341 (+ 194us) service_pool.cc:224] Handling call
0925 01:50:06.544425 (+9366084us) ts_tablet_manager.cc:1151] Deleting tablet 9e112a4ce48f40a196f655379c758c9c
0925 01:50:06.544433 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.544491 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9313432}
I20260925 01:50:06.547740 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 3e3a033c9e7545479130c7a3c48ac254 (table default.Table_4e63a5cef7e84a9cbe9a2911d1523b8c [id=603d80ba3d934fc69b60ff151671e75d]) successfully deleted
W20260925 01:50:06.548018 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 4930edeb2edd4e7494dbf1761b5d20c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4930edeb2edd4e7494dbf1761b5d20c0 already in progress: creating tablet
W20260925 01:50:06.548220 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9e112a4ce48f40a196f655379c758c9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e112a4ce48f40a196f655379c758c9c already in progress: creating tablet
I20260925 01:50:06.545850 11754 consensus_queue.cc:260] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.555176 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 40618d01b8724ad9a0bb82ca3e00f162 (DEFAULT_TABLE table=default.Table_03285c55385442afa6e0ae96bdd74716 [id=0b46cf03c2594863b5221744806f38e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.554013 11754 ts_tablet_manager.cc:1434] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260925 01:50:06.555634 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40618d01b8724ad9a0bb82ca3e00f162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.558521 11754 tablet_bootstrap.cc:492] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.559461 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 47e533afa7f147339393cc952bc1a16a (DEFAULT_TABLE table=default.Table_4ce55b42ce4e4e239d303411e27c68dd [id=169d5ec1bd014013a72ced907e820da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.560148 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 40618d01b8724ad9a0bb82ca3e00f162 (DEFAULT_TABLE table=default.Table_03285c55385442afa6e0ae96bdd74716 [id=0b46cf03c2594863b5221744806f38e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.562084 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 85e98cf0ddd34554abd3d80cff64eb81 (DEFAULT_TABLE table=default.Table_d6444607e23045e5a39e6f44fa353f7e [id=60371bf468f04be8924a89774eeced55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.562448 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e98cf0ddd34554abd3d80cff64eb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.563185 12689 ts_tablet_manager.cc:1929] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.563449 12689 log.cc:1199] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/1f778b87d307483b9edb17dce7355a65
I20260925 01:50:06.566926 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 85e98cf0ddd34554abd3d80cff64eb81 (DEFAULT_TABLE table=default.Table_d6444607e23045e5a39e6f44fa353f7e [id=60371bf468f04be8924a89774eeced55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.567677 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40618d01b8724ad9a0bb82ca3e00f162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.570284 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e98cf0ddd34554abd3d80cff64eb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.570685 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e533afa7f147339393cc952bc1a16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.571204 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:06.571584 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 9feb00f881ed4518a32e08d170080a46 (table default.Table_a9bdcb0034c84520a7d9881bc8927159 [id=372975f12d544860a00670c2763bbbb4]). Expected version 3 got 0
I20260925 01:50:06.571849 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e87128b8baef4f9d80341f6980da519d (table default.Table_7bf2059d1939417f9dc9b05d8a716c76 [id=03d3184bbc30406db8afae3e9f64fb9b]). Expected version 1 got 0
I20260925 01:50:06.578308 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5048a0fca2e64ffa9f19000f48a4c090
I20260925 01:50:06.581185 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.588773 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 0575861dd3d6437284cc183acb87af0a (table default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086]). Expected version 2 got 0
I20260925 01:50:06.589022 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 7da55c488da540048a94324fa347c1ef (table default.Table_c81fc5cfc06f4c059ba11507857d478d [id=c97451943f104891bb63fcd9478c6a17]). Expected version 5 got 0
I20260925 01:50:06.589061 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 424) took 9051 ms. Trace:
I20260925 01:50:06.589383 11953 rpcz_store.cc:276] 0925 01:49:57.538124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.731491 (+193367us) service_pool.cc:224] Handling call
0925 01:50:06.544721 (+8813230us) ts_tablet_manager.cc:1151] Deleting tablet 8909181e04be451aa8aeb219c9da8b89
0925 01:50:06.561313 (+ 16592us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.589032 (+ 27719us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8812928}
I20260925 01:50:06.591313 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 422) took 9067 ms. Trace:
I20260925 01:50:06.592998 11953 rpcz_store.cc:276] 0925 01:49:57.524104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.712879 (+188775us) service_pool.cc:224] Handling call
0925 01:50:06.591196 (+8878317us) ts_tablet_manager.cc:1151] Deleting tablet 49b110516abb45d1880d0e0e33e20174
0925 01:50:06.591206 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.591299 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8826156}
I20260925 01:50:06.593572 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 423) took 9058 ms. Trace:
W20260925 01:50:06.593577 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8909181e04be451aa8aeb219c9da8b89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8909181e04be451aa8aeb219c9da8b89 already in progress: creating tablet
W20260925 01:50:06.594249 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 49b110516abb45d1880d0e0e33e20174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49b110516abb45d1880d0e0e33e20174 already in progress: creating tablet
I20260925 01:50:06.595156 11953 rpcz_store.cc:276] 0925 01:49:57.535419 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.727097 (+191678us) service_pool.cc:224] Handling call
0925 01:50:06.593465 (+8866368us) ts_tablet_manager.cc:1151] Deleting tablet 5e6715233be44b9aad5210d17500f59d
0925 01:50:06.593474 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.593553 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8826373}
I20260925 01:50:06.598989 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5ef093a4a1134407ba94207137ce3e81
I20260925 01:50:06.599591 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 5ef093a4a1134407ba94207137ce3e81 deleted and replaced by tablet f8ffc45058774a878d4b802400feecb7
I20260925 01:50:06.600126 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ef8e5edec85740b59397191a9adfb275"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.600740 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef8e5edec85740b59397191a9adfb275 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.603420 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 425) took 9062 ms. Trace:
I20260925 01:50:06.604387 11953 rpcz_store.cc:276] 0925 01:49:57.540614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.731814 (+191200us) service_pool.cc:224] Handling call
0925 01:50:06.603305 (+8871491us) ts_tablet_manager.cc:1151] Deleting tablet fce91b00d3a14e6398abacad61ff5b0f
0925 01:50:06.603314 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.603401 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8763371}
I20260925 01:50:06.612003 11953 tablet_replica.cc:333] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:06.612537 11953 raft_consensus.cc:2243] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:06.612536 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5e6715233be44b9aad5210d17500f59d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e6715233be44b9aad5210d17500f59d already in progress: creating tablet
I20260925 01:50:06.610795 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ef093a4a1134407ba94207137ce3e81 with delete_type TABLET_DATA_DELETED (replaced by tablet f8ffc45058774a878d4b802400feecb7) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.612512 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe00088fb8f4895ad137121169d228c (DEFAULT_TABLE table=default.Table_b8457e024a154480817c8b2d97e1e398 [id=5eddc016803e4f3c8a4d26839a817b62]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:06.612833 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet fce91b00d3a14e6398abacad61ff5b0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fce91b00d3a14e6398abacad61ff5b0f already in progress: creating tablet
I20260925 01:50:06.613616 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe00088fb8f4895ad137121169d228c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.613102 11953 raft_consensus.cc:2272] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.613584 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4f58554cb84a08a3fdf14cb279ca56 (DEFAULT_TABLE table=default.Table_4b66e20f55e04eaf8ea162d732c1e929 [id=96a8a65607e54f728a18079f6e6e1bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.614027 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4f58554cb84a08a3fdf14cb279ca56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.614271 11344 tablet_service.cc:1511] Processing CreateTablet for tablet e4d3293730684400a84f1ca62bb6a95d (DEFAULT_TABLE table=default.Table_b9496066fd384ed5a55cddc646c482f0 [id=0dea54d04b9f484092d92822fe1de6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.612150 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 98e13bbb749544afbb73e83b314c3d06 (DEFAULT_TABLE table=default.Table_f9584e223de240118d5403df64e4aa15 [id=8c8d9ec3a2ea42a8a63714546817babd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.614898 11953 ts_tablet_manager.cc:1916] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.618084 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e13bbb749544afbb73e83b314c3d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.580520 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.619007 12689 ts_tablet_manager.cc:1950] T 1f778b87d307483b9edb17dce7355a65 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:06.619023 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d3293730684400a84f1ca62bb6a95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.618955 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 0cab72cc0f4f4c3aac01916dc1f7c4e9 (DEFAULT_TABLE table=default.Table_b956becceb424b008b027c67f8ffb52d [id=aa8d2c4cceb345c29abc3373fdd78203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.619343 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cab72cc0f4f4c3aac01916dc1f7c4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.619916 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 1f778b87d307483b9edb17dce7355a65 (table default.Table_78fa9227d15c432fb2a7b5f1bba2b14c [id=7403f961d61b4ab2b2042f88d1b80db0]) successfully deleted
W20260925 01:50:06.620313 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 22a335062caa48139e1cd4bca7bd4e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22a335062caa48139e1cd4bca7bd4e2b already in progress: creating tablet
W20260925 01:50:06.620710 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bfc152df745b46fb84aec1c9fa017ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfc152df745b46fb84aec1c9fa017ba5 already in progress: creating tablet
W20260925 01:50:06.622022 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5048a0fca2e64ffa9f19000f48a4c090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5048a0fca2e64ffa9f19000f48a4c090 already in progress: creating tablet
I20260925 01:50:06.631156 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc5d0702e644784a73346085f739117 (DEFAULT_TABLE table=default.Table_0965c7825c014870988b8f3f46fd395f [id=bf06ca9d4e614f84b138f8ecb589ffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.631639 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc5d0702e644784a73346085f739117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.633226 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 064c6cbe77d0405abe16a9a53d842590
I20260925 01:50:06.633881 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 064c6cbe77d0405abe16a9a53d842590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.634205 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0b317291cb904b7f9bbf1b8d05022488" } new_table_name: "default.Table_26cf0afaf1184108bb28e2caaca2ff96" modify_external_catalogs: true
I20260925 01:50:06.635569 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 16dcc2d4bf24480f8e5fe67ae18764d0
I20260925 01:50:06.636153 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.636329 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3b9c5f79b2e444938f2face578ece85a" } new_table_name: "default.Table_6a348a5f51504bd0bea192d30afde312" modify_external_catalogs: true
I20260925 01:50:06.637290 11222 tablet_service.cc:1511] Processing CreateTablet for tablet 0652894c66c5413ca0f54e84c8fca89a (DEFAULT_TABLE table=default.Table_e63c9983706349cc9be41a3203248fba [id=7b13f365681c42edb238a5ba907ea182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.637650 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652894c66c5413ca0f54e84c8fca89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.638414 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc5d0702e644784a73346085f739117 (DEFAULT_TABLE table=default.Table_0965c7825c014870988b8f3f46fd395f [id=bf06ca9d4e614f84b138f8ecb589ffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.638749 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc5d0702e644784a73346085f739117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.643491 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1e1c0285c79b4e1280f3aa732e297c57
I20260925 01:50:06.644186 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_635b952a4e8b4c5b9b99fdf275576e31" } new_table_name: "default.Table_ee02eb5241724e1a8a9ade9adb5d0392" modify_external_catalogs: true
I20260925 01:50:06.645736 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1c0285c79b4e1280f3aa732e297c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.590974 11754 tablet_bootstrap.cc:654] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.646960 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:06.647158 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 40618d01b8724ad9a0bb82ca3e00f162 (DEFAULT_TABLE table=default.Table_03285c55385442afa6e0ae96bdd74716 [id=0b46cf03c2594863b5221744806f38e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.647563 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40618d01b8724ad9a0bb82ca3e00f162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.648612 11755 tablet_bootstrap.cc:492] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:06.648802 11755 ts_tablet_manager.cc:1403] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.119s user 0.002s sys 0.004s
I20260925 01:50:06.649514 11755 raft_consensus.cc:359] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.649758 11755 raft_consensus.cc:385] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.649868 11755 raft_consensus.cc:740] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.649887 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ef093a4a1134407ba94207137ce3e81 with delete_type TABLET_DATA_DELETED (replaced by tablet f8ffc45058774a878d4b802400feecb7) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:06.650174 11755 consensus_queue.cc:260] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.650766 11755 ts_tablet_manager.cc:1434] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260925 01:50:06.651108 11755 tablet_bootstrap.cc:492] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:06.651136 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4f58554cb84a08a3fdf14cb279ca56 (DEFAULT_TABLE table=default.Table_4b66e20f55e04eaf8ea162d732c1e929 [id=96a8a65607e54f728a18079f6e6e1bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.651204 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 98e13bbb749544afbb73e83b314c3d06 (DEFAULT_TABLE table=default.Table_f9584e223de240118d5403df64e4aa15 [id=8c8d9ec3a2ea42a8a63714546817babd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.651544 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4f58554cb84a08a3fdf14cb279ca56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.651589 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe00088fb8f4895ad137121169d228c (DEFAULT_TABLE table=default.Table_b8457e024a154480817c8b2d97e1e398 [id=5eddc016803e4f3c8a4d26839a817b62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.651930 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe00088fb8f4895ad137121169d228c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.652161 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e13bbb749544afbb73e83b314c3d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.652827 11755 tablet_bootstrap.cc:654] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.653705 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1c0285c79b4e1280f3aa732e297c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.653852 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 064c6cbe77d0405abe16a9a53d842590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:06.653898 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 0cab72cc0f4f4c3aac01916dc1f7c4e9 (DEFAULT_TABLE table=default.Table_b956becceb424b008b027c67f8ffb52d [id=aa8d2c4cceb345c29abc3373fdd78203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.654002 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 064c6cbe77d0405abe16a9a53d842590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.654278 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cab72cc0f4f4c3aac01916dc1f7c4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.654244 11493 tablet_service.cc:1511] Processing CreateTablet for tablet e4d3293730684400a84f1ca62bb6a95d (DEFAULT_TABLE table=default.Table_b9496066fd384ed5a55cddc646c482f0 [id=0dea54d04b9f484092d92822fe1de6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.654573 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d3293730684400a84f1ca62bb6a95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.655359 11754 tablet_bootstrap.cc:492] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.658334 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc5d0702e644784a73346085f739117 (DEFAULT_TABLE table=default.Table_0965c7825c014870988b8f3f46fd395f [id=bf06ca9d4e614f84b138f8ecb589ffd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.658612 11754 ts_tablet_manager.cc:1403] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.103s user 0.004s sys 0.000s
I20260925 01:50:06.658618 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 47e533afa7f147339393cc952bc1a16a (DEFAULT_TABLE table=default.Table_4ce55b42ce4e4e239d303411e27c68dd [id=169d5ec1bd014013a72ced907e820da6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.658797 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:06.659166 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 064c6cbe77d0405abe16a9a53d842590 because the tablet was not found. No further retry: Not found: Tablet not found: 064c6cbe77d0405abe16a9a53d842590
W20260925 01:50:06.660058 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16dcc2d4bf24480f8e5fe67ae18764d0 already in progress: creating tablet
I20260925 01:50:06.660909 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 85e98cf0ddd34554abd3d80cff64eb81 (DEFAULT_TABLE table=default.Table_d6444607e23045e5a39e6f44fa353f7e [id=60371bf468f04be8924a89774eeced55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.661211 11754 raft_consensus.cc:359] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.661446 11754 raft_consensus.cc:385] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.661533 11754 raft_consensus.cc:740] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.661536 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1c0285c79b4e1280f3aa732e297c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:06.658694 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc5d0702e644784a73346085f739117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.661866 11754 consensus_queue.cc:260] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.662606 11754 ts_tablet_manager.cc:1434] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:06.663154 11754 tablet_bootstrap.cc:492] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.664855 11754 tablet_bootstrap.cc:654] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.667292 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47e533afa7f147339393cc952bc1a16a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.668004 11953 ts_tablet_manager.cc:1929] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.609802 11219 tablet_service.cc:1511] Processing CreateTablet for tablet e4d3293730684400a84f1ca62bb6a95d (DEFAULT_TABLE table=default.Table_b9496066fd384ed5a55cddc646c482f0 [id=0dea54d04b9f484092d92822fe1de6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.668401 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d3293730684400a84f1ca62bb6a95d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.669931 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e98cf0ddd34554abd3d80cff64eb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.670077 13149 raft_consensus.cc:493] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.670194 13149 raft_consensus.cc:515] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.670938 13149 leader_election.cc:290] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.671583 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b11c6526dbc4177b3a54b3c952bbd31" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:06.671746 11238 raft_consensus.cc:2468] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:06.672144 11456 leader_election.cc:304] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:06.672377 13149 raft_consensus.cc:2804] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.672435 13149 raft_consensus.cc:493] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.672498 13149 raft_consensus.cc:3060] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.609915 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4f58554cb84a08a3fdf14cb279ca56 (DEFAULT_TABLE table=default.Table_4b66e20f55e04eaf8ea162d732c1e929 [id=96a8a65607e54f728a18079f6e6e1bb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.674583 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4f58554cb84a08a3fdf14cb279ca56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.610261 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 98e13bbb749544afbb73e83b314c3d06 (DEFAULT_TABLE table=default.Table_f9584e223de240118d5403df64e4aa15 [id=8c8d9ec3a2ea42a8a63714546817babd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.611806 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 0cab72cc0f4f4c3aac01916dc1f7c4e9 (DEFAULT_TABLE table=default.Table_b956becceb424b008b027c67f8ffb52d [id=aa8d2c4cceb345c29abc3373fdd78203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.676597 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cab72cc0f4f4c3aac01916dc1f7c4e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.610342 13140 raft_consensus.cc:697] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:06.680372 13140 consensus_queue.cc:237] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.609234 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ef093a4a1134407ba94207137ce3e81 with delete_type TABLET_DATA_DELETED (replaced by tablet f8ffc45058774a878d4b802400feecb7) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.609594 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe00088fb8f4895ad137121169d228c (DEFAULT_TABLE table=default.Table_b8457e024a154480817c8b2d97e1e398 [id=5eddc016803e4f3c8a4d26839a817b62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.685917 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe00088fb8f4895ad137121169d228c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.673065 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b11c6526dbc4177b3a54b3c952bbd31" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:06.685372 11755 tablet_bootstrap.cc:492] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:06.686458 11755 ts_tablet_manager.cc:1403] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.003s
I20260925 01:50:06.686551 12964 raft_consensus.cc:493] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.686679 12964 raft_consensus.cc:515] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.687160 11755 raft_consensus.cc:359] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.687250 12964 leader_election.cc:290] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.687322 11755 raft_consensus.cc:385] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.687379 11755 raft_consensus.cc:740] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.687578 11755 consensus_queue.cc:260] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.688107 11755 ts_tablet_manager.cc:1434] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:06.688369 11755 tablet_bootstrap.cc:492] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:06.688861 11953 log.cc:1199] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ca17585cd523440ca1e9b754f3aedf8a
I20260925 01:50:06.689258 11953 ts_tablet_manager.cc:1950] T ca17585cd523440ca1e9b754f3aedf8a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:06.692224 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07f37b8469a497ba3fe504cb21105d2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:06.692291 11457 leader_election.cc:343] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:06.692842 11457 leader_election.cc:343] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.693007 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e13bbb749544afbb73e83b314c3d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.695233 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07f37b8469a497ba3fe504cb21105d2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:06.695470 11238 raft_consensus.cc:2468] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:06.696010 11456 leader_election.cc:304] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.696532 12964 raft_consensus.cc:2804] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.696635 12964 raft_consensus.cc:493] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.696727 12964 raft_consensus.cc:3060] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.700726 12964 raft_consensus.cc:515] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.701578 12964 leader_election.cc:290] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.702262 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 434) took 8862 ms. Trace:
I20260925 01:50:06.702348 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07f37b8469a497ba3fe504cb21105d2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:06.702355 11953 rpcz_store.cc:276] 0925 01:49:57.840141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.859084 (+ 18943us) service_pool.cc:224] Handling call
0925 01:50:06.611953 (+8752869us) ts_tablet_manager.cc:1151] Deleting tablet ca17585cd523440ca1e9b754f3aedf8a
0925 01:50:06.611963 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.658451 (+ 46488us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.667943 (+ 9492us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.702241 (+ 34298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8738074}
I20260925 01:50:06.702567 11238 raft_consensus.cc:3060] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.702775 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 426) took 9151 ms. Trace:
I20260925 01:50:06.702844 11953 rpcz_store.cc:276] 0925 01:49:57.550954 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:57.747118 (+196164us) service_pool.cc:224] Handling call
0925 01:50:06.702653 (+8955535us) ts_tablet_manager.cc:1151] Deleting tablet 811b957c4e6647ccaa688d7273ec9eeb
0925 01:50:06.702663 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.702758 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8718543}
I20260925 01:50:06.703111 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 443) took 8511 ms. Trace:
I20260925 01:50:06.703169 11953 rpcz_store.cc:276] 0925 01:49:58.191527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.192470 (+ 943us) service_pool.cc:224] Handling call
0925 01:50:06.703028 (+8510558us) ts_tablet_manager.cc:1151] Deleting tablet 09a79f0bd7374dabb2edc5ddf5fc8e41
0925 01:50:06.703035 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.703099 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8487374}
I20260925 01:50:06.704155 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 445) took 8459 ms. Trace:
I20260925 01:50:06.704228 11953 rpcz_store.cc:276] 0925 01:49:58.244585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.244643 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:06.703338 (+8458695us) ts_tablet_manager.cc:1151] Deleting tablet 6a773feeb51349a084efedfd338eafe0
0925 01:50:06.704046 (+ 708us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.704138 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8458500}
I20260925 01:50:06.705561 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07f37b8469a497ba3fe504cb21105d2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:06.707221 12947 raft_consensus.cc:493] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.707350 12947 raft_consensus.cc:515] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.707676 11238 raft_consensus.cc:2468] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:06.707947 12947 leader_election.cc:290] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.708240 11456 leader_election.cc:304] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:06.708918 11755 tablet_bootstrap.cc:654] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:06.709435 11457 leader_election.cc:343] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.709687 13149 raft_consensus.cc:515] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.710208 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f97ead49634bf6b03e292544af4d07" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.716420 11521 raft_consensus.cc:2393] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:50:06.711139 13162 raft_consensus.cc:2804] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.717146 13149 leader_election.cc:290] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.717844 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b11c6526dbc4177b3a54b3c952bbd31" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:06.718040 11239 raft_consensus.cc:3060] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.691038 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 507d06f04fb24c1abb9119a0fa5af141
I20260925 01:50:06.702267 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet 19c718c83cfe49b9a745e06314e24409 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:06.720726 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f2a993f348294efa9dd4d14d80c38492"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.721036 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f4f4ecc9e22d4728b850f0f8bd4170bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.721436 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2a993f348294efa9dd4d14d80c38492 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.721596 11239 raft_consensus.cc:2468] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
W20260925 01:50:06.721858 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4f4ecc9e22d4728b850f0f8bd4170bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.722183 13198 raft_consensus.cc:493] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.722307 13198 raft_consensus.cc:515] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.704022 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ca17585cd523440ca1e9b754f3aedf8a (table default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]) successfully deleted
W20260925 01:50:06.722898 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 811b957c4e6647ccaa688d7273ec9eeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 811b957c4e6647ccaa688d7273ec9eeb already in progress: creating tablet
I20260925 01:50:06.722954 13198 leader_election.cc:290] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:06.723171 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 already in progress: creating tablet
W20260925 01:50:06.723395 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 6a773feeb51349a084efedfd338eafe0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a773feeb51349a084efedfd338eafe0 already in progress: creating tablet
W20260925 01:50:06.723727 11456 consensus_peers.cc:597] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b306496f992f45a9b64b05b73712cb5b. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:06.723933 11456 leader_election.cc:304] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:06.723935 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb00f881ed4518a32e08d170080a46" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:06.710867 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_229aa93ef5bf437694d72a7119dad224"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.724051 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 507d06f04fb24c1abb9119a0fa5af141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:06.660348 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1e1c0285c79b4e1280f3aa732e297c57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e1c0285c79b4e1280f3aa732e297c57 already in progress: creating tablet
W20260925 01:50:06.724408 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 64084us
W20260925 01:50:06.724500 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_229aa93ef5bf437694d72a7119dad224 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:06.724471 11177 leader_election.cc:343] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.724756 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb00f881ed4518a32e08d170080a46" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.724915 11521 raft_consensus.cc:2468] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:06.725351 11176 leader_election.cc:304] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.725494 12964 raft_consensus.cc:2804] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.711275 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f304a261ed084fdaa807544fafad7c30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:06.725593 12964 raft_consensus.cc:697] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:06.725803 12964 consensus_queue.cc:237] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:06.725924 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f304a261ed084fdaa807544fafad7c30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.726377 13198 raft_consensus.cc:2804] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.726476 13198 raft_consensus.cc:493] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.726540 13198 raft_consensus.cc:3060] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.699579 11680 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086] alter complete (version 2)
I20260925 01:50:06.727794 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_beb6ee96dba041d6a7c99c5d8dc3a403" } new_table_name: "default.Table_75c9b6035afe42349ad58a9bc0645d80" modify_external_catalogs: true
I20260925 01:50:06.729329 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 446) took 8482 ms. Trace:
I20260925 01:50:06.729431 11953 rpcz_store.cc:276] 0925 01:49:58.246973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.247028 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:06.704454 (+8457426us) ts_tablet_manager.cc:1151] Deleting tablet c8944feb988d4509b8601689ac02b11b
0925 01:50:06.729200 (+ 24746us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.729308 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8457135}
I20260925 01:50:06.730767 13198 raft_consensus.cc:515] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:06.731061 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c8944feb988d4509b8601689ac02b11b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8944feb988d4509b8601689ac02b11b already in progress: creating tablet
I20260925 01:50:06.731917 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb00f881ed4518a32e08d170080a46" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:06.732489 11177 leader_election.cc:343] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.733364 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9feb00f881ed4518a32e08d170080a46" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:06.733561 11521 raft_consensus.cc:3060] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.734102 13198 leader_election.cc:290] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.736833 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 447) took 8487 ms. Trace:
I20260925 01:50:06.736937 11953 rpcz_store.cc:276] 0925 01:49:58.249511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.249565 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:06.729704 (+8480139us) ts_tablet_manager.cc:1151] Deleting tablet 9663d7f4008e4ee0a3ba4373258242eb
0925 01:50:06.736726 (+ 7022us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.736815 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8479769}
I20260925 01:50:06.737298 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 444) took 8503 ms. Trace:
I20260925 01:50:06.737362 11953 rpcz_store.cc:276] 0925 01:49:58.234185 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.235366 (+ 1181us) service_pool.cc:224] Handling call
0925 01:50:06.737198 (+8501832us) ts_tablet_manager.cc:1151] Deleting tablet e2ba874cb6a34ccd9e59cc9146280c17
0925 01:50:06.737210 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.737284 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8451367}
I20260925 01:50:06.737625 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 465) took 7989 ms. Trace:
I20260925 01:50:06.737691 11953 rpcz_store.cc:276] 0925 01:49:58.748627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:58.874810 (+126183us) service_pool.cc:224] Handling call
0925 01:50:06.737566 (+7862756us) ts_tablet_manager.cc:1151] Deleting tablet 00906edfa6b648229bcba8e59d68b969
0925 01:50:06.737573 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.737614 (+ 41us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7838457}
I20260925 01:50:06.737990 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 469) took 7963 ms. Trace:
I20260925 01:50:06.738047 11953 rpcz_store.cc:276] 0925 01:49:58.774944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.022402 (+247458us) service_pool.cc:224] Handling call
0925 01:50:06.737903 (+7715501us) ts_tablet_manager.cc:1151] Deleting tablet 45c06bf5641542f5aa36b160b31d797f
0925 01:50:06.737911 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.737976 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7712661}
I20260925 01:50:06.738332 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 470) took 7963 ms. Trace:
I20260925 01:50:06.738415 11953 rpcz_store.cc:276] 0925 01:49:58.775021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.025277 (+250256us) service_pool.cc:224] Handling call
0925 01:50:06.738248 (+7712971us) ts_tablet_manager.cc:1151] Deleting tablet 67c5e0fdc70243e8ba59e5e1faeecfc0
0925 01:50:06.738255 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.738318 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7710247}
I20260925 01:50:06.738742 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 471) took 7963 ms. Trace:
I20260925 01:50:06.738812 11953 rpcz_store.cc:276] 0925 01:49:58.775113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.028045 (+252932us) service_pool.cc:224] Handling call
0925 01:50:06.738639 (+7710594us) ts_tablet_manager.cc:1151] Deleting tablet d3aadd649e4b4f489bfe4b0eea13ede8
0925 01:50:06.738650 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.738728 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7671917}
I20260925 01:50:06.739060 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 507d06f04fb24c1abb9119a0fa5af141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:06.739130 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 473) took 7930 ms. Trace:
W20260925 01:50:06.740296 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9663d7f4008e4ee0a3ba4373258242eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9663d7f4008e4ee0a3ba4373258242eb already in progress: creating tablet
W20260925 01:50:06.740576 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e2ba874cb6a34ccd9e59cc9146280c17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e2ba874cb6a34ccd9e59cc9146280c17 already in progress: creating tablet
I20260925 01:50:06.739198 11953 rpcz_store.cc:276] 0925 01:49:58.808509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.066754 (+258245us) service_pool.cc:224] Handling call
0925 01:50:06.739028 (+7672274us) ts_tablet_manager.cc:1151] Deleting tablet be89c0911dfa4b9d83d6bd88755be2b2
0925 01:50:06.739038 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.739114 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7672101}
W20260925 01:50:06.741075 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5ef093a4a1134407ba94207137ce3e81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ef093a4a1134407ba94207137ce3e81 already in progress: creating tablet
I20260925 01:50:06.741144 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 474) took 7932 ms. Trace:
I20260925 01:50:06.741518 11502 tablet_service.cc:1558] Processing DeleteTablet for tablet 507d06f04fb24c1abb9119a0fa5af141 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:06.741297 11953 rpcz_store.cc:276] 0925 01:49:58.808652 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.066944 (+258292us) service_pool.cc:224] Handling call
0925 01:50:06.741058 (+7674114us) ts_tablet_manager.cc:1151] Deleting tablet 85ae2fbcec1d41dda3e0b32ce09a32f2
0925 01:50:06.741066 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.741130 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7673977}
W20260925 01:50:06.742237 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 00906edfa6b648229bcba8e59d68b969 because the tablet was not found. No further retry: Not found: Tablet not found: 00906edfa6b648229bcba8e59d68b969
W20260925 01:50:06.742633 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 45c06bf5641542f5aa36b160b31d797f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45c06bf5641542f5aa36b160b31d797f already in progress: creating tablet
I20260925 01:50:06.742835 13198 raft_consensus.cc:493] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:50:06.742862 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67c5e0fdc70243e8ba59e5e1faeecfc0 already in progress: creating tablet
I20260925 01:50:06.743018 13198 raft_consensus.cc:515] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:06.743088 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d3aadd649e4b4f489bfe4b0eea13ede8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3aadd649e4b4f489bfe4b0eea13ede8 already in progress: creating tablet
I20260925 01:50:06.744033 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfde700aff8049f4b10c46059da6907f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.744195 11516 raft_consensus.cc:2468] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:06.744666 11176 leader_election.cc:304] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:50:06.745098 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet be89c0911dfa4b9d83d6bd88755be2b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be89c0911dfa4b9d83d6bd88755be2b2 already in progress: creating tablet
I20260925 01:50:06.745477 13198 leader_election.cc:290] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.745646 13198 raft_consensus.cc:2804] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.745739 13198 raft_consensus.cc:493] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.745833 13198 raft_consensus.cc:3060] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:06.745949 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 507d06f04fb24c1abb9119a0fa5af141 because the tablet was not found. No further retry: Not found: Tablet not found: 507d06f04fb24c1abb9119a0fa5af141
I20260925 01:50:06.746157 12964 raft_consensus.cc:493] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.746469 12964 raft_consensus.cc:515] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:06.742033 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 475) took 7896 ms. Trace:
I20260925 01:50:06.750253 11953 rpcz_store.cc:276] 0925 01:49:58.846175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.067097 (+220922us) service_pool.cc:224] Handling call
0925 01:50:06.741949 (+7674852us) ts_tablet_manager.cc:1151] Deleting tablet d401574e89014d2aaa5f98d0d9a2729f
0925 01:50:06.741957 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.742021 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7674733}
I20260925 01:50:06.750898 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 472) took 7942 ms. Trace:
I20260925 01:50:06.751039 11953 rpcz_store.cc:276] 0925 01:49:58.808333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.057683 (+249350us) service_pool.cc:224] Handling call
0925 01:50:06.750770 (+7693087us) ts_tablet_manager.cc:1151] Deleting tablet 70f4777a789a48a18cfadbfb9d49a708
0925 01:50:06.750781 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.750879 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7629293}
I20260925 01:50:06.751623 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 481) took 7766 ms. Trace:
I20260925 01:50:06.751834 11946 ts_tablet_manager.cc:1929] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:06.751756 11953 rpcz_store.cc:276] 0925 01:49:58.985580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.164429 (+178849us) service_pool.cc:224] Handling call
0925 01:50:06.751507 (+7587078us) ts_tablet_manager.cc:1151] Deleting tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3
0925 01:50:06.751519 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.751604 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7586724}
I20260925 01:50:06.751963 11946 log.cc:1199] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:06.752243 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 482) took 7752 ms. Trace:
I20260925 01:50:06.752281 11946 ts_tablet_manager.cc:1950] T 75a8e09b8838443c9bfff440ff1f877d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.752321 11953 rpcz_store.cc:276] 0925 01:49:58.999586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.164810 (+165224us) service_pool.cc:224] Handling call
0925 01:50:06.752137 (+7587327us) ts_tablet_manager.cc:1151] Deleting tablet f385af75e11c4643b4e7c2d899ee99a4
0925 01:50:06.752148 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.752227 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7587069}
I20260925 01:50:06.752606 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 653) took 3271 ms. Trace:
I20260925 01:50:06.752662 11946 rpcz_store.cc:276] 0925 01:50:03.481472 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.481708 (+ 236us) service_pool.cc:224] Handling call
0925 01:50:06.504244 (+3022536us) ts_tablet_manager.cc:1151] Deleting tablet 75a8e09b8838443c9bfff440ff1f877d
0925 01:50:06.504255 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.537523 (+ 33268us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.751764 (+214241us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.752594 (+ 830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3022356}
W20260925 01:50:06.752786 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d401574e89014d2aaa5f98d0d9a2729f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d401574e89014d2aaa5f98d0d9a2729f already in progress: creating tablet
I20260925 01:50:06.753121 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 654) took 3204 ms. Trace:
W20260925 01:50:06.753153 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 70f4777a789a48a18cfadbfb9d49a708 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70f4777a789a48a18cfadbfb9d49a708 already in progress: creating tablet
I20260925 01:50:06.753196 11946 rpcz_store.cc:276] 0925 01:50:03.549090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.549165 (+ 75us) service_pool.cc:224] Handling call
0925 01:50:06.752999 (+3203834us) ts_tablet_manager.cc:1151] Deleting tablet 49692d2824a34f48a4dcefad8c89618b
0925 01:50:06.753010 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.753104 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3203569}
W20260925 01:50:06.753392 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 already in progress: creating tablet
W20260925 01:50:06.753634 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f385af75e11c4643b4e7c2d899ee99a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f385af75e11c4643b4e7c2d899ee99a4 already in progress: creating tablet
I20260925 01:50:06.745417 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfde700aff8049f4b10c46059da6907f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:06.754369 11177 leader_election.cc:343] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:06.742717 11314 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:06.755095 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b11c6526dbc4177b3a54b3c952bbd31" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:06.755873 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1d2d998d834c21ab83694daae37520" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:06.756219 11314 leader_election.cc:304] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.756486 12947 raft_consensus.cc:3060] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.758188 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 655) took 3190 ms. Trace:
I20260925 01:50:06.758277 11946 rpcz_store.cc:276] 0925 01:50:03.568049 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.568142 (+ 93us) service_pool.cc:224] Handling call
0925 01:50:06.753434 (+3185292us) ts_tablet_manager.cc:1151] Deleting tablet f46004be36b543a395a783a13b1b14cf
0925 01:50:06.753444 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.758165 (+ 4721us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3185093}
I20260925 01:50:06.760265 12947 raft_consensus.cc:2749] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:06.761227 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 484) took 7759 ms. Trace:
I20260925 01:50:06.761312 11953 rpcz_store.cc:276] 0925 01:49:59.001932 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.177730 (+175798us) service_pool.cc:224] Handling call
0925 01:50:06.761105 (+7583375us) ts_tablet_manager.cc:1151] Deleting tablet 982b2a3dcdcb44bd8ad8562f30c38f13
0925 01:50:06.761118 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.761208 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7538171}
I20260925 01:50:06.761823 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 487) took 7687 ms. Trace:
I20260925 01:50:06.761897 11953 rpcz_store.cc:276] 0925 01:49:59.074242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.221339 (+147097us) service_pool.cc:224] Handling call
0925 01:50:06.761718 (+7540379us) ts_tablet_manager.cc:1151] Deleting tablet c2fe086048c04e0db797272e50f21c91
0925 01:50:06.761729 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.761805 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7515843}
I20260925 01:50:06.762765 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 656) took 3154 ms. Trace:
I20260925 01:50:06.763576 11946 rpcz_store.cc:276] 0925 01:50:03.607845 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.607908 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:06.762631 (+3154723us) ts_tablet_manager.cc:1151] Deleting tablet 728157ec17ed4df5a4a8559df6c1ac78
0925 01:50:06.762644 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.762746 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3154509}
I20260925 01:50:06.764007 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 657) took 3144 ms. Trace:
W20260925 01:50:06.763229 11457 leader_election.cc:343] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:06.764178 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 982b2a3dcdcb44bd8ad8562f30c38f13 already in progress: creating tablet
W20260925 01:50:06.764439 11457 consensus_peers.cc:597] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:06.764541 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c2fe086048c04e0db797272e50f21c91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2fe086048c04e0db797272e50f21c91 already in progress: creating tablet
W20260925 01:50:06.764640 11457 leader_election.cc:343] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.764958 11946 rpcz_store.cc:276] 0925 01:50:03.619751 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.619809 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:06.763899 (+3144090us) ts_tablet_manager.cc:1151] Deleting tablet f92450c05b394603ba475328d5a3eb71
0925 01:50:06.763910 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.763992 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3143848}
I20260925 01:50:06.765177 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 493) took 7448 ms. Trace:
I20260925 01:50:06.765267 11946 tablet_replica.cc:333] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.765298 11953 rpcz_store.cc:276] 0925 01:49:59.317024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.317472 (+ 448us) service_pool.cc:224] Handling call
0925 01:50:06.765046 (+7447574us) ts_tablet_manager.cc:1151] Deleting tablet 7eee30b35eb94fa196e9ccd1de37175a
0925 01:50:06.765055 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.765160 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7420552}
I20260925 01:50:06.765564 11946 raft_consensus.cc:2243] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.765795 11946 raft_consensus.cc:2272] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.766511 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 495) took 7137 ms. Trace:
I20260925 01:50:06.766511 11946 ts_tablet_manager.cc:1916] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:06.766817 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 7eee30b35eb94fa196e9ccd1de37175a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7eee30b35eb94fa196e9ccd1de37175a already in progress: creating tablet
I20260925 01:50:06.773533 11953 rpcz_store.cc:276] 0925 01:49:59.629223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.629274 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:06.766410 (+7137136us) ts_tablet_manager.cc:1151] Deleting tablet c3e2709b3b0f4157938d8d8bca8a7b10
0925 01:50:06.766418 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.766497 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7132884}
W20260925 01:50:06.774168 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c3e2709b3b0f4157938d8d8bca8a7b10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3e2709b3b0f4157938d8d8bca8a7b10 already in progress: creating tablet
I20260925 01:50:06.750011 13198 raft_consensus.cc:515] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.779982 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfde700aff8049f4b10c46059da6907f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:06.780164 11516 raft_consensus.cc:3060] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.783152 11516 raft_consensus.cc:2468] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:06.784118 11176 leader_election.cc:304] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:06.784850 12885 raft_consensus.cc:2804] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.785084 12885 raft_consensus.cc:697] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:06.785640 12885 consensus_queue.cc:237] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.787994 11521 raft_consensus.cc:2468] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:06.794582 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 494) took 7165 ms. Trace:
I20260925 01:50:06.795892 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfde700aff8049f4b10c46059da6907f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:06.796828 11177 leader_election.cc:343] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.797116 11953 rpcz_store.cc:276] 0925 01:49:59.628709 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.628963 (+ 254us) service_pool.cc:224] Handling call
0925 01:50:06.792507 (+7163544us) ts_tablet_manager.cc:1151] Deleting tablet cb7bac6e89b8405e8bd541eba6278a0b
0925 01:50:06.792520 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.794552 (+ 2032us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7154840}
I20260925 01:50:06.797657 13198 leader_election.cc:290] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:06.798388 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet cb7bac6e89b8405e8bd541eba6278a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb7bac6e89b8405e8bd541eba6278a0b already in progress: creating tablet
I20260925 01:50:06.798485 12782 raft_consensus.cc:493] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.798662 12782 raft_consensus.cc:515] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.799218 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 510) took 7021 ms. Trace:
I20260925 01:50:06.799492 13198 raft_consensus.cc:493] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.799340 12782 leader_election.cc:290] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.801017 13149 raft_consensus.cc:493] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:50:06.799595 11314 consensus_peers.cc:597] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8152c9e0b0af4ab2a18c5a0080e22ffc. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:06.801141 13149 raft_consensus.cc:515] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.802300 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd4b231f89a48e59e5eb3cf3976385a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:06.801872 13149 leader_election.cc:290] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:06.802799 11457 leader_election.cc:343] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:06.803128 11314 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:06.803238 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd4b231f89a48e59e5eb3cf3976385a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:06.803436 11238 raft_consensus.cc:2468] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:06.803845 11456 leader_election.cc:304] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.804225 13149 raft_consensus.cc:2804] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.804329 13149 raft_consensus.cc:493] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.804415 13149 raft_consensus.cc:3060] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.799988 13198 raft_consensus.cc:515] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.804345 11953 rpcz_store.cc:276] 0925 01:49:59.777473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.777561 (+ 88us) service_pool.cc:224] Handling call
0925 01:50:06.799089 (+7021528us) ts_tablet_manager.cc:1151] Deleting tablet 9f7639fd1f1149a7973eba0c77bd7065
0925 01:50:06.799102 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.799200 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7009867}
W20260925 01:50:06.806084 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9f7639fd1f1149a7973eba0c77bd7065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f7639fd1f1149a7973eba0c77bd7065 already in progress: creating tablet
I20260925 01:50:06.807648 13149 raft_consensus.cc:515] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.807735 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:06.808270 11177 leader_election.cc:343] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.809653 13198 leader_election.cc:290] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.811992 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 0652894c66c5413ca0f54e84c8fca89a (DEFAULT_TABLE table=default.Table_e63c9983706349cc9be41a3203248fba [id=7b13f365681c42edb238a5ba907ea182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.812417 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652894c66c5413ca0f54e84c8fca89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.813699 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 75a8e09b8838443c9bfff440ff1f877d (table default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea [id=22de07c9013f4c3ab9568e926ea5b8c1]) successfully deleted
I20260925 01:50:06.809978 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.814677 11953 tablet_replica.cc:333] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:06.814987 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1d2d998d834c21ab83694daae37520" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:06.815048 11953 raft_consensus.cc:2243] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.815419 11953 raft_consensus.cc:2272] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:06.821923 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 49692d2824a34f48a4dcefad8c89618b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49692d2824a34f48a4dcefad8c89618b already in progress: creating tablet
I20260925 01:50:06.822461 12782 raft_consensus.cc:493] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:06.822650 12782 raft_consensus.cc:515] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.823354 12782 leader_election.cc:290] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:06.824074 11346 tablet_service.cc:1511] Processing CreateTablet for tablet e42dc54d78bb4a6b9b870543b6f1bc0d (DEFAULT_TABLE table=default.Table_fbec59b2447b4db3bcb49c05c2d6921d [id=fddda9ed4d274adfaf7aab64b81d24fa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:06.824777 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f46004be36b543a395a783a13b1b14cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f46004be36b543a395a783a13b1b14cf already in progress: creating tablet
I20260925 01:50:06.826884 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42dc54d78bb4a6b9b870543b6f1bc0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:06.825922 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00345732f7314624831b4cfc59e981f4 consensus state has no leader
W20260925 01:50:06.826299 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1cae40ea83e429f8d50958dcd0cdded consensus state has no leader
W20260925 01:50:06.830880 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 728157ec17ed4df5a4a8559df6c1ac78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 728157ec17ed4df5a4a8559df6c1ac78 already in progress: creating tablet
W20260925 01:50:06.827224 11314 leader_election.cc:343] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 4d7b3c65d8a64734b2c432790dae07e1
W20260925 01:50:06.846297 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 62209.7us
W20260925 01:50:06.851295 11314 leader_election.cc:343] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:06.851478 11314 leader_election.cc:304] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.851794 12782 raft_consensus.cc:2749] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:06.851924 11176 leader_election.cc:304] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:06.853322 11314 leader_election.cc:343] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 4d7b3c65d8a64734b2c432790dae07e1
I20260925 01:50:06.853463 11314 leader_election.cc:304] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.853698 12782 raft_consensus.cc:2749] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:06.856467 11314 consensus_peers.cc:597] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba378e9d37c64a8ebd56894b2101ed8f. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:06.814241 12964 leader_election.cc:290] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:06.858305 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd4b231f89a48e59e5eb3cf3976385a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:06.858937 11457 leader_election.cc:343] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.856771 11753 raft_consensus.cc:385] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.859573 11753 raft_consensus.cc:740] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:06.815606 11456 leader_election.cc:343] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.849807 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:06.862097 11516 raft_consensus.cc:2468] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:06.862311 13140 raft_consensus.cc:2804] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.862489 13140 raft_consensus.cc:697] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:06.862491 11456 leader_election.cc:304] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.862728 12964 raft_consensus.cc:2749] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:06.862831 13140 consensus_queue.cc:237] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:06.863071 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 47473.3us
I20260925 01:50:06.863994 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd4b231f89a48e59e5eb3cf3976385a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:06.864198 11237 raft_consensus.cc:3060] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.860400 11753 consensus_queue.cc:260] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.865196 11753 ts_tablet_manager.cc:1434] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.376s user 0.020s sys 0.000s
I20260925 01:50:06.866971 11753 tablet_bootstrap.cc:492] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.866966 11237 raft_consensus.cc:2468] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:06.867286 11370 raft_consensus.cc:3060] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.868815 11753 tablet_bootstrap.cc:654] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.815497 13162 raft_consensus.cc:697] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:06.860128 13149 leader_election.cc:290] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.871399 13162 consensus_queue.cc:237] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.875408 11456 leader_election.cc:304] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.876065 12964 raft_consensus.cc:2804] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.876304 12964 raft_consensus.cc:697] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:06.876602 12964 consensus_queue.cc:237] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.878190 11754 tablet_bootstrap.cc:492] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:06.878340 11754 ts_tablet_manager.cc:1403] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.215s user 0.043s sys 0.035s
I20260925 01:50:06.879185 11754 raft_consensus.cc:359] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.879365 11754 raft_consensus.cc:385] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.879431 11754 raft_consensus.cc:740] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.879631 11754 consensus_queue.cc:260] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.880187 11754 ts_tablet_manager.cc:1434] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:06.882489 13192 tablet.cc:1751] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:06.855872 11946 ts_tablet_manager.cc:1929] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:06.884105 11946 log.cc:1199] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/f892954cd22c48aaad2f0e20b1277844
I20260925 01:50:06.884547 11946 ts_tablet_manager.cc:1950] T f892954cd22c48aaad2f0e20b1277844 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:06.884907 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 658) took 3209 ms. Trace:
I20260925 01:50:06.885028 11946 rpcz_store.cc:276] 0925 01:50:03.675443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.675556 (+ 113us) service_pool.cc:224] Handling call
0925 01:50:06.765218 (+3089662us) ts_tablet_manager.cc:1151] Deleting tablet f892954cd22c48aaad2f0e20b1277844
0925 01:50:06.765227 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.832395 (+ 67168us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.855801 (+ 23406us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:06.884890 (+ 29089us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3089446}
I20260925 01:50:06.885516 11946 tablet_replica.cc:333] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:06.886413 11953 ts_tablet_manager.cc:1916] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.889185 11176 leader_election.cc:304] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.891317 11754 tablet_bootstrap.cc:492] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:06.899169 11754 tablet_bootstrap.cc:654] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.903080 13209 raft_consensus.cc:2804] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:06.903252 13209 raft_consensus.cc:493] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:06.903416 13209 raft_consensus.cc:3060] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.906239 13223 tablet.cc:1751] T f6e9bc6f6c7346bfadbd79b8d494641e P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:06.906626 13209 raft_consensus.cc:515] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.908656 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:06.909193 11177 leader_election.cc:343] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.910609 13209 leader_election.cc:290] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.891628 11753 tablet_bootstrap.cc:492] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.911149 11753 ts_tablet_manager.cc:1403] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.001s
I20260925 01:50:06.911876 11753 raft_consensus.cc:359] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.912045 11753 raft_consensus.cc:385] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.912101 11753 raft_consensus.cc:740] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.912192 11370 raft_consensus.cc:3060] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.912322 11753 consensus_queue.cc:260] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.912669 13192 tablet.cc:1751] T 7da55c488da540048a94324fa347c1ef P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260925 01:50:06.912803 11753 ts_tablet_manager.cc:1434] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:06.899088 13172 tablet.cc:1751] T f6e9bc6f6c7346bfadbd79b8d494641e P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:06.915743 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:06.915956 11516 raft_consensus.cc:3060] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:06.918900 11516 raft_consensus.cc:2468] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:06.920364 11176 leader_election.cc:304] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:06.920833 13140 raft_consensus.cc:2804] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:06.920996 13140 raft_consensus.cc:697] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:06.921375 13140 consensus_queue.cc:237] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:06.925007 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f92450c05b394603ba475328d5a3eb71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92450c05b394603ba475328d5a3eb71 already in progress: creating tablet
W20260925 01:50:06.925227 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 87478us
I20260925 01:50:06.926680 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_c361990e57274e58b9e99c7086a27792 [id=8dcfe1cef923411faea69f4f694a51e6]) successfully deleted
I20260925 01:50:06.927541 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 0652894c66c5413ca0f54e84c8fca89a (DEFAULT_TABLE table=default.Table_e63c9983706349cc9be41a3203248fba [id=7b13f365681c42edb238a5ba907ea182]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:06.930104 11665 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet e42dc54d78bb4a6b9b870543b6f1bc0d (table default.Table_fbec59b2447b4db3bcb49c05c2d6921d [id=fddda9ed4d274adfaf7aab64b81d24fa], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e42dc54d78bb4a6b9b870543b6f1bc0d consensus state has no leader
I20260925 01:50:06.930506 11494 tablet_service.cc:1511] Processing CreateTablet for tablet e42dc54d78bb4a6b9b870543b6f1bc0d (DEFAULT_TABLE table=default.Table_fbec59b2447b4db3bcb49c05c2d6921d [id=fddda9ed4d274adfaf7aab64b81d24fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.933367 11501 tablet_service.cc:1511] Processing CreateTablet for tablet ab8682686f894beaaa58f4818c0651c4 (DEFAULT_TABLE table=default.Table_888d29cf77974252be89bea321d7542b [id=1ac851b7c103443cbb666b907f339946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.933692 11755 tablet_bootstrap.cc:492] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:06.933810 11346 tablet_service.cc:1511] Processing CreateTablet for tablet ab8682686f894beaaa58f4818c0651c4 (DEFAULT_TABLE table=default.Table_888d29cf77974252be89bea321d7542b [id=1ac851b7c103443cbb666b907f339946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.933820 11755 ts_tablet_manager.cc:1403] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.246s user 0.000s sys 0.076s
I20260925 01:50:06.934924 11755 raft_consensus.cc:359] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.935087 11755 raft_consensus.cc:385] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.935135 11755 raft_consensus.cc:740] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:06.935321 11755 consensus_queue.cc:260] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.935776 11755 ts_tablet_manager.cc:1434] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260925 01:50:06.936050 11755 tablet_bootstrap.cc:492] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:06.934247 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8682686f894beaaa58f4818c0651c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.938359 11755 tablet_bootstrap.cc:654] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.940739 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:06.941262 11753 tablet_bootstrap.cc:492] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.943545 11753 tablet_bootstrap.cc:654] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:06.944590 11212 tablet_service.cc:1511] Processing CreateTablet for tablet e42dc54d78bb4a6b9b870543b6f1bc0d (DEFAULT_TABLE table=default.Table_fbec59b2447b4db3bcb49c05c2d6921d [id=fddda9ed4d274adfaf7aab64b81d24fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.944999 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652894c66c5413ca0f54e84c8fca89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.945102 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42dc54d78bb4a6b9b870543b6f1bc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.946272 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42dc54d78bb4a6b9b870543b6f1bc0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.946468 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8682686f894beaaa58f4818c0651c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.947896 11346 tablet_service.cc:1511] Processing CreateTablet for tablet d549d73cf407467faa68cbfb68306190 (DEFAULT_TABLE table=default.Table_a93395123070480ca376c5c7828846f1 [id=b8fc7af6e5554c87afdc97b303b573c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.948216 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d549d73cf407467faa68cbfb68306190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.963372 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bea72848a0204c5f93359abe4f3ff9d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.964277 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bea72848a0204c5f93359abe4f3ff9d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.966157 11221 tablet_service.cc:1511] Processing CreateTablet for tablet d549d73cf407467faa68cbfb68306190 (DEFAULT_TABLE table=default.Table_a93395123070480ca376c5c7828846f1 [id=b8fc7af6e5554c87afdc97b303b573c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.966606 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d549d73cf407467faa68cbfb68306190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.969622 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c54f81e7d3234f95890fbd622794df08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:06.971335 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c54f81e7d3234f95890fbd622794df08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:06.973086 13162 raft_consensus.cc:493] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.973248 13162 raft_consensus.cc:515] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:06.973670 11946 raft_consensus.cc:2243] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:06.973698 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet d7f97ead49634bf6b03e292544af4d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:06.973845 11946 raft_consensus.cc:2272] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:06.973877 13162 leader_election.cc:290] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.974439 11946 ts_tablet_manager.cc:1916] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:06.980835 11344 tablet_service.cc:1511] Processing CreateTablet for tablet e5bc61637d944b60ba9e703e9894174c (DEFAULT_TABLE table=default.Table_167e60d2ec454ce38356ee349c14867b [id=ff94db776ce546be9ca23a60d0615e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.981237 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bc61637d944b60ba9e703e9894174c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.982369 11212 tablet_service.cc:1511] Processing CreateTablet for tablet ab8682686f894beaaa58f4818c0651c4 (DEFAULT_TABLE table=default.Table_888d29cf77974252be89bea321d7542b [id=1ac851b7c103443cbb666b907f339946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.982784 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8682686f894beaaa58f4818c0651c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.982671 11495 tablet_service.cc:1511] Processing CreateTablet for tablet d549d73cf407467faa68cbfb68306190 (DEFAULT_TABLE table=default.Table_a93395123070480ca376c5c7828846f1 [id=b8fc7af6e5554c87afdc97b303b573c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:06.983079 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d549d73cf407467faa68cbfb68306190. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:06.984288 13192 tablet.cc:1751] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:06.984715 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae948bf42ae34a7ab72112d5f1f02585" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:06.985209 11457 leader_election.cc:343] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.989337 11753 tablet_bootstrap.cc:492] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:06.989516 11753 ts_tablet_manager.cc:1403] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260925 01:50:06.990235 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae948bf42ae34a7ab72112d5f1f02585" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:06.990465 11753 raft_consensus.cc:359] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.990671 11753 raft_consensus.cc:385] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:06.990767 11753 raft_consensus.cc:740] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:06.990913 11456 leader_election.cc:343] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.991048 11456 leader_election.cc:304] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:06.991058 11753 consensus_queue.cc:260] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.991925 13162 raft_consensus.cc:2749] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:06.992425 13140 raft_consensus.cc:493] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:06.992535 11753 ts_tablet_manager.cc:1434] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:06.992682 13140 raft_consensus.cc:515] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:06.992830 11753 tablet_bootstrap.cc:492] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:06.993886 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3150980bb72435886486156aa98d342" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:06.994540 11753 tablet_bootstrap.cc:654] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:06.994463 11177 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:06.994737 13140 leader_election.cc:290] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:06.996800 12782 consensus_queue.cc:1048] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:07.001762 11755 tablet_bootstrap.cc:492] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.001925 11755 ts_tablet_manager.cc:1403] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.066s user 0.007s sys 0.003s
I20260925 01:50:07.002697 11755 raft_consensus.cc:359] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.002874 11755 raft_consensus.cc:385] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.002964 11755 raft_consensus.cc:740] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.003202 11755 consensus_queue.cc:260] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.003795 11755 ts_tablet_manager.cc:1434] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:07.004125 11755 tablet_bootstrap.cc:492] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.007300 11755 tablet_bootstrap.cc:654] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.012867 11495 tablet_service.cc:1511] Processing CreateTablet for tablet e5bc61637d944b60ba9e703e9894174c (DEFAULT_TABLE table=default.Table_167e60d2ec454ce38356ee349c14867b [id=ff94db776ce546be9ca23a60d0615e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.013376 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bc61637d944b60ba9e703e9894174c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.014436 11755 tablet_bootstrap.cc:492] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.014546 11755 ts_tablet_manager.cc:1403] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260925 01:50:07.015151 11755 raft_consensus.cc:359] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:07.015301 11755 raft_consensus.cc:385] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.015347 11755 raft_consensus.cc:740] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.016722 11755 consensus_queue.cc:260] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:50:07.016812 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb9339ab8dcb4ecca41fef9e9552009e consensus state has no leader
I20260925 01:50:07.017256 11755 ts_tablet_manager.cc:1434] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:50:07.017354 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b6b66fd099114d3fa9bf0b4cd9839b02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.017952 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6b66fd099114d3fa9bf0b4cd9839b02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.017602 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 9e86bd9a65dd46f09d87ddd831552b59 (DEFAULT_TABLE table=default.Table_d3b5e1eb785749939261859f4fb504a9 [id=fa9b155147cd48e2b56817bdceeb357d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.018316 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e86bd9a65dd46f09d87ddd831552b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.018833 11346 tablet_service.cc:1511] Processing CreateTablet for tablet f30fbaa9db5144debf9cc5124c9bf9bd (DEFAULT_TABLE table=default.Table_f23b8482c3ce4904a2a54bad0536a288 [id=a9eaca16691b4511908b7291080c1935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.019153 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30fbaa9db5144debf9cc5124c9bf9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.019261 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8] alter complete (version 1)
I20260925 01:50:07.020138 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e63c9983706349cc9be41a3203248fba" } new_table_name: "default.Table_a5cb51f2c7664220b18c70d38bcb6928" modify_external_catalogs: true
I20260925 01:50:07.021560 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c60e42eaec624765b51e956e32a4619c" } modify_external_catalogs: true
I20260925 01:50:07.021700 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c60e42eaec624765b51e956e32a4619c" } modify_external_catalogs: true
I20260925 01:50:07.025072 11755 tablet_bootstrap.cc:492] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.026748 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f1d2d998d834c21ab83694daae37520 with delete_type TABLET_DATA_DELETED (replaced by tablet 4930edeb2edd4e7494dbf1761b5d20c0) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.026971 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 with delete_type TABLET_DATA_DELETED (replaced by tablet aaa2f7ef888846ec9667916ba47084db) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.029253 11755 tablet_bootstrap.cc:654] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.032953 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:07.033278 11677 catalog_manager.cc:5838] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:07.033721 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e87128b8baef4f9d80341f6980da519d (table default.Table_7bf2059d1939417f9dc9b05d8a716c76 [id=03d3184bbc30406db8afae3e9f64fb9b]). Expected version 1 got 0
I20260925 01:50:07.033986 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 9feb00f881ed4518a32e08d170080a46 (table default.Table_a9bdcb0034c84520a7d9881bc8927159 [id=372975f12d544860a00670c2763bbbb4]). Expected version 3 got 0
I20260925 01:50:07.035120 11494 tablet_service.cc:1511] Processing CreateTablet for tablet f30fbaa9db5144debf9cc5124c9bf9bd (DEFAULT_TABLE table=default.Table_f23b8482c3ce4904a2a54bad0536a288 [id=a9eaca16691b4511908b7291080c1935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.035573 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30fbaa9db5144debf9cc5124c9bf9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.040774 11755 tablet_bootstrap.cc:492] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.041913 11755 ts_tablet_manager.cc:1403] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.007s
I20260925 01:50:07.042965 11755 raft_consensus.cc:359] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.044198 11755 raft_consensus.cc:385] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.044435 11755 raft_consensus.cc:740] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.044875 11755 consensus_queue.cc:260] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.046006 11755 ts_tablet_manager.cc:1434] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:07.046823 11755 tablet_bootstrap.cc:492] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.048848 11755 tablet_bootstrap.cc:654] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.050396 11344 tablet_service.cc:1511] Processing CreateTablet for tablet e36dd3b9f9fb4140ab1a46463c72cbe8 (DEFAULT_TABLE table=default.Table_3b54278b3e5c4b4d9e47c490f39d4e9d [id=9538ca3e438c48aabb0f4ff9d18b16f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.051256 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36dd3b9f9fb4140ab1a46463c72cbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.051301 11501 tablet_service.cc:1511] Processing CreateTablet for tablet e36dd3b9f9fb4140ab1a46463c72cbe8 (DEFAULT_TABLE table=default.Table_3b54278b3e5c4b4d9e47c490f39d4e9d [id=9538ca3e438c48aabb0f4ff9d18b16f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.051658 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36dd3b9f9fb4140ab1a46463c72cbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.053807 11355 tablet_service.cc:1511] Processing CreateTablet for tablet d9e250c2c5dc4bfbbaebce53b90dc8b2 (DEFAULT_TABLE table=default.Table_56311785b95e4e71a49b965b97bd7ca3 [id=7ab734772f734e9aa66e9b812dabbedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.054144 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e250c2c5dc4bfbbaebce53b90dc8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.056736 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3150980bb72435886486156aa98d342" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.056941 11516 raft_consensus.cc:2468] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:07.057358 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 507d06f04fb24c1abb9119a0fa5af141 (DEFAULT_TABLE table=default.Table_79a1a30d8d93482aa7135607c46b5b7e [id=2d09fc78e7a2467baef6ff4a12767443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.057677 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507d06f04fb24c1abb9119a0fa5af141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.058384 11493 tablet_service.cc:1511] Processing CreateTablet for tablet d9e250c2c5dc4bfbbaebce53b90dc8b2 (DEFAULT_TABLE table=default.Table_56311785b95e4e71a49b965b97bd7ca3 [id=7ab734772f734e9aa66e9b812dabbedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.058699 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e250c2c5dc4bfbbaebce53b90dc8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.062156 11212 tablet_service.cc:1511] Processing CreateTablet for tablet e5bc61637d944b60ba9e703e9894174c (DEFAULT_TABLE table=default.Table_167e60d2ec454ce38356ee349c14867b [id=ff94db776ce546be9ca23a60d0615e6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.062304 11359 tablet_service.cc:1511] Processing CreateTablet for tablet a5986ce928ab4d3e87cb592355ae5247 (DEFAULT_TABLE table=default.Table_dd2ebcec56d34289bf2ac59023ae3ea8 [id=5d3cd2b1614d4d318a9be6f0902029b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.062613 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bc61637d944b60ba9e703e9894174c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.062639 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5986ce928ab4d3e87cb592355ae5247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.066334 11495 tablet_service.cc:1511] Processing CreateTablet for tablet a5986ce928ab4d3e87cb592355ae5247 (DEFAULT_TABLE table=default.Table_dd2ebcec56d34289bf2ac59023ae3ea8 [id=5d3cd2b1614d4d318a9be6f0902029b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.066679 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5986ce928ab4d3e87cb592355ae5247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.067456 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 9e86bd9a65dd46f09d87ddd831552b59 (DEFAULT_TABLE table=default.Table_d3b5e1eb785749939261859f4fb504a9 [id=fa9b155147cd48e2b56817bdceeb357d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.067777 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e86bd9a65dd46f09d87ddd831552b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.078858 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 9e86bd9a65dd46f09d87ddd831552b59 (DEFAULT_TABLE table=default.Table_d3b5e1eb785749939261859f4fb504a9 [id=fa9b155147cd48e2b56817bdceeb357d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.079056 11204 tablet_service.cc:1511] Processing CreateTablet for tablet d9e250c2c5dc4bfbbaebce53b90dc8b2 (DEFAULT_TABLE table=default.Table_56311785b95e4e71a49b965b97bd7ca3 [id=7ab734772f734e9aa66e9b812dabbedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.079324 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e86bd9a65dd46f09d87ddd831552b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.079473 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e250c2c5dc4bfbbaebce53b90dc8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.082502 11220 tablet_service.cc:1511] Processing CreateTablet for tablet e36dd3b9f9fb4140ab1a46463c72cbe8 (DEFAULT_TABLE table=default.Table_3b54278b3e5c4b4d9e47c490f39d4e9d [id=9538ca3e438c48aabb0f4ff9d18b16f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.082952 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36dd3b9f9fb4140ab1a46463c72cbe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.086338 11215 tablet_service.cc:1511] Processing CreateTablet for tablet a5986ce928ab4d3e87cb592355ae5247 (DEFAULT_TABLE table=default.Table_dd2ebcec56d34289bf2ac59023ae3ea8 [id=5d3cd2b1614d4d318a9be6f0902029b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.086673 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5986ce928ab4d3e87cb592355ae5247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.086745 11212 tablet_service.cc:1511] Processing CreateTablet for tablet f30fbaa9db5144debf9cc5124c9bf9bd (DEFAULT_TABLE table=default.Table_f23b8482c3ce4904a2a54bad0536a288 [id=a9eaca16691b4511908b7291080c1935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.087168 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30fbaa9db5144debf9cc5124c9bf9bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.088522 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 507d06f04fb24c1abb9119a0fa5af141 (DEFAULT_TABLE table=default.Table_79a1a30d8d93482aa7135607c46b5b7e [id=2d09fc78e7a2467baef6ff4a12767443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.088884 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507d06f04fb24c1abb9119a0fa5af141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.089936 11495 tablet_service.cc:1511] Processing CreateTablet for tablet c97236543c96426e94a4b910e4891a20 (DEFAULT_TABLE table=default.Table_17e80afce4044b87b69f9e75284121f4 [id=afd011b7ff254ba3b036d45f5ddc3832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.090288 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97236543c96426e94a4b910e4891a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.092904 11342 tablet_service.cc:1511] Processing CreateTablet for tablet c97236543c96426e94a4b910e4891a20 (DEFAULT_TABLE table=default.Table_17e80afce4044b87b69f9e75284121f4 [id=afd011b7ff254ba3b036d45f5ddc3832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.093180 12964 raft_consensus.cc:493] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.093366 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97236543c96426e94a4b910e4891a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.093354 12964 raft_consensus.cc:515] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:07.094938 11456 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:07.095418 12964 leader_election.cc:290] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.097934 13140 raft_consensus.cc:493] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.098150 13140 raft_consensus.cc:515] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.098656 11754 tablet_bootstrap.cc:492] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.098798 11754 ts_tablet_manager.cc:1403] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.208s user 0.012s sys 0.000s
I20260925 01:50:07.099367 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.099629 11754 raft_consensus.cc:359] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.099779 11754 raft_consensus.cc:385] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.099821 11754 raft_consensus.cc:740] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:50:07.099998 11177 leader_election.cc:343] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.100507 13140 leader_election.cc:290] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.100560 11176 leader_election.cc:304] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:07.100829 13209 raft_consensus.cc:2804] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.100911 13209 raft_consensus.cc:493] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.100986 13209 raft_consensus.cc:3060] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.102118 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 507d06f04fb24c1abb9119a0fa5af141 (DEFAULT_TABLE table=default.Table_79a1a30d8d93482aa7135607c46b5b7e [id=2d09fc78e7a2467baef6ff4a12767443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.102536 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507d06f04fb24c1abb9119a0fa5af141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.103886 13209 raft_consensus.cc:515] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.104519 13209 leader_election.cc:290] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.105438 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3150980bb72435886486156aa98d342" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:07.106091 11177 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.107393 11755 tablet_bootstrap.cc:492] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.107561 11755 ts_tablet_manager.cc:1403] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.001s
I20260925 01:50:07.108269 11755 raft_consensus.cc:359] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.108448 11755 raft_consensus.cc:385] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.108528 11755 raft_consensus.cc:740] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.108748 11755 consensus_queue.cc:260] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.109267 11755 ts_tablet_manager.cc:1434] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:07.109556 11755 tablet_bootstrap.cc:492] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.110011 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 06f81b111fc9477bafd4889d40d08dd3 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.110852 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f81b111fc9477bafd4889d40d08dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.116982 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7b8aaa9dead44c7a88716274828db980" } modify_external_catalogs: true
I20260925 01:50:07.117195 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7b8aaa9dead44c7a88716274828db980" } modify_external_catalogs: true
I20260925 01:50:07.118687 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_126b13b368c348bea98d7d87748aaf1c" } modify_external_catalogs: true
I20260925 01:50:07.118775 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 06f81b111fc9477bafd4889d40d08dd3 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.118858 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_126b13b368c348bea98d7d87748aaf1c" } modify_external_catalogs: true
I20260925 01:50:07.119179 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f81b111fc9477bafd4889d40d08dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.120489 11755 tablet_bootstrap.cc:654] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.128577 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 05709373e8a54116813c28fafd022509 (DEFAULT_TABLE table=default.Table_f2b587e2f7a544ce9cbf186e3d68e345 [id=dccb43c80f864fe393e8ae136c264f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.128970 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05709373e8a54116813c28fafd022509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.136961 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 05709373e8a54116813c28fafd022509 (DEFAULT_TABLE table=default.Table_f2b587e2f7a544ce9cbf186e3d68e345 [id=dccb43c80f864fe393e8ae136c264f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.137487 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05709373e8a54116813c28fafd022509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.139700 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 064c6cbe77d0405abe16a9a53d842590 (DEFAULT_TABLE table=default.Table_6554cdebbe834c79b745a3509dfd52ca [id=883a04c99b0544129fd8e12f1150ad9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.140080 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064c6cbe77d0405abe16a9a53d842590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.147053 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 064c6cbe77d0405abe16a9a53d842590 (DEFAULT_TABLE table=default.Table_6554cdebbe834c79b745a3509dfd52ca [id=883a04c99b0544129fd8e12f1150ad9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.147549 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064c6cbe77d0405abe16a9a53d842590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.148413 11359 tablet_service.cc:1511] Processing CreateTablet for tablet b81a0f0e096f4bdaaedb2122c3487079 (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.149868 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72f376af5c48d893b30640e895fa04 (DEFAULT_TABLE table=default.Table_75bca35046524ed68a35b985cdb07db5 [id=444012a5089f420b8e2a6cea9da2ca6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.150427 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81a0f0e096f4bdaaedb2122c3487079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.150595 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72f376af5c48d893b30640e895fa04 (DEFAULT_TABLE table=default.Table_75bca35046524ed68a35b985cdb07db5 [id=444012a5089f420b8e2a6cea9da2ca6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.150883 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72f376af5c48d893b30640e895fa04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.154342 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72f376af5c48d893b30640e895fa04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.158341 13229 tablet.cc:1751] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:07.100000 11754 consensus_queue.cc:260] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.160567 11754 ts_tablet_manager.cc:1434] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.062s user 0.002s sys 0.000s
I20260925 01:50:07.164088 11494 tablet_service.cc:1511] Processing CreateTablet for tablet b81a0f0e096f4bdaaedb2122c3487079 (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.164465 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81a0f0e096f4bdaaedb2122c3487079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.188117 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 9579ea0a36824e9c819c17488ee852c4 (DEFAULT_TABLE table=default.Table_17c3330e01fe42d2aabc2343b927861e [id=a57dada5c8084652990d94c3c05eb5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.188669 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9579ea0a36824e9c819c17488ee852c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.189448 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.189563 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2f5603ea23446c9db47fd78d0c7854 (DEFAULT_TABLE table=default.Table_e9d27af68a134e74b9ab639ff0ebd044 [id=6d267fe10abf4178bda800124d93be42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.189739 11521 raft_consensus.cc:2468] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:07.189878 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2f5603ea23446c9db47fd78d0c7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.190420 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 0727c3a2271c445b9d2c54c2d43b7b01 (DEFAULT_TABLE table=default.Table_4dc2aafe1f934115beec31af1098d148 [id=156d277bcfff4dfb9c5f255b66ac410e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.190747 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0727c3a2271c445b9d2c54c2d43b7b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.198714 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 9579ea0a36824e9c819c17488ee852c4 (DEFAULT_TABLE table=default.Table_17c3330e01fe42d2aabc2343b927861e [id=a57dada5c8084652990d94c3c05eb5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.198894 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 0727c3a2271c445b9d2c54c2d43b7b01 (DEFAULT_TABLE table=default.Table_4dc2aafe1f934115beec31af1098d148 [id=156d277bcfff4dfb9c5f255b66ac410e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.199826 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9579ea0a36824e9c819c17488ee852c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.202210 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0727c3a2271c445b9d2c54c2d43b7b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.207048 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2f5603ea23446c9db47fd78d0c7854 (DEFAULT_TABLE table=default.Table_e9d27af68a134e74b9ab639ff0ebd044 [id=6d267fe10abf4178bda800124d93be42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.207432 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2f5603ea23446c9db47fd78d0c7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.210595 11755 tablet_bootstrap.cc:492] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.210841 11755 ts_tablet_manager.cc:1403] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.101s user 0.015s sys 0.010s
I20260925 01:50:07.211747 11755 raft_consensus.cc:359] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.212147 11755 raft_consensus.cc:385] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.212256 11755 raft_consensus.cc:740] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.212563 11755 consensus_queue.cc:260] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.213294 11755 ts_tablet_manager.cc:1434] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260925 01:50:07.219226 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 56700.4us
I20260925 01:50:07.220103 11754 tablet_bootstrap.cc:492] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.222432 11755 tablet_bootstrap.cc:492] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.225883 11755 tablet_bootstrap.cc:654] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.228778 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
W20260925 01:50:07.235937 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0226f482c8ff49ce976490e6aadfcee4 consensus state has no leader
I20260925 01:50:07.241173 11680 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 0575861dd3d6437284cc183acb87af0a (table default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086]). Expected version 2 got 0
I20260925 01:50:07.253928 11755 tablet_bootstrap.cc:492] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.254163 11755 ts_tablet_manager.cc:1403] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.000s
I20260925 01:50:07.255125 11755 raft_consensus.cc:359] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.255389 11755 raft_consensus.cc:385] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.255566 11755 raft_consensus.cc:740] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.255904 11755 consensus_queue.cc:260] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.256758 11755 ts_tablet_manager.cc:1434] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:07.257236 11755 tablet_bootstrap.cc:492] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.266774 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3150980bb72435886486156aa98d342" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:07.267040 11521 raft_consensus.cc:3060] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.269968 11521 raft_consensus.cc:2468] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:07.260614 11177 consensus_peers.cc:597] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:07.262192 11220 tablet_service.cc:1511] Processing CreateTablet for tablet c97236543c96426e94a4b910e4891a20 (DEFAULT_TABLE table=default.Table_17e80afce4044b87b69f9e75284121f4 [id=afd011b7ff254ba3b036d45f5ddc3832]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.275216 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97236543c96426e94a4b910e4891a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.262813 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 06f81b111fc9477bafd4889d40d08dd3 (DEFAULT_TABLE table=default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.280364 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f81b111fc9477bafd4889d40d08dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.283048 11755 tablet_bootstrap.cc:654] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.263247 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 05709373e8a54116813c28fafd022509 (DEFAULT_TABLE table=default.Table_f2b587e2f7a544ce9cbf186e3d68e345 [id=dccb43c80f864fe393e8ae136c264f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.263748 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 064c6cbe77d0405abe16a9a53d842590 (DEFAULT_TABLE table=default.Table_6554cdebbe834c79b745a3509dfd52ca [id=883a04c99b0544129fd8e12f1150ad9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.287086 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 064c6cbe77d0405abe16a9a53d842590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.263893 11222 tablet_service.cc:1511] Processing CreateTablet for tablet b81a0f0e096f4bdaaedb2122c3487079 (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.290383 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b81a0f0e096f4bdaaedb2122c3487079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.290815 11753 tablet_bootstrap.cc:492] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:07.290956 11753 ts_tablet_manager.cc:1403] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.298s user 0.045s sys 0.043s
I20260925 01:50:07.264101 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 0a72f376af5c48d893b30640e895fa04 (DEFAULT_TABLE table=default.Table_75bca35046524ed68a35b985cdb07db5 [id=444012a5089f420b8e2a6cea9da2ca6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.293319 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a72f376af5c48d893b30640e895fa04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.264209 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 9579ea0a36824e9c819c17488ee852c4 (DEFAULT_TABLE table=default.Table_17c3330e01fe42d2aabc2343b927861e [id=a57dada5c8084652990d94c3c05eb5cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.294332 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9579ea0a36824e9c819c17488ee852c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.264832 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 6f2f5603ea23446c9db47fd78d0c7854 (DEFAULT_TABLE table=default.Table_e9d27af68a134e74b9ab639ff0ebd044 [id=6d267fe10abf4178bda800124d93be42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.298622 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f2f5603ea23446c9db47fd78d0c7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.265522 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 0727c3a2271c445b9d2c54c2d43b7b01 (DEFAULT_TABLE table=default.Table_4dc2aafe1f934115beec31af1098d148 [id=156d277bcfff4dfb9c5f255b66ac410e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:07.299249 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0727c3a2271c445b9d2c54c2d43b7b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.302794 13101 raft_consensus.cc:493] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.302848 11753 raft_consensus.cc:359] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.303068 11753 raft_consensus.cc:385] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.303005 13101 raft_consensus.cc:515] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.303131 11753 raft_consensus.cc:740] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.303385 11753 consensus_queue.cc:260] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.303802 13101 leader_election.cc:290] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.304031 11753 ts_tablet_manager.cc:1434] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260925 01:50:07.304375 11753 tablet_bootstrap.cc:492] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:07.319953 11753 tablet_bootstrap.cc:654] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.321126 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05709373e8a54116813c28fafd022509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:07.339632 11946 ts_tablet_manager.cc:1929] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:07.341199 11754 tablet_bootstrap.cc:654] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.343194 11755 tablet_bootstrap.cc:492] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.343348 11755 ts_tablet_manager.cc:1403] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.005s
I20260925 01:50:07.344151 11755 raft_consensus.cc:359] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.344360 11755 raft_consensus.cc:385] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.344426 11755 raft_consensus.cc:740] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.344659 11755 consensus_queue.cc:260] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.345343 11755 ts_tablet_manager.cc:1434] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:07.345842 11755 tablet_bootstrap.cc:492] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.346279 11753 tablet_bootstrap.cc:492] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:07.346431 11753 ts_tablet_manager.cc:1403] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.005s
I20260925 01:50:07.348006 13101 raft_consensus.cc:493] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.348132 13101 raft_consensus.cc:515] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.348747 13101 leader_election.cc:290] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.349144 11953 ts_tablet_manager.cc:1929] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:07.349277 11953 log.cc:1199] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/596f8ddbcd16458aa4f287f4f11282a1
I20260925 01:50:07.349615 11953 ts_tablet_manager.cc:1950] T 596f8ddbcd16458aa4f287f4f11282a1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:07.350150 11755 tablet_bootstrap.cc:654] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.350630 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 513) took 7557 ms. Trace:
I20260925 01:50:07.350790 11953 rpcz_store.cc:276] 0925 01:49:59.793006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.794838 (+ 1832us) service_pool.cc:224] Handling call
0925 01:50:06.806532 (+7011694us) ts_tablet_manager.cc:1151] Deleting tablet 596f8ddbcd16458aa4f287f4f11282a1
0925 01:50:06.806684 (+ 152us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.071457 (+264773us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.349087 (+277630us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.350604 (+ 1517us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7010529}
I20260925 01:50:07.358850 11753 raft_consensus.cc:359] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.359081 11753 raft_consensus.cc:385] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.359141 11753 raft_consensus.cc:740] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.359357 11753 consensus_queue.cc:260] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.359839 11753 ts_tablet_manager.cc:1434] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260925 01:50:07.359910 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aef1efeefaf4495bb03c12af5e28505b" } modify_external_catalogs: true
I20260925 01:50:07.360140 11753 tablet_bootstrap.cc:492] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:07.360121 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aef1efeefaf4495bb03c12af5e28505b" } modify_external_catalogs: true
I20260925 01:50:07.360677 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet 0575861dd3d6437284cc183acb87af0a from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:07.362999 11753 tablet_bootstrap.cc:654] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.369652 13210 raft_consensus.cc:493] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.369788 13210 raft_consensus.cc:515] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.370512 13210 leader_election.cc:290] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.371685 13210 raft_consensus.cc:493] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.371814 13210 raft_consensus.cc:515] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.372335 13210 leader_election.cc:290] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.374190 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 596f8ddbcd16458aa4f287f4f11282a1 (table default.Table_196b02edd23b4384aef87a7819365849 [id=2a64ecd7c8aa4c058cf50c57d0373c3c]) successfully deleted
I20260925 01:50:07.374742 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 509) took 7597 ms. Trace:
I20260925 01:50:07.374830 11176 leader_election.cc:304] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:07.375042 13210 raft_consensus.cc:2804] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.375099 13210 raft_consensus.cc:493] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.375156 13210 raft_consensus.cc:3060] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.374920 11953 rpcz_store.cc:276] 0925 01:49:59.777363 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.777516 (+ 153us) service_pool.cc:224] Handling call
0925 01:50:07.374524 (+7597008us) ts_tablet_manager.cc:1151] Deleting tablet 5c1c05b5a87e43d38a24f63242415fd7
0925 01:50:07.374539 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.374718 (+ 179us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7578398}
W20260925 01:50:07.375622 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5c1c05b5a87e43d38a24f63242415fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c1c05b5a87e43d38a24f63242415fd7 already in progress: creating tablet
I20260925 01:50:07.376168 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 514) took 7569 ms. Trace:
I20260925 01:50:07.376392 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae948bf42ae34a7ab72112d5f1f02585" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.376362 11953 rpcz_store.cc:276] 0925 01:49:59.806268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.807571 (+ 1303us) service_pool.cc:224] Handling call
0925 01:50:07.375976 (+7568405us) ts_tablet_manager.cc:1151] Deleting tablet 941fd8333f6d45878677e55ff6948bbf
0925 01:50:07.375987 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.376126 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7568163}
I20260925 01:50:07.376729 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d23c5d52faa4b6da2996fabb16bd74a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:07.377038 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 941fd8333f6d45878677e55ff6948bbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 941fd8333f6d45878677e55ff6948bbf already in progress: creating tablet
W20260925 01:50:07.377427 11177 leader_election.cc:343] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.377561 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 511) took 7584 ms. Trace:
W20260925 01:50:07.377629 11177 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.377650 11953 rpcz_store.cc:276] 0925 01:49:59.792810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:59.812372 (+ 19562us) service_pool.cc:224] Handling call
0925 01:50:07.377390 (+7565018us) ts_tablet_manager.cc:1151] Deleting tablet e457c4ab4e814fc4be11ced6ca69284f
0925 01:50:07.377422 (+ 32us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.377522 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7564570}
I20260925 01:50:07.378108 13210 raft_consensus.cc:515] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:07.378401 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e457c4ab4e814fc4be11ced6ca69284f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e457c4ab4e814fc4be11ced6ca69284f already in progress: creating tablet
I20260925 01:50:07.378758 13210 leader_election.cc:290] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.378942 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 516) took 7277 ms. Trace:
I20260925 01:50:07.379117 11176 leader_election.cc:304] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:07.380671 12964 raft_consensus.cc:493] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.380818 12964 raft_consensus.cc:515] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.381415 12964 leader_election.cc:290] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.381599 13210 raft_consensus.cc:2804] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.381711 13210 raft_consensus.cc:697] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:07.382046 13210 consensus_queue.cc:237] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:07.382813 11456 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:07.382944 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:07.383724 11177 leader_election.cc:343] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.339915 11946 log.cc:1199] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/95ac080782664fca8661c188ab822e89
I20260925 01:50:07.384393 11946 ts_tablet_manager.cc:1950] T 95ac080782664fca8661c188ab822e89 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:07.385223 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 659) took 3285 ms. Trace:
I20260925 01:50:07.385380 11946 rpcz_store.cc:276] 0925 01:50:04.099879 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.099990 (+ 111us) service_pool.cc:224] Handling call
0925 01:50:06.885464 (+2785474us) ts_tablet_manager.cc:1151] Deleting tablet 95ac080782664fca8661c188ab822e89
0925 01:50:06.885476 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:06.977739 (+ 92263us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.339563 (+361824us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.385205 (+ 45642us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2785163}
I20260925 01:50:07.385787 13101 raft_consensus.cc:493] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.385911 13101 raft_consensus.cc:515] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:07.386355 11946 tablet_replica.cc:333] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:07.386478 13101 leader_election.cc:290] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:07.386802 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 95ac080782664fca8661c188ab822e89 (table default.Table_40519dcfbe2e470ca48f0351bf0ea7cd [id=9bdac40ff34c4ea8aa4fa8da91357cbf]) successfully deleted
I20260925 01:50:07.389386 13101 raft_consensus.cc:493] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:07.389547 13101 raft_consensus.cc:515] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.390282 13101 leader_election.cc:290] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.398537 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d8bff0bd6b85436a97a7ead19ee47e1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.399422 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8bff0bd6b85436a97a7ead19ee47e1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.399673 13126 log.cc:826] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Log is configured to *not* fsync() on all Append() calls
I20260925 01:50:07.400136 11754 tablet_bootstrap.cc:492] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.400374 11754 ts_tablet_manager.cc:1403] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.180s user 0.004s sys 0.000s
W20260925 01:50:07.401147 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0652894c66c5413ca0f54e84c8fca89a consensus state has no leader
I20260925 01:50:07.401727 11754 raft_consensus.cc:359] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:07.401691 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f40821075d3c4668b7099d6fceee3c21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:07.402101 11754 raft_consensus.cc:385] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.402215 11754 raft_consensus.cc:740] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:50:07.402468 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f40821075d3c4668b7099d6fceee3c21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.402618 11754 consensus_queue.cc:260] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:07.403913 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet cea3ad181ffa42d694a609bf99001c75
I20260925 01:50:07.404381 11754 ts_tablet_manager.cc:1434] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260925 01:50:07.404953 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bdec13308f734fc98b23b4015fdf0b7f" } modify_external_catalogs: true
I20260925 01:50:07.405386 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet cea3ad181ffa42d694a609bf99001c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:07.405678 11946 raft_consensus.cc:2243] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:07.406108 11946 raft_consensus.cc:2272] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.406493 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet cea3ad181ffa42d694a609bf99001c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.406827 11753 tablet_bootstrap.cc:492] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:07.406985 11753 ts_tablet_manager.cc:1403] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.002s
I20260925 01:50:07.407516 11946 ts_tablet_manager.cc:1916] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.407974 11753 raft_consensus.cc:359] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.408181 11753 raft_consensus.cc:385] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.408246 11753 raft_consensus.cc:740] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.408243 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bdec13308f734fc98b23b4015fdf0b7f" } modify_external_catalogs: true
I20260925 01:50:07.379083 11953 rpcz_store.cc:276] 0925 01:50:00.101085 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.101155 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:07.378697 (+7277542us) ts_tablet_manager.cc:1151] Deleting tablet 6e644bfe06ff4ca89066b1ded01f2b90
0925 01:50:07.378733 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.378892 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7277363}
I20260925 01:50:07.408492 11753 consensus_queue.cc:260] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.409117 11753 ts_tablet_manager.cc:1434] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:07.409435 11753 tablet_bootstrap.cc:492] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:07.418444 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae948bf42ae34a7ab72112d5f1f02585" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.418706 11521 raft_consensus.cc:2468] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:07.419065 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d23c5d52faa4b6da2996fabb16bd74a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.419242 11516 raft_consensus.cc:2468] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:07.419482 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:07.419600 11519 raft_consensus.cc:3060] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.419760 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 518) took 7311 ms. Trace:
I20260925 01:50:07.419852 11953 rpcz_store.cc:276] 0925 01:50:00.108034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.108117 (+ 83us) service_pool.cc:224] Handling call
0925 01:50:07.409453 (+7301336us) ts_tablet_manager.cc:1151] Deleting tablet 2a37a6deaeb24c99824b62fbb2d603b1
0925 01:50:07.419597 (+ 10144us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.419734 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7301116}
I20260925 01:50:07.420073 11753 tablet_bootstrap.cc:654] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.415861 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet cea3ad181ffa42d694a609bf99001c75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.421375 11754 tablet_bootstrap.cc:492] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.422612 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 519) took 7313 ms. Trace:
I20260925 01:50:07.423415 13101 raft_consensus.cc:493] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.423990 13101 raft_consensus.cc:515] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.424736 13101 leader_election.cc:290] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.425031 11953 rpcz_store.cc:276] 0925 01:50:00.109167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.109243 (+ 76us) service_pool.cc:224] Handling call
0925 01:50:07.420291 (+7311048us) ts_tablet_manager.cc:1151] Deleting tablet e40083a885974e3595ec2fb5b16d4a5d
0925 01:50:07.422435 (+ 2144us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.422583 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7310827}
I20260925 01:50:07.427748 11519 raft_consensus.cc:2468] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:07.431870 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 6e644bfe06ff4ca89066b1ded01f2b90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e644bfe06ff4ca89066b1ded01f2b90 already in progress: creating tablet
W20260925 01:50:07.432337 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2a37a6deaeb24c99824b62fbb2d603b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a37a6deaeb24c99824b62fbb2d603b1 already in progress: creating tablet
I20260925 01:50:07.432737 11755 tablet_bootstrap.cc:492] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.432893 11755 ts_tablet_manager.cc:1403] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.087s user 0.006s sys 0.010s
I20260925 01:50:07.434599 11755 raft_consensus.cc:359] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.434778 11755 raft_consensus.cc:385] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.434837 11755 raft_consensus.cc:740] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.435072 11755 consensus_queue.cc:260] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.435588 11755 ts_tablet_manager.cc:1434] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:07.438395 11754 tablet_bootstrap.cc:654] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:07.438618 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e40083a885974e3595ec2fb5b16d4a5d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e40083a885974e3595ec2fb5b16d4a5d already in progress: creating tablet
I20260925 01:50:07.442987 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 6a773feeb51349a084efedfd338eafe0 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:07.443564 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ada1f063f511450c9c742f4b0fb7be82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.444136 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ada1f063f511450c9c742f4b0fb7be82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.445338 11675 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet b58cc09aac554ab2a3a1792a8d9f7a0f
I20260925 01:50:07.445696 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6a348a5f51504bd0bea192d30afde312" } new_table_name: "default.Table_2ede92a7925546e2b9e23ca64229b818" modify_external_catalogs: true
I20260925 01:50:07.446362 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 519d954b6a214d0b8e960e128cfcea10
I20260925 01:50:07.447132 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ef599a1535564aafa91d077e4d74ef35" } new_table_name: "default.Table_c7dca73593d14d4abea25d8c1fd77cb0" modify_external_catalogs: true
I20260925 01:50:07.449501 11674 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 4 got 0
I20260925 01:50:07.450192 11674 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 6a9ccd099cba4b92909bb17c45dfce8a (table default.Table_a6b67f9415ae41dbaf3903dbbaec308f [id=c23a94a77b36437f843f323488d4ed42]). Expected version 1 got 0
I20260925 01:50:07.451098 11753 tablet_bootstrap.cc:492] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:07.451277 11753 ts_tablet_manager.cc:1403] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.003s
I20260925 01:50:07.452275 11753 raft_consensus.cc:359] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.452471 11753 raft_consensus.cc:385] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.452546 11753 raft_consensus.cc:740] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.454493 11753 consensus_queue.cc:260] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.455792 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 519d954b6a214d0b8e960e128cfcea10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:07.466756 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet cea3ad181ffa42d694a609bf99001c75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cea3ad181ffa42d694a609bf99001c75 already in progress: creating tablet
I20260925 01:50:07.468398 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 8234c4d0c72541158826416e40f34031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.468830 13245 tablet_replica.cc:333] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.469161 13245 raft_consensus.cc:2243] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:07.469501 13245 pending_rounds.cc:70] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:07.469607 13245 pending_rounds.cc:77] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072923365449728 op_type: NO_OP noop_request { }
I20260925 01:50:07.469803 13245 raft_consensus.cc:2889] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:07.469960 13245 raft_consensus.cc:2272] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.470752 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.471053 13245 ts_tablet_manager.cc:1916] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.471868 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet fbd4b231f89a48e59e5eb3cf3976385a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.474368 11680 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_41b14ce4b2cc4cb6939c0c7fffce1ed8 [id=f0acdfabaee64c329976f1cf227f0668] alter complete (version 1)
I20260925 01:50:07.475020 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5122b8c24d3442a1a52ff0b003d65ffb
I20260925 01:50:07.475209 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.475898 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0575861dd3d6437284cc183acb87af0a
I20260925 01:50:07.476395 11672 catalog_manager.cc:6934] ReplaceTablet: tablet 0575861dd3d6437284cc183acb87af0a deleted and replaced by tablet 1f97bbad6b7348caaed4d745343b811c
I20260925 01:50:07.477208 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:07.477365 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.477424 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet 24cd89d238bf4220a48ecdf59cca5e6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:07.477639 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 0575861dd3d6437284cc183acb87af0a with delete_type TABLET_DATA_DELETED (replaced by tablet 1f97bbad6b7348caaed4d745343b811c) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:07.477842 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 0575861dd3d6437284cc183acb87af0a with delete_type TABLET_DATA_DELETED (replaced by tablet 1f97bbad6b7348caaed4d745343b811c) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.478552 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f37b8469a497ba3fe504cb21105d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:07.478926 11674 catalog_manager.cc:6038] Failed to send AlterTable RPC for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9], current schema version=4): Not found: failed to reset TS proxy: No leader found: Tablet e1001e66d2984d9187443adcc42e5856 consensus state has no leader
I20260925 01:50:07.479202 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet dfde700aff8049f4b10c46059da6907f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.479809 13245 ts_tablet_manager.cc:1929] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:07.479935 13245 log.cc:1199] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8234c4d0c72541158826416e40f34031
I20260925 01:50:07.480012 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 519d954b6a214d0b8e960e128cfcea10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.480304 13245 ts_tablet_manager.cc:1950] T 8234c4d0c72541158826416e40f34031 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:07.480835 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.481997 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 0575861dd3d6437284cc183acb87af0a with delete_type TABLET_DATA_DELETED (replaced by tablet 1f97bbad6b7348caaed4d745343b811c) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.482247 11176 leader_election.cc:304] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:07.482861 13210 raft_consensus.cc:2804] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.482935 13210 raft_consensus.cc:493] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.483011 13210 raft_consensus.cc:3060] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.483047 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.485805 13210 raft_consensus.cc:515] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.487226 13210 leader_election.cc:290] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.487658 11176 leader_election.cc:304] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:07.487674 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 519d954b6a214d0b8e960e128cfcea10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:07.490404 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 4 got 0
I20260925 01:50:07.491251 13210 raft_consensus.cc:2804] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.491338 13210 raft_consensus.cc:493] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.491403 13210 raft_consensus.cc:3060] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.491323 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_91f5d26231524dd6ad91b6d49e5e9d14" } new_table_name: "default.Table_e998f52add6a48c286e13a889e780f52" modify_external_catalogs: true
I20260925 01:50:07.491685 11680 catalog_manager.cc:5838] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:07.492107 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 9feb00f881ed4518a32e08d170080a46 (table default.Table_a9bdcb0034c84520a7d9881bc8927159 [id=372975f12d544860a00670c2763bbbb4]). Expected version 3 got 0
I20260925 01:50:07.490808 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_885c17a19ebe40b08339efd10d1a9f96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.493148 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_885c17a19ebe40b08339efd10d1a9f96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.491204 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_37f09900657f43d79f9eca3fe69932f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.494462 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37f09900657f43d79f9eca3fe69932f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.494681 13210 raft_consensus.cc:515] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.494817 11674 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 60411b0feafe4fef9c4fdc364163f1df (table default.Table_9c96e3747586472d861731441a16b7eb [id=0848b51bdadb45b5b1a5357208cfcd58]). Expected version 4 got 0
I20260925 01:50:07.496327 13210 leader_election.cc:290] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.496513 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.496765 11176 leader_election.cc:304] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:07.497041 13210 raft_consensus.cc:2804] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.497536 13210 raft_consensus.cc:697] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:07.497843 13210 consensus_queue.cc:237] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.499485 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet d3150980bb72435886486156aa98d342 with delete_type TABLET_DATA_DELETED (replaced by tablet 49692d2824a34f48a4dcefad8c89618b) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.500052 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae948bf42ae34a7ab72112d5f1f02585" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:07.500161 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d23c5d52faa4b6da2996fabb16bd74a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:07.500239 11519 raft_consensus.cc:3060] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.500314 11516 raft_consensus.cc:3060] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.502517 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4d14ab205bba4f9d92797d34ab82f13d
I20260925 01:50:07.503167 11516 raft_consensus.cc:2468] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:07.503566 11519 raft_consensus.cc:2468] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:07.503830 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet cdd615a0405742fcb472d92829a8d7c7 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:07.504172 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dcf6b955044a4f3ba2e8c3d9c23bee04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.504740 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcf6b955044a4f3ba2e8c3d9c23bee04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:07.505167 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1cae40ea83e429f8d50958dcd0cdded consensus state has no leader
W20260925 01:50:07.505509 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db20c20da0ec4785a2a3a18aba109b8f consensus state has no leader
I20260925 01:50:07.505571 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d14ab205bba4f9d92797d34ab82f13d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.506485 12964 raft_consensus.cc:493] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.506619 12964 raft_consensus.cc:515] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.506703 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b28d944249da44c997013470672b2958" } new_table_name: "default.Table_c326862997624b5296241dd69ff7984e" modify_external_catalogs: true
I20260925 01:50:07.507225 12964 leader_election.cc:290] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.507973 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_72b9bf9e8daa4d8ba25863cf74ba0563"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:07.508077 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:07.508648 11456 leader_election.cc:343] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.508682 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72b9bf9e8daa4d8ba25863cf74ba0563 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.509070 11176 leader_election.cc:304] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.509371 13209 raft_consensus.cc:2804] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.509400 11176 leader_election.cc:304] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.509501 13209 raft_consensus.cc:697] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:07.509732 13209 consensus_queue.cc:237] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.510349 13245 tablet_replica.cc:333] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.510552 13245 raft_consensus.cc:2243] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:07.510723 13245 raft_consensus.cc:2272] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.510769 13140 raft_consensus.cc:2804] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.510848 13140 raft_consensus.cc:697] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:07.511049 13140 consensus_queue.cc:237] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.511232 13245 ts_tablet_manager.cc:1916] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.513653 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d14ab205bba4f9d92797d34ab82f13d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:07.514761 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d14ab205bba4f9d92797d34ab82f13d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.528461 11753 ts_tablet_manager.cc:1434] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.077s user 0.001s sys 0.001s
I20260925 01:50:07.532641 11374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae948bf42ae34a7ab72112d5f1f02585" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:07.533041 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d23c5d52faa4b6da2996fabb16bd74a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:07.533720 11177 leader_election.cc:343] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.533943 11177 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.539430 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet 8e28aeabdf724784b8ed27535ea0701b from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:07.540730 11753 tablet_bootstrap.cc:492] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:07.545629 11755 tablet_bootstrap.cc:492] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.547174 11755 tablet_bootstrap.cc:654] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.551666 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:07.555750 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 517) took 7448 ms. Trace:
I20260925 01:50:07.560060 11953 rpcz_store.cc:276] 0925 01:50:00.106960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.112485 (+ 5525us) service_pool.cc:224] Handling call
0925 01:50:07.430762 (+7318277us) ts_tablet_manager.cc:1151] Deleting tablet 11a0a886d73442bd9753df870acf63f7
0925 01:50:07.526119 (+ 95357us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.555726 (+ 29607us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7317952}
I20260925 01:50:07.560510 13245 ts_tablet_manager.cc:1929] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:07.560727 13245 log.cc:1199] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:50:07.561089 13245 ts_tablet_manager.cc:1950] T 5b11c6526dbc4177b3a54b3c952bbd31 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:07.561581 13245 tablet_replica.cc:333] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.561813 13245 raft_consensus.cc:2243] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:07.561995 13245 raft_consensus.cc:2272] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:07.562579 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 11a0a886d73442bd9753df870acf63f7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11a0a886d73442bd9753df870acf63f7 already in progress: creating tablet
I20260925 01:50:07.562933 13245 ts_tablet_manager.cc:1916] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.563133 11953 tablet_replica.cc:333] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:07.565811 11753 tablet_bootstrap.cc:654] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.569653 13245 ts_tablet_manager.cc:1929] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:07.569774 13245 log.cc:1199] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/fbd4b231f89a48e59e5eb3cf3976385a
I20260925 01:50:07.572943 12964 raft_consensus.cc:493] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.573096 12964 raft_consensus.cc:515] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.573685 12964 leader_election.cc:290] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.574841 12964 raft_consensus.cc:493] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.574955 12964 raft_consensus.cc:515] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.575434 12964 leader_election.cc:290] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.576479 11755 tablet_bootstrap.cc:492] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.576615 11755 ts_tablet_manager.cc:1403] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.004s
I20260925 01:50:07.577521 11755 raft_consensus.cc:359] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.577684 11755 raft_consensus.cc:385] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.577729 11755 raft_consensus.cc:740] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.577920 11755 consensus_queue.cc:260] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.578608 11755 ts_tablet_manager.cc:1434] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:07.578914 11755 tablet_bootstrap.cc:492] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.580480 11755 tablet_bootstrap.cc:654] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.581552 13101 raft_consensus.cc:493] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.581704 13101 raft_consensus.cc:515] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.582551 13101 leader_election.cc:290] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.585737 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e96576354fe46bf9bfcde18f0a53390" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.585938 11519 raft_consensus.cc:2468] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:07.575137 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d253f8b1e4ac41388a885178f2ed0f40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:07.576154 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:07.586913 13245 ts_tablet_manager.cc:1950] T fbd4b231f89a48e59e5eb3cf3976385a P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:50:07.586898 11456 leader_election.cc:343] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.587136 11456 leader_election.cc:343] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.591122 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d50e428bfc46caa130f96ccc7e8f40" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.593722 11953 raft_consensus.cc:2243] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:07.593998 11953 raft_consensus.cc:2272] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.594657 11953 ts_tablet_manager.cc:1916] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.594974 11753 tablet_bootstrap.cc:492] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:07.595113 11753 ts_tablet_manager.cc:1403] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.003s
I20260925 01:50:07.595144 13245 tablet_replica.cc:333] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.595395 13245 raft_consensus.cc:2243] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:07.595649 13245 pending_rounds.cc:70] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:07.595705 13245 pending_rounds.cc:77] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072926762299392 op_type: NO_OP noop_request { }
I20260925 01:50:07.595813 13245 raft_consensus.cc:2889] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:07.595908 13245 raft_consensus.cc:2272] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.596645 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:07.598340 11177 consensus_peers.cc:597] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:07.601037 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5276072bbeca403fb06566b4a43489a0 consensus state has no leader
I20260925 01:50:07.604511 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3ce6bd366a584b9c854e974ae30fe203"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.605379 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ce6bd366a584b9c854e974ae30fe203 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.607628 13245 ts_tablet_manager.cc:1916] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.615453 13245 ts_tablet_manager.cc:1929] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:07.616011 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_76ddcad4f1a84ce599a5c29562a9ae9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.617112 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76ddcad4f1a84ce599a5c29562a9ae9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.620370 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6b0927490fa04b2e9766f07ec9ca0e2a" } new_table_name: "default.Table_500b95f7b4bf49b7bc5fb405085bcc85" modify_external_catalogs: true
I20260925 01:50:07.595920 11753 raft_consensus.cc:359] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.597146 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "519d954b6a214d0b8e960e128cfcea10" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.631225 11519 raft_consensus.cc:2393] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:50:07.631728 11753 raft_consensus.cc:385] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.631834 11753 raft_consensus.cc:740] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.632129 11753 consensus_queue.cc:260] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.632822 11753 ts_tablet_manager.cc:1434] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260925 01:50:07.619192 13210 raft_consensus.cc:493] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.642333 13210 raft_consensus.cc:515] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.643060 13210 leader_election.cc:290] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.643878 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1001e66d2984d9187443adcc42e5856" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.646191 11753 tablet_bootstrap.cc:492] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:07.648752 11753 tablet_bootstrap.cc:654] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:07.649861 11177 leader_election.cc:343] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.650629 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 141236us
I20260925 01:50:07.651072 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8234c4d0c72541158826416e40f34031 (table default.Table_69dd9b3d7d624415aacea6486cb9caeb [id=dfef0ea9809c46c8971e29b2f080e7df]) successfully deleted
I20260925 01:50:07.651623 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 5b11c6526dbc4177b3a54b3c952bbd31 (table default.Table_3dbfc023733e4f1ba765a6ad09ad8de8 [id=751698529dcb4a9c8d8806958926ecde]) successfully deleted
I20260925 01:50:07.652207 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet fbd4b231f89a48e59e5eb3cf3976385a (table default.Table_35c4ed0e87a84f229968365f06717746 [id=b28ab41a090b4b4ba73898ff85d54d07]) successfully deleted
I20260925 01:50:07.652953 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1001e66d2984d9187443adcc42e5856" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.653155 11519 raft_consensus.cc:2468] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:07.654189 11176 leader_election.cc:304] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:07.654832 13210 raft_consensus.cc:2804] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.654909 13210 raft_consensus.cc:493] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.654968 13210 raft_consensus.cc:3060] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.639019 11754 tablet_bootstrap.cc:492] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.642186 13245 log.cc:1199] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:50:07.655335 11754 ts_tablet_manager.cc:1403] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.234s user 0.008s sys 0.008s
I20260925 01:50:07.655608 13245 ts_tablet_manager.cc:1950] T 5d23c5d52faa4b6da2996fabb16bd74a P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:07.656078 11754 raft_consensus.cc:359] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.656225 11754 raft_consensus.cc:385] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.656271 11754 raft_consensus.cc:740] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.656579 13245 tablet_replica.cc:333] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.656826 13245 raft_consensus.cc:2243] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:07.657006 13245 raft_consensus.cc:2272] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.657589 13245 ts_tablet_manager.cc:1916] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.657735 13210 raft_consensus.cc:515] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.660706 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f1d2d998d834c21ab83694daae37520 with delete_type TABLET_DATA_DELETED (replaced by tablet 4930edeb2edd4e7494dbf1761b5d20c0) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.661422 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 with delete_type TABLET_DATA_DELETED (replaced by tablet aaa2f7ef888846ec9667916ba47084db) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.661537 13210 leader_election.cc:290] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.665333 13245 ts_tablet_manager.cc:1929] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:07.665416 13162 raft_consensus.cc:493] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.665571 13162 raft_consensus.cc:515] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.666581 13162 leader_election.cc:290] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.667330 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:07.667534 11754 consensus_queue.cc:260] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.673087 11754 ts_tablet_manager.cc:1434] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
W20260925 01:50:07.673148 11456 leader_election.cc:343] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.673454 13245 log.cc:1199] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/a07f37b8469a497ba3fe504cb21105d2
I20260925 01:50:07.673861 13245 ts_tablet_manager.cc:1950] T a07f37b8469a497ba3fe504cb21105d2 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:07.675997 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 5d23c5d52faa4b6da2996fabb16bd74a (table default.Table_82ebda3635eb4fdbb40fd316f06241b8 [id=afe7e3c8eceb40f5b1b0c3809f94e503]) successfully deleted
I20260925 01:50:07.676942 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1001e66d2984d9187443adcc42e5856" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:07.677114 11519 raft_consensus.cc:3060] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.679989 11519 raft_consensus.cc:2468] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:07.676793 13245 tablet_replica.cc:333] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.680235 13245 raft_consensus.cc:2243] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:07.681244 13245 pending_rounds.cc:70] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:07.681350 13245 pending_rounds.cc:77] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072923802718208 op_type: NO_OP noop_request { }
I20260925 01:50:07.681497 13245 raft_consensus.cc:2889] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:07.682790 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet a07f37b8469a497ba3fe504cb21105d2 (table default.Table_a3c9e904392e436babfab378a07cf3a6 [id=13d7f920892e4b7d8befdde8d52affbb]) successfully deleted
I20260925 01:50:07.683514 13245 raft_consensus.cc:2272] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.684437 13245 ts_tablet_manager.cc:1916] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.683277 11176 leader_election.cc:304] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.685736 13210 raft_consensus.cc:2804] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.685860 13210 raft_consensus.cc:697] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:07.686183 13210 consensus_queue.cc:237] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.687006 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet cdd615a0405742fcb472d92829a8d7c7
I20260925 01:50:07.687602 11678 catalog_manager.cc:6934] ReplaceTablet: tablet cdd615a0405742fcb472d92829a8d7c7 deleted and replaced by tablet 2ef025c076394333b416b6613f9116d6
I20260925 01:50:07.689368 11754 tablet_bootstrap.cc:492] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.690383 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet cdd615a0405742fcb472d92829a8d7c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ef025c076394333b416b6613f9116d6) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.691321 11754 tablet_bootstrap.cc:654] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:07.692283 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7c44d814b1d4cb785f244f2eed90c09 consensus state has no leader
I20260925 01:50:07.693920 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8e28aeabdf724784b8ed27535ea0701b
I20260925 01:50:07.694345 11673 catalog_manager.cc:6934] ReplaceTablet: tablet 8e28aeabdf724784b8ed27535ea0701b deleted and replaced by tablet dceeedf3471d45508f025e7a4c7f73f2
I20260925 01:50:07.695780 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e28aeabdf724784b8ed27535ea0701b with delete_type TABLET_DATA_DELETED (replaced by tablet dceeedf3471d45508f025e7a4c7f73f2) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.696178 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fc489c45aa2f4bfbbde8d88ed70b0d55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:07.696435 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5867f948c3824f95a39d7ccbc8b319d4" } modify_external_catalogs: true
I20260925 01:50:07.696643 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5867f948c3824f95a39d7ccbc8b319d4" } modify_external_catalogs: true
W20260925 01:50:07.696914 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc489c45aa2f4bfbbde8d88ed70b0d55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.697175 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e2286db8340a41b88ba1ce8f2b6df8d1" } modify_external_catalogs: true
I20260925 01:50:07.697381 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e2286db8340a41b88ba1ce8f2b6df8d1" } modify_external_catalogs: true
I20260925 01:50:07.698168 13252 consensus_queue.cc:1048] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:07.698589 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1c719484abbc48d985408ab5f7a3e42c" } modify_external_catalogs: true
I20260925 01:50:07.698771 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1c719484abbc48d985408ab5f7a3e42c" } modify_external_catalogs: true
I20260925 01:50:07.700862 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a93395123070480ca376c5c7828846f1" } modify_external_catalogs: true
I20260925 01:50:07.701052 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a93395123070480ca376c5c7828846f1" } modify_external_catalogs: true
I20260925 01:50:07.704118 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e28aeabdf724784b8ed27535ea0701b with delete_type TABLET_DATA_DELETED (replaced by tablet dceeedf3471d45508f025e7a4c7f73f2) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:07.705461 11456 consensus_peers.cc:597] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a07f37b8469a497ba3fe504cb21105d2. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:07.706528 11754 tablet_bootstrap.cc:492] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.706717 11754 ts_tablet_manager.cc:1403] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20260925 01:50:07.708686 11754 raft_consensus.cc:359] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.709026 11754 raft_consensus.cc:385] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.709111 11754 raft_consensus.cc:740] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.709375 11754 consensus_queue.cc:260] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.709962 11754 ts_tablet_manager.cc:1434] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:50:07.710335 11754 tablet_bootstrap.cc:492] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.712054 11754 tablet_bootstrap.cc:654] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.714856 13252 consensus_queue.cc:1048] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:07.715866 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet cdd615a0405742fcb472d92829a8d7c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ef025c076394333b416b6613f9116d6) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.716686 11753 tablet_bootstrap.cc:492] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:07.716857 11753 ts_tablet_manager.cc:1403] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.000s
I20260925 01:50:07.717855 11753 raft_consensus.cc:359] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.719132 11753 raft_consensus.cc:385] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.719349 13245 ts_tablet_manager.cc:1929] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:07.719435 11753 raft_consensus.cc:740] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.722774 11755 tablet_bootstrap.cc:492] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.722950 11755 ts_tablet_manager.cc:1403] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.144s user 0.005s sys 0.004s
I20260925 01:50:07.722970 13245 log.cc:1199] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/dfde700aff8049f4b10c46059da6907f
I20260925 01:50:07.723551 13245 ts_tablet_manager.cc:1950] T dfde700aff8049f4b10c46059da6907f P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:07.724131 13245 tablet_replica.cc:333] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.724453 13245 raft_consensus.cc:2243] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:07.727913 11754 tablet_bootstrap.cc:492] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.730239 11754 ts_tablet_manager.cc:1403] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20260925 01:50:07.730298 13245 pending_rounds.cc:70] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:07.730360 13245 pending_rounds.cc:77] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072924354031616 op_type: NO_OP noop_request { }
I20260925 01:50:07.730473 13245 raft_consensus.cc:2889] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:07.730624 13245 raft_consensus.cc:2272] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.731412 13259 raft_consensus.cc:493] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.732877 11754 raft_consensus.cc:359] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.733266 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet dfde700aff8049f4b10c46059da6907f (table default.Table_32aa0edcb40b42d39d7a738c77b857fb [id=1ee74b5ac91243c9b7f65e894bbbb7a8]) successfully deleted
I20260925 01:50:07.733702 11754 raft_consensus.cc:385] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.734010 11754 raft_consensus.cc:740] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.734689 11754 consensus_queue.cc:260] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.735668 11754 ts_tablet_manager.cc:1434] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:07.736694 11754 tablet_bootstrap.cc:492] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.737519 13245 ts_tablet_manager.cc:1916] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.732199 13101 raft_consensus.cc:493] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.738255 13101 raft_consensus.cc:515] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.738783 11754 tablet_bootstrap.cc:654] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.739185 13101 leader_election.cc:290] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.740124 13259 raft_consensus.cc:515] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.741096 13265 raft_consensus.cc:493] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.741441 13265 raft_consensus.cc:515] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.742132 13265 leader_election.cc:290] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.742245 13265 raft_consensus.cc:493] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:07.742340 13265 raft_consensus.cc:515] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:07.742764 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1001e66d2984d9187443adcc42e5856" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:07.742780 13265 leader_election.cc:290] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:07.743697 13259 leader_election.cc:290] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:07.743918 11177 leader_election.cc:343] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.744412 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet cdd615a0405742fcb472d92829a8d7c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ef025c076394333b416b6613f9116d6) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:07.744621 11177 consensus_peers.cc:597] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:07.745028 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e28aeabdf724784b8ed27535ea0701b with delete_type TABLET_DATA_DELETED (replaced by tablet dceeedf3471d45508f025e7a4c7f73f2) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:07.752213 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 341dca6f396449daadcaf8bbb77ed04b consensus state has no leader
I20260925 01:50:07.752737 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_99409c0387c74d8ca4fcf88a9968acf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.753348 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99409c0387c74d8ca4fcf88a9968acf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.754951 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet a92e93e5478846c7ac2eee8a8e76c7aa from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:07.757467 13245 ts_tablet_manager.cc:1929] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:07.723997 11755 raft_consensus.cc:359] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.762662 11755 raft_consensus.cc:385] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.762737 11755 raft_consensus.cc:740] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.763031 11755 consensus_queue.cc:260] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.763545 13245 log.cc:1199] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/519d954b6a214d0b8e960e128cfcea10
I20260925 01:50:07.770401 13162 raft_consensus.cc:493] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.770555 13162 raft_consensus.cc:515] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.771179 13162 leader_election.cc:290] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.772383 11753 consensus_queue.cc:260] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.760800 11754 tablet_bootstrap.cc:492] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.772878 11754 ts_tablet_manager.cc:1403] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.002s
I20260925 01:50:07.773095 11753 ts_tablet_manager.cc:1434] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.056s user 0.001s sys 0.001s
I20260925 01:50:07.773173 13245 ts_tablet_manager.cc:1950] T 519d954b6a214d0b8e960e128cfcea10 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:07.773379 11753 tablet_bootstrap.cc:492] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:07.773732 11754 raft_consensus.cc:359] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.773901 11754 raft_consensus.cc:385] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.773986 11754 raft_consensus.cc:740] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.774238 11754 consensus_queue.cc:260] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.774758 11754 ts_tablet_manager.cc:1434] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:07.774950 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 519d954b6a214d0b8e960e128cfcea10 (table default.Table_126b13b368c348bea98d7d87748aaf1c [id=3e31f69b151b4dd69a3ac8be6e2bc48d]) successfully deleted
I20260925 01:50:07.775066 11754 tablet_bootstrap.cc:492] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:07.775223 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5122b8c24d3442a1a52ff0b003d65ffb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5122b8c24d3442a1a52ff0b003d65ffb already in progress: creating tablet
I20260925 01:50:07.771966 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f412cbebe04a629070aecf2753287c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:07.776615 11753 tablet_bootstrap.cc:654] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.776692 11236 raft_consensus.cc:2468] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:07.776741 13245 tablet_replica.cc:333] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.777194 13245 raft_consensus.cc:2243] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:07.777478 11456 leader_election.cc:304] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.777577 13245 raft_consensus.cc:2272] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.777557 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e92a27627ba1487594f1190c011575b6" } modify_external_catalogs: true
I20260925 01:50:07.777729 13162 raft_consensus.cc:2804] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.777729 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e92a27627ba1487594f1190c011575b6" } modify_external_catalogs: true
I20260925 01:50:07.777796 13162 raft_consensus.cc:493] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.777874 13162 raft_consensus.cc:3060] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.777956 11754 tablet_bootstrap.cc:654] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.780575 13162 raft_consensus.cc:515] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.780577 11755 ts_tablet_manager.cc:1434] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.058s user 0.002s sys 0.002s
I20260925 01:50:07.781751 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f412cbebe04a629070aecf2753287c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:07.781947 11236 raft_consensus.cc:3060] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.784835 11236 raft_consensus.cc:2468] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:07.785651 11456 leader_election.cc:304] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.785971 12964 raft_consensus.cc:2804] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.790151 13245 ts_tablet_manager.cc:1916] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.796814 13162 leader_election.cc:290] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.799252 11754 tablet_bootstrap.cc:492] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.799453 11754 ts_tablet_manager.cc:1403] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.024s user 0.007s sys 0.005s
I20260925 01:50:07.799997 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d549d73cf407467faa68cbfb68306190
I20260925 01:50:07.800480 11754 raft_consensus.cc:359] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.800745 11754 raft_consensus.cc:385] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.800890 11754 raft_consensus.cc:740] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.801245 11754 consensus_queue.cc:260] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.801402 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet d549d73cf407467faa68cbfb68306190 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:07.801996 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet d549d73cf407467faa68cbfb68306190 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:07.802049 11754 ts_tablet_manager.cc:1434] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:07.802505 11754 tablet_bootstrap.cc:492] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.804877 11754 tablet_bootstrap.cc:654] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.806519 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet d549d73cf407467faa68cbfb68306190 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:07.810740 13263 raft_consensus.cc:493] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:07.810892 13263 raft_consensus.cc:515] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.811597 13263 leader_election.cc:290] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.814265 13245 ts_tablet_manager.cc:1929] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:50:07.821874 13271 raft_consensus.cc:493] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.822184 13271 raft_consensus.cc:515] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.823518 13271 leader_election.cc:290] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.823753 13271 raft_consensus.cc:493] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.823946 13271 raft_consensus.cc:515] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.824688 13271 leader_election.cc:290] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.827620 11314 leader_election.cc:304] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters:
W20260925 01:50:07.828080 11314 leader_election.cc:343] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: fcb56153a802427aaebbf55a8193d62b
W20260925 01:50:07.828353 11314 leader_election.cc:343] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 4d9558462332400d92f7d61858bdeca2
I20260925 01:50:07.829131 13260 raft_consensus.cc:2804] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.829267 13260 raft_consensus.cc:493] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.829412 13260 raft_consensus.cc:3060] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.829661 13245 log.cc:1199] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/0575861dd3d6437284cc183acb87af0a
I20260925 01:50:07.830379 13245 ts_tablet_manager.cc:1950] T 0575861dd3d6437284cc183acb87af0a P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:07.822666 11754 tablet_bootstrap.cc:492] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.831169 11754 ts_tablet_manager.cc:1403] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.002s
I20260925 01:50:07.831987 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 0575861dd3d6437284cc183acb87af0a (table default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086]) successfully deleted
I20260925 01:50:07.832152 11754 raft_consensus.cc:359] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.832384 11754 raft_consensus.cc:385] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.832525 11754 raft_consensus.cc:740] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.832463 13245 tablet_replica.cc:333] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:07.832803 11754 consensus_queue.cc:260] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.833158 13245 raft_consensus.cc:2243] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:07.834498 11754 ts_tablet_manager.cc:1434] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 01:50:07.835423 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ffeb9d70374afdb72a728d7b211d33" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.835685 11522 raft_consensus.cc:2468] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:07.835947 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be89c0911dfa4b9d83d6bd88755be2b2" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.836102 11517 raft_consensus.cc:2468] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:07.836591 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829d167dc0214890b722c0197500f159" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.836719 11520 raft_consensus.cc:2468] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 0.
I20260925 01:50:07.838402 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e96576354fe46bf9bfcde18f0a53390" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.838440 11369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.838667 11371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d253f8b1e4ac41388a885178f2ed0f40" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.838953 11755 tablet_bootstrap.cc:492] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:07.838917 11363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f412cbebe04a629070aecf2753287c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:07.839138 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.839367 11379 raft_consensus.cc:3060] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.839540 11380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.839959 11946 ts_tablet_manager.cc:1929] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:07.840082 11946 log.cc:1199] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:07.840071 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f412cbebe04a629070aecf2753287c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.840860 12964 raft_consensus.cc:697] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:07.841018 11946 ts_tablet_manager.cc:1950] T d7f97ead49634bf6b03e292544af4d07 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:07.841150 12964 consensus_queue.cc:237] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.842260 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be89c0911dfa4b9d83d6bd88755be2b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:07.842475 11375 raft_consensus.cc:2468] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:07.842494 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8f0757127a1b42eca8ea1ed79f738dfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:07.842909 11361 raft_consensus.cc:3060] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:07.843274 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f0757127a1b42eca8ea1ed79f738dfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:07.844784 11456 consensus_peers.cc:597] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b11c6526dbc4177b3a54b3c952bbd31. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:07.848275 11754 tablet_bootstrap.cc:492] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.855518 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_32a32bf92a704259be81d568b38294a6" } new_table_name: "default.Table_f10469179e634f61a8bda439491e8a2c" modify_external_catalogs: true
I20260925 01:50:07.865010 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b306496f992f45a9b64b05b73712cb5b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.866444 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_26cf0afaf1184108bb28e2caaca2ff96" } new_table_name: "default.Table_680b07a036384b658c5ceba2509b47bd" modify_external_catalogs: true
I20260925 01:50:07.875170 13273 raft_consensus.cc:493] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.875335 13273 raft_consensus.cc:515] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.876150 13264 raft_consensus.cc:493] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.876307 13273 leader_election.cc:290] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.876268 13264 raft_consensus.cc:515] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:07.878118 13264 leader_election.cc:290] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.879380 11754 tablet_bootstrap.cc:654] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.835134 13245 pending_rounds.cc:70] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:07.842866 13252 raft_consensus.cc:493] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.882272 13252 raft_consensus.cc:515] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.882956 13252 leader_election.cc:290] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.883966 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91957f62d8044ea8f6a3464c84b9e10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.884145 11513 raft_consensus.cc:2468] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:07.884598 11755 tablet_bootstrap.cc:654] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:07.884737 11176 leader_election.cc:304] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.885051 13252 raft_consensus.cc:2804] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.885133 13252 raft_consensus.cc:493] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.885210 13252 raft_consensus.cc:3060] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.888057 13252 raft_consensus.cc:515] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.888830 11953 ts_tablet_manager.cc:1929] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:07.889132 11953 log.cc:1199] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/e2b9df8d98e5414186ef23b8b7f9cb61
I20260925 01:50:07.889137 11515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91957f62d8044ea8f6a3464c84b9e10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:07.889292 11515 raft_consensus.cc:3060] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.889789 11953 ts_tablet_manager.cc:1950] T e2b9df8d98e5414186ef23b8b7f9cb61 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:07.891103 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 660) took 3791 ms. Trace:
I20260925 01:50:07.891183 11946 rpcz_store.cc:276] 0925 01:50:04.100126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.100427 (+ 301us) service_pool.cc:224] Handling call
0925 01:50:07.386278 (+3285851us) ts_tablet_manager.cc:1151] Deleting tablet d7f97ead49634bf6b03e292544af4d07
0925 01:50:07.386290 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.634902 (+248612us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.784354 (+149452us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.891083 (+106729us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3285626}
I20260925 01:50:07.891716 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet d7f97ead49634bf6b03e292544af4d07 (table default.Table_0e71b8f12efa4591b712a486be4752b9 [id=a0cfa508705d43c0b763a35cf3b1f3c4]) successfully deleted
I20260925 01:50:07.892391 11946 tablet_replica.cc:333] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:07.892544 11515 raft_consensus.cc:2468] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:07.892596 11946 raft_consensus.cc:2243] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:07.892772 11946 raft_consensus.cc:2272] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.893270 11176 leader_election.cc:304] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.893586 13209 raft_consensus.cc:2804] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.893784 13209 raft_consensus.cc:697] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:07.894132 13209 consensus_queue.cc:237] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.895118 13260 raft_consensus.cc:515] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.895603 11370 raft_consensus.cc:2393] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in current term 1: Already voted for candidate aac4ec033f794d7a90b52aa4e0b6155d in this term.
I20260925 01:50:07.896770 13260 leader_election.cc:290] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:07.898144 11314 consensus_peers.cc:597] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9944a1422d14ae2b22451e67c477d5b. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:07.898463 11314 consensus_peers.cc:597] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 770ebdbd355142ba86fd9eb8eaa844f4. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:07.899299 11314 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
W20260925 01:50:07.900174 11314 leader_election.cc:343] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: fcb56153a802427aaebbf55a8193d62b
I20260925 01:50:07.900276 11314 leader_election.cc:304] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.902688 13252 leader_election.cc:290] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.905653 13101 raft_consensus.cc:2749] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:07.906455 13277 raft_consensus.cc:493] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.906646 13245 pending_rounds.cc:77] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072926240641024 op_type: NO_OP noop_request { }
I20260925 01:50:07.906682 13277 raft_consensus.cc:515] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.906857 13245 raft_consensus.cc:2889] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:07.907047 13245 raft_consensus.cc:2272] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:07.907871 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15376374d9f2401fb9bb83d2f0acf7b3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:07.908167 11237 raft_consensus.cc:2468] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:07.908685 11456 leader_election.cc:304] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.909632 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91957f62d8044ea8f6a3464c84b9e10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:07.910286 11177 leader_election.cc:343] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.910691 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7131531641464bba9ada4b5655dd0e47 consensus state has no leader
I20260925 01:50:07.911129 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_34b02f12b7b94204aef2095afe4d766c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.911707 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34b02f12b7b94204aef2095afe4d766c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.919713 13276 raft_consensus.cc:2804] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.919824 13276 raft_consensus.cc:493] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.919899 13276 raft_consensus.cc:3060] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.923260 13276 raft_consensus.cc:515] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.924613 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15376374d9f2401fb9bb83d2f0acf7b3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:07.924875 11237 raft_consensus.cc:3060] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.924873 13276 leader_election.cc:290] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.926110 13277 leader_election.cc:290] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.927924 11237 raft_consensus.cc:2468] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:07.928452 11456 leader_election.cc:304] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.929128 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b91957f62d8044ea8f6a3464c84b9e10" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:07.929445 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00345732f7314624831b4cfc59e981f4 consensus state has no leader
W20260925 01:50:07.929752 11177 leader_election.cc:343] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.930130 13277 raft_consensus.cc:2804] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.930037 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_25bbdb6b8b6047d890e3355231bd7975" } new_table_name: "default.Table_5ae053efd23b4d5abcdb46465e6e381b" modify_external_catalogs: true
I20260925 01:50:07.930415 13277 raft_consensus.cc:697] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:07.930691 13277 consensus_queue.cc:237] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.934731 13245 ts_tablet_manager.cc:1916] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:07.938822 11314 leader_election.cc:343] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:50:07.940179 11946 ts_tablet_manager.cc:1916] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.940568 11314 leader_election.cc:304] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:07.943307 11666 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 341dca6f396449daadcaf8bbb77ed04b (table default.Table_500b95f7b4bf49b7bc5fb405085bcc85 [id=fffcb55426084429ade6e3c4daa22722], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 341dca6f396449daadcaf8bbb77ed04b consensus state has no leader
I20260925 01:50:07.943514 11754 tablet_bootstrap.cc:492] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:07.943683 11754 ts_tablet_manager.cc:1403] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.096s user 0.001s sys 0.006s
I20260925 01:50:07.944449 11754 raft_consensus.cc:359] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.944645 11754 raft_consensus.cc:385] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:07.944722 11754 raft_consensus.cc:740] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:07.944984 13209 raft_consensus.cc:493] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.945120 13209 raft_consensus.cc:515] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.946131 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4f4321544a4f1d9de2e50aa5d7b42a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:07.946345 11516 raft_consensus.cc:2468] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:07.946664 13209 leader_election.cc:290] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.946868 11176 leader_election.cc:304] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.947188 13209 raft_consensus.cc:2804] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.947296 13209 raft_consensus.cc:493] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.947394 13209 raft_consensus.cc:3060] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.950192 13209 raft_consensus.cc:515] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.951133 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4f4321544a4f1d9de2e50aa5d7b42a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:07.951308 11516 raft_consensus.cc:3060] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.954025 11516 raft_consensus.cc:2468] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:07.954499 11176 leader_election.cc:304] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:07.954900 13140 raft_consensus.cc:2804] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:07.955720 13140 raft_consensus.cc:697] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:07.956009 13140 consensus_queue.cc:237] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:07.957567 11314 leader_election.cc:343] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 4d9558462332400d92f7d61858bdeca2
I20260925 01:50:07.957712 11314 leader_election.cc:304] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.957957 13101 raft_consensus.cc:2749] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:07.958160 13101 raft_consensus.cc:2749] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:07.958588 11314 leader_election.cc:304] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.958829 13101 raft_consensus.cc:3060] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.961004 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_63a050ebd5684e69a4a1f06a6f07e876"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:07.961557 13101 raft_consensus.cc:2749] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:07.961643 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63a050ebd5684e69a4a1f06a6f07e876 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:07.961918 13272 raft_consensus.cc:493] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:07.962024 13272 raft_consensus.cc:515] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.962764 13272 leader_election.cc:290] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:07.946969 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4f4321544a4f1d9de2e50aa5d7b42a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:07.966760 11177 leader_election.cc:343] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.968700 11314 leader_election.cc:343] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c28c8f00a8634ef89e4773b62e095b74
W20260925 01:50:07.969034 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d28dc51fc345487ba74c56b9b8f1ad42 consensus state has no leader
I20260925 01:50:07.969515 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_25eae0a5cb4d4de28ef70586f0093354"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:07.969849 11314 leader_election.cc:343] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 7ee95aba7a8f4d8db4ed0b8a862dab63
W20260925 01:50:07.970196 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25eae0a5cb4d4de28ef70586f0093354 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:07.970423 11314 leader_election.cc:343] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 98ffeb9d70374afdb72a728d7b211d33
W20260925 01:50:07.970752 11314 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
W20260925 01:50:07.970924 11314 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 24cd89d238bf4220a48ecdf59cca5e6d
W20260925 01:50:07.971110 11314 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b306496f992f45a9b64b05b73712cb5b
W20260925 01:50:07.971555 11314 leader_election.cc:343] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 93329036763146beb8e6a9b039cc1ec1
W20260925 01:50:07.972482 11314 leader_election.cc:343] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 829d167dc0214890b722c0197500f159
I20260925 01:50:07.973874 13209 leader_election.cc:290] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.974304 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4f4321544a4f1d9de2e50aa5d7b42a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:07.974376 11457 leader_election.cc:343] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.974488 11457 leader_election.cc:304] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.974923 13276 raft_consensus.cc:2749] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:07.974905 11177 leader_election.cc:343] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.975528 11457 leader_election.cc:343] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.975622 11457 leader_election.cc:304] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.975971 13276 raft_consensus.cc:2749] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:07.976469 11457 consensus_peers.cc:597] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:07.980859 11457 leader_election.cc:343] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:07.981956 11457 leader_election.cc:343] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.982089 11457 leader_election.cc:304] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.982532 13276 raft_consensus.cc:2749] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:07.983973 11457 consensus_peers.cc:597] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:07.947271 11754 consensus_queue.cc:260] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:07.984350 11457 leader_election.cc:343] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.984437 11457 leader_election.cc:304] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.984448 11754 ts_tablet_manager.cc:1434] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.041s user 0.001s sys 0.001s
I20260925 01:50:07.984752 11754 tablet_bootstrap.cc:492] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:07.984788 13276 raft_consensus.cc:2749] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:07.986092 11457 leader_election.cc:343] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.986728 11457 leader_election.cc:304] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:07.987172 13276 raft_consensus.cc:2804] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:07.987280 13276 raft_consensus.cc:493] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:07.987372 13276 raft_consensus.cc:3060] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:07.988824 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 521) took 7853 ms. Trace:
I20260925 01:50:07.988976 11953 rpcz_store.cc:276] 0925 01:50:00.135588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.135661 (+ 73us) service_pool.cc:224] Handling call
0925 01:50:07.563080 (+7427419us) ts_tablet_manager.cc:1151] Deleting tablet e2b9df8d98e5414186ef23b8b7f9cb61
0925 01:50:07.563093 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:07.748340 (+185247us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.888663 (+140323us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:07.988788 (+100125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7427210}
I20260925 01:50:07.989626 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet e2b9df8d98e5414186ef23b8b7f9cb61 (table default.Table_a33362d5d6de41e985d86740d8af966c [id=351fd2bbafea4565a9cc4537f7f0c1aa]) successfully deleted
I20260925 01:50:07.990109 11953 tablet_replica.cc:333] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:07.990394 11953 raft_consensus.cc:2243] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:07.990329 13276 raft_consensus.cc:515] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:07.990727 11953 raft_consensus.cc:2272] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:07.991781 11456 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:07.992364 13276 leader_election.cc:290] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:07.995316 13296 tablet.cc:1751] T e87128b8baef4f9d80341f6980da519d P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:07.995819 13297 tablet.cc:1751] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:07.998997 11755 tablet_bootstrap.cc:492] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:07.999143 11755 ts_tablet_manager.cc:1403] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.160s user 0.002s sys 0.002s
I20260925 01:50:07.999064 11953 ts_tablet_manager.cc:1916] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:07.999883 11755 raft_consensus.cc:359] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.000067 11755 raft_consensus.cc:385] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.000124 11755 raft_consensus.cc:740] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.000344 11755 consensus_queue.cc:260] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.000998 11755 ts_tablet_manager.cc:1434] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:08.001276 11755 tablet_bootstrap.cc:492] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:08.002974 11755 tablet_bootstrap.cc:654] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.010249 13252 raft_consensus.cc:493] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.010478 13252 raft_consensus.cc:515] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:08.012137 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1d2d998d834c21ab83694daae37520" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:08.012737 11177 leader_election.cc:343] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.012943 13252 leader_election.cc:290] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.013192 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1d2d998d834c21ab83694daae37520" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.016184 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6535b827d6fb43b7bae1647a19913dce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:08.016566 11516 raft_consensus.cc:2468] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:08.016774 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6535b827d6fb43b7bae1647a19913dce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.017040 11176 leader_election.cc:304] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:08.017484 13252 raft_consensus.cc:2804] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.017597 13252 raft_consensus.cc:493] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.017693 13252 raft_consensus.cc:3060] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.020406 13252 raft_consensus.cc:515] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:08.024163 11946 ts_tablet_manager.cc:1929] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.024354 11946 log.cc:1199] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:08.024884 11946 ts_tablet_manager.cc:1950] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.027705 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_346e965d39234aaa8ed222800eb0fc34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.028404 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_346e965d39234aaa8ed222800eb0fc34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.029278 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 661) took 3929 ms. Trace:
I20260925 01:50:08.031445 13252 leader_election.cc:290] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.031718 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1d2d998d834c21ab83694daae37520" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:08.032413 11177 leader_election.cc:343] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:07.997237 11754 tablet_bootstrap.cc:654] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.030964 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f1d2d998d834c21ab83694daae37520" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:08.037904 11516 raft_consensus.cc:3060] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.040412 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:08.040733 11516 raft_consensus.cc:2468] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:08.041304 11176 leader_election.cc:304] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:08.042500 13252 raft_consensus.cc:2804] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.042704 13252 raft_consensus.cc:697] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:08.043042 13252 consensus_queue.cc:237] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:08.045285 11946 rpcz_store.cc:276] 0925 01:50:04.100324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.100618 (+ 294us) service_pool.cc:224] Handling call
0925 01:50:07.892340 (+3791722us) ts_tablet_manager.cc:1151] Deleting tablet 2e96576354fe46bf9bfcde18f0a53390
0925 01:50:07.892350 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.007095 (+114745us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.024097 (+ 17002us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.029259 (+ 5162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3791520}
I20260925 01:50:08.044575 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:08.046829 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 2e96576354fe46bf9bfcde18f0a53390 (table default.Table_901ce728b66a4e0aa595efc09462e77c [id=77342c106aac476884403421439b8f52]) successfully deleted
I20260925 01:50:08.047196 11946 tablet_replica.cc:333] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.047544 13276 raft_consensus.cc:493] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.047694 13276 raft_consensus.cc:515] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.048702 13276 leader_election.cc:290] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.050422 11946 raft_consensus.cc:2243] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.050633 11946 raft_consensus.cc:2272] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:08.050920 11456 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 1f778b87d307483b9edb17dce7355a65
I20260925 01:50:08.053277 11946 ts_tablet_manager.cc:1916] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.056939 13245 ts_tablet_manager.cc:1929] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:08.057341 13245 log.cc:1199] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/d3150980bb72435886486156aa98d342
I20260925 01:50:08.059937 13245 ts_tablet_manager.cc:1950] T d3150980bb72435886486156aa98d342 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:08.061811 11946 ts_tablet_manager.cc:1929] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:08.075387 11754 tablet_bootstrap.cc:492] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.075646 11754 ts_tablet_manager.cc:1403] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.091s user 0.004s sys 0.000s
I20260925 01:50:08.076545 11754 raft_consensus.cc:359] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.076908 11754 raft_consensus.cc:385] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.077054 11754 raft_consensus.cc:740] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.077405 11754 consensus_queue.cc:260] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.078186 11754 ts_tablet_manager.cc:1434] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:08.078564 11754 tablet_bootstrap.cc:492] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.080392 11754 tablet_bootstrap.cc:654] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.084511 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet d3150980bb72435886486156aa98d342 (table default.Table_2428d63259334c4e96044516c1560465 [id=374d5a46f2b2482598aec3f5cc801aef]) successfully deleted
W20260925 01:50:08.085736 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 4d14ab205bba4f9d92797d34ab82f13d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d14ab205bba4f9d92797d34ab82f13d already in progress: creating tablet
I20260925 01:50:08.086768 13245 tablet_replica.cc:333] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:08.087023 13245 raft_consensus.cc:2243] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:08.087327 13245 pending_rounds.cc:70] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:08.087435 13245 pending_rounds.cc:77] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072928947679232 op_type: NO_OP noop_request { }
I20260925 01:50:08.087601 13245 raft_consensus.cc:2889] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:08.088160 13245 raft_consensus.cc:2272] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.088277 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15376374d9f2401fb9bb83d2f0acf7b3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:08.089277 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15376374d9f2401fb9bb83d2f0acf7b3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:08.090703 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be89c0911dfa4b9d83d6bd88755be2b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:08.090866 11379 raft_consensus.cc:3060] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.093748 11379 raft_consensus.cc:2468] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:08.082698 11457 leader_election.cc:304] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:08.095782 11457 raft_consensus.cc:2686] T 2e96576354fe46bf9bfcde18f0a53390 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:08.096067 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f778b87d307483b9edb17dce7355a65" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:08.096526 11314 leader_election.cc:304] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.097249 11314 leader_election.cc:304] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.097605 13260 raft_consensus.cc:2804] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.097640 13261 raft_consensus.cc:2764] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260925 01:50:08.097683 13260 raft_consensus.cc:493] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.097746 13260 raft_consensus.cc:3060] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.098250 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9068770de0b473488bd8ea4752fb15d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.098443 11522 raft_consensus.cc:2393] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:50:08.100492 13260 raft_consensus.cc:515] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:08.100746 11456 consensus_peers.cc:597] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbd4b231f89a48e59e5eb3cf3976385a. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:08.101187 13260 leader_election.cc:290] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.103561 13245 ts_tablet_manager.cc:1916] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.113441 13252 raft_consensus.cc:493] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.113636 13252 raft_consensus.cc:515] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.115232 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.115458 11516 raft_consensus.cc:2468] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:08.115872 11176 leader_election.cc:304] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.116159 13209 raft_consensus.cc:2804] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.116261 13209 raft_consensus.cc:493] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.116338 13209 raft_consensus.cc:3060] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.117012 13260 raft_consensus.cc:493] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.117172 13260 raft_consensus.cc:515] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.117937 13260 leader_election.cc:290] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.118335 13252 leader_election.cc:290] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.119472 13209 raft_consensus.cc:515] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.120227 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:08.121088 11177 leader_election.cc:343] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.121425 13209 leader_election.cc:290] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.121701 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:08.121724 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_086bf3a81e584116994b46acdf5be7bd" } new_table_name: "default.Table_da4efdb559b446c880ab108cd26e6e9a" modify_external_catalogs: true
I20260925 01:50:08.121904 11516 raft_consensus.cc:3060] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.122882 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:08.123378 11177 leader_election.cc:343] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.124684 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d451558b9dd34a58997d77c2d847aee4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.125272 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d451558b9dd34a58997d77c2d847aee4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.125713 11516 raft_consensus.cc:2468] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:08.126240 11176 leader_election.cc:304] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:08.126711 13140 raft_consensus.cc:2804] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.126874 13140 raft_consensus.cc:697] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:08.127147 13140 consensus_queue.cc:237] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:08.133462 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b3ef72a9d01444f8bb77cf7b3ee7fe2e consensus state has no leader
I20260925 01:50:08.133975 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_229aa93ef5bf437694d72a7119dad224" } new_table_name: "default.Table_564e5d550937462b9b930df2e64cf028" modify_external_catalogs: true
I20260925 01:50:08.136684 11754 tablet_bootstrap.cc:492] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.136904 11754 ts_tablet_manager.cc:1403] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20260925 01:50:08.136808 13297 tablet.cc:1751] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:08.137823 13296 tablet.cc:1751] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:08.141291 11946 log.cc:1199] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a9944a1422d14ae2b22451e67c477d5b
I20260925 01:50:08.141845 11946 ts_tablet_manager.cc:1950] T a9944a1422d14ae2b22451e67c477d5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.142251 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 662) took 4041 ms. Trace:
I20260925 01:50:08.137789 11754 raft_consensus.cc:359] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.142390 11946 rpcz_store.cc:276] 0925 01:50:04.101153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.101431 (+ 278us) service_pool.cc:224] Handling call
0925 01:50:08.047135 (+3945704us) ts_tablet_manager.cc:1151] Deleting tablet a9944a1422d14ae2b22451e67c477d5b
0925 01:50:08.047149 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.058736 (+ 11587us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.061755 (+ 3019us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.142233 (+ 80478us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3945414}
I20260925 01:50:08.142840 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 663) took 3975 ms. Trace:
I20260925 01:50:08.142884 11754 raft_consensus.cc:385] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.142949 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a9944a1422d14ae2b22451e67c477d5b (table default.Table_4b87558f2a98419f96b453a44aae814b [id=a1a3b3d0054a4bff8de55b5c5e71880f]) successfully deleted
I20260925 01:50:08.142930 11946 rpcz_store.cc:276] 0925 01:50:04.167346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.167934 (+ 588us) service_pool.cc:224] Handling call
0925 01:50:08.142705 (+3974771us) ts_tablet_manager.cc:1151] Deleting tablet 2487a41e682740cb83a4281aeef0368a
0925 01:50:08.142717 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.142822 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3974548}
I20260925 01:50:08.143074 11754 raft_consensus.cc:740] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.143276 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 664) took 3969 ms. Trace:
I20260925 01:50:08.143343 11946 rpcz_store.cc:276] 0925 01:50:04.173940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.173994 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:08.143170 (+3969176us) ts_tablet_manager.cc:1151] Deleting tablet 2957cbd4669749b381f59d1e301a692d
0925 01:50:08.143178 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.143261 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3968924}
I20260925 01:50:08.143376 11754 consensus_queue.cc:260] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:08.143445 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2487a41e682740cb83a4281aeef0368a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2487a41e682740cb83a4281aeef0368a already in progress: creating tablet
I20260925 01:50:08.143646 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 665) took 3963 ms. Trace:
I20260925 01:50:08.143713 11946 rpcz_store.cc:276] 0925 01:50:04.180008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.180099 (+ 91us) service_pool.cc:224] Handling call
0925 01:50:08.143555 (+3963456us) ts_tablet_manager.cc:1151] Deleting tablet 75014fc54fc7481f83da07e1d96c4370
0925 01:50:08.143563 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.143631 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3963247}
I20260925 01:50:08.143886 11754 ts_tablet_manager.cc:1434] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260925 01:50:08.143960 11946 tablet_replica.cc:333] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.144188 11946 raft_consensus.cc:2243] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:08.144289 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2957cbd4669749b381f59d1e301a692d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2957cbd4669749b381f59d1e301a692d already in progress: creating tablet
I20260925 01:50:08.144356 11946 raft_consensus.cc:2272] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:08.144551 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 75014fc54fc7481f83da07e1d96c4370 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75014fc54fc7481f83da07e1d96c4370 already in progress: creating tablet
I20260925 01:50:08.144902 11946 ts_tablet_manager.cc:1916] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.151784 11755 tablet_bootstrap.cc:492] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:08.152045 11755 ts_tablet_manager.cc:1403] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.151s user 0.003s sys 0.011s
I20260925 01:50:08.153088 11755 raft_consensus.cc:359] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.153323 11755 raft_consensus.cc:385] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.157312 11755 raft_consensus.cc:740] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.157801 11755 consensus_queue.cc:260] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.162417 11754 tablet_bootstrap.cc:492] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.164755 11754 tablet_bootstrap.cc:654] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.173981 11946 ts_tablet_manager.cc:1929] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.180153 11953 ts_tablet_manager.cc:1929] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.180670 11953 log.cc:1199] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/644b28192e3b45e7b5370d55804cb043
I20260925 01:50:08.181578 11953 ts_tablet_manager.cc:1950] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:08.182610 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 520) took 8047 ms. Trace:
I20260925 01:50:08.182765 11946 log.cc:1199] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8234c4d0c72541158826416e40f34031
I20260925 01:50:08.182826 11953 rpcz_store.cc:276] 0925 01:50:00.135442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.142129 (+ 6687us) service_pool.cc:224] Handling call
0925 01:50:07.990028 (+7847899us) ts_tablet_manager.cc:1151] Deleting tablet 644b28192e3b45e7b5370d55804cb043
0925 01:50:07.990042 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.084634 (+ 94592us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.180028 (+ 95394us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.182568 (+ 2540us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7847694}
I20260925 01:50:08.183176 11946 ts_tablet_manager.cc:1950] T 8234c4d0c72541158826416e40f34031 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.192963 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 669) took 3952 ms. Trace:
I20260925 01:50:08.183910 11755 ts_tablet_manager.cc:1434] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260925 01:50:08.193658 11755 tablet_bootstrap.cc:492] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:50:08.189276 11314 leader_election.cc:343] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 7ee95aba7a8f4d8db4ed0b8a862dab63
I20260925 01:50:08.194303 11314 leader_election.cc:304] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.194698 13260 raft_consensus.cc:2749] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:08.194675 11946 rpcz_store.cc:276] 0925 01:50:04.240206 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.242373 (+ 2167us) service_pool.cc:224] Handling call
0925 01:50:08.143913 (+3901540us) ts_tablet_manager.cc:1151] Deleting tablet 8234c4d0c72541158826416e40f34031
0925 01:50:08.143923 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.170849 (+ 26926us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.173921 (+ 3072us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.192937 (+ 19016us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3901322}
I20260925 01:50:08.195300 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 675) took 3852 ms. Trace:
I20260925 01:50:08.195394 11946 rpcz_store.cc:276] 0925 01:50:04.343076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.344675 (+ 1599us) service_pool.cc:224] Handling call
0925 01:50:08.195162 (+3850487us) ts_tablet_manager.cc:1151] Deleting tablet b8f82aa815bd42bdbf70a673e3a4c9da
0925 01:50:08.195172 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.195283 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3850300}
I20260925 01:50:08.196062 11314 leader_election.cc:304] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.196482 13260 raft_consensus.cc:2804] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.196597 13260 raft_consensus.cc:493] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.196563 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8234c4d0c72541158826416e40f34031 (table default.Table_69dd9b3d7d624415aacea6486cb9caeb [id=dfef0ea9809c46c8971e29b2f080e7df]) successfully deleted
I20260925 01:50:08.196666 13260 raft_consensus.cc:3060] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:08.197003 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b8f82aa815bd42bdbf70a673e3a4c9da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8f82aa815bd42bdbf70a673e3a4c9da already in progress: creating tablet
I20260925 01:50:08.197190 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 677) took 3838 ms. Trace:
I20260925 01:50:08.197276 11946 rpcz_store.cc:276] 0925 01:50:04.359112 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.359178 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:08.197060 (+3837882us) ts_tablet_manager.cc:1151] Deleting tablet db217278aa27439587768291c4ca7e3a
0925 01:50:08.197070 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.197171 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3837678}
I20260925 01:50:08.197803 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 678) took 3836 ms. Trace:
I20260925 01:50:08.197868 11946 rpcz_store.cc:276] 0925 01:50:04.361031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.361087 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:08.197682 (+3836595us) ts_tablet_manager.cc:1151] Deleting tablet ff70e44b72d1425c81751ff0b3d93b11
0925 01:50:08.197691 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.197785 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3836422}
I20260925 01:50:08.198015 11754 tablet_bootstrap.cc:492] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.198221 11754 ts_tablet_manager.cc:1403] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.003s
I20260925 01:50:08.198326 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 693) took 3350 ms. Trace:
I20260925 01:50:08.198395 11946 rpcz_store.cc:276] 0925 01:50:04.847907 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.848785 (+ 878us) service_pool.cc:224] Handling call
0925 01:50:08.198225 (+3349440us) ts_tablet_manager.cc:1151] Deleting tablet 17d628e46be942b3be3a69afd3f6968b
0925 01:50:08.198236 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.198313 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3349270}
I20260925 01:50:08.199035 11754 raft_consensus.cc:359] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.199214 11754 raft_consensus.cc:385] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.199272 11754 raft_consensus.cc:740] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.199566 11754 consensus_queue.cc:260] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.200158 11754 ts_tablet_manager.cc:1434] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260925 01:50:08.200462 11754 tablet_bootstrap.cc:492] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.202044 11754 tablet_bootstrap.cc:654] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:08.202049 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet db217278aa27439587768291c4ca7e3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db217278aa27439587768291c4ca7e3a already in progress: creating tablet
W20260925 01:50:08.202329 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ff70e44b72d1425c81751ff0b3d93b11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff70e44b72d1425c81751ff0b3d93b11 already in progress: creating tablet
W20260925 01:50:08.202536 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 17d628e46be942b3be3a69afd3f6968b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d628e46be942b3be3a69afd3f6968b already in progress: creating tablet
I20260925 01:50:08.203473 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 695) took 3347 ms. Trace:
I20260925 01:50:08.203570 11946 rpcz_store.cc:276] 0925 01:50:04.855690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.855744 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:08.203386 (+3347642us) ts_tablet_manager.cc:1151] Deleting tablet 4d7b3c65d8a64734b2c432790dae07e1
0925 01:50:08.203395 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.203455 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3347478}
W20260925 01:50:08.204017 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 4d7b3c65d8a64734b2c432790dae07e1 because the tablet was not found. No further retry: Not found: Tablet not found: 4d7b3c65d8a64734b2c432790dae07e1
I20260925 01:50:08.205936 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_476bf1ac18a8424287eb6e04103c5437"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:08.206025 13260 raft_consensus.cc:515] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.206422 11946 tablet_replica.cc:333] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:08.206578 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_476bf1ac18a8424287eb6e04103c5437 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.206645 11946 raft_consensus.cc:2243] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.206712 13260 leader_election.cc:290] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.206779 11946 raft_consensus.cc:2272] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.207250 11946 ts_tablet_manager.cc:1916] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:08.208171 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7457026bbf14466bb3585d514d4d898 has no consensus state
I20260925 01:50:08.208575 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_51b55c1a28a74a73a883a31c2d1e62d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:08.208812 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
W20260925 01:50:08.209132 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51b55c1a28a74a73a883a31c2d1e62d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:08.215370 11314 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 24cd89d238bf4220a48ecdf59cca5e6d
I20260925 01:50:08.215632 11314 leader_election.cc:304] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.216010 13260 raft_consensus.cc:2749] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:08.216650 11314 leader_election.cc:343] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 93329036763146beb8e6a9b039cc1ec1
I20260925 01:50:08.216954 11314 leader_election.cc:304] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.217438 13260 raft_consensus.cc:2749] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:08.218109 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 644b28192e3b45e7b5370d55804cb043 (table default.Table_58fdde0b3e6a47b79d42646ec2ed37ef [id=70a49de4b7e04789bb0a1afaf2df1900]) successfully deleted
I20260925 01:50:08.220849 11755 tablet_bootstrap.cc:654] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.222169 11314 leader_election.cc:304] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.223037 13260 raft_consensus.cc:2749] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:08.223136 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a45eb10593cd43ec8508c6dee33b434e" } modify_external_catalogs: true
I20260925 01:50:08.223402 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a45eb10593cd43ec8508c6dee33b434e" } modify_external_catalogs: true
I20260925 01:50:08.223989 13260 raft_consensus.cc:493] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.224166 13260 raft_consensus.cc:515] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:08.224951 13260 leader_election.cc:290] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:08.225179 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1b208d4f9adf4fb68e03f8b99db77356"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.226070 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b208d4f9adf4fb68e03f8b99db77356 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:08.225971 11314 consensus_peers.cc:597] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f892954cd22c48aaad2f0e20b1277844. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:08.227581 11314 leader_election.cc:343] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: c28c8f00a8634ef89e4773b62e095b74
I20260925 01:50:08.228725 11314 leader_election.cc:304] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.231580 13260 raft_consensus.cc:2749] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:08.234268 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 522) took 8090 ms. Trace:
I20260925 01:50:08.234469 11953 rpcz_store.cc:276] 0925 01:50:00.143893 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.144127 (+ 234us) service_pool.cc:224] Handling call
0925 01:50:08.220702 (+8076575us) ts_tablet_manager.cc:1151] Deleting tablet fe947074863044c1a8640092735a51fc
0925 01:50:08.234105 (+ 13403us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.234249 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8076303}
W20260925 01:50:08.235512 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet fe947074863044c1a8640092735a51fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe947074863044c1a8640092735a51fc already in progress: creating tablet
I20260925 01:50:08.236809 11755 tablet_bootstrap.cc:492] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:08.237064 11755 ts_tablet_manager.cc:1403] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.001s
I20260925 01:50:08.238397 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9949d5ff8dc5438bbdac2523833b7a53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:08.238775 11755 raft_consensus.cc:359] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.238999 11755 raft_consensus.cc:385] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.239081 11755 raft_consensus.cc:740] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.239351 11755 consensus_queue.cc:260] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:08.239703 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9949d5ff8dc5438bbdac2523833b7a53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.239943 11755 ts_tablet_manager.cc:1434] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:08.240916 11754 tablet_bootstrap.cc:492] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.241159 11754 ts_tablet_manager.cc:1403] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.041s user 0.000s sys 0.006s
I20260925 01:50:08.241864 11953 tablet_replica.cc:333] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:08.242105 11953 raft_consensus.cc:2243] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:08.242486 11953 raft_consensus.cc:2272] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.243096 11953 ts_tablet_manager.cc:1916] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.245079 11754 raft_consensus.cc:359] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.245417 11754 raft_consensus.cc:385] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.245604 11754 raft_consensus.cc:740] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.246047 11754 consensus_queue.cc:260] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.249204 13245 ts_tablet_manager.cc:1929] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:08.249297 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_78fb2c35bc36492f8ae1eb15521969f5" } new_table_name: "default.Table_5ddb0bb553ea417ca3118e2fe3ec58a1" modify_external_catalogs: true
I20260925 01:50:08.249552 13245 log.cc:1199] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/1f1d2d998d834c21ab83694daae37520
I20260925 01:50:08.250388 13245 ts_tablet_manager.cc:1950] T 1f1d2d998d834c21ab83694daae37520 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:08.251675 11754 ts_tablet_manager.cc:1434] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260925 01:50:08.257053 11754 tablet_bootstrap.cc:492] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.257448 11946 ts_tablet_manager.cc:1929] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.257766 11946 log.cc:1199] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/98ffeb9d70374afdb72a728d7b211d33
I20260925 01:50:08.258251 11946 ts_tablet_manager.cc:1950] T 98ffeb9d70374afdb72a728d7b211d33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.259110 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 694) took 3403 ms. Trace:
I20260925 01:50:08.259263 11946 rpcz_store.cc:276] 0925 01:50:04.855507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.855944 (+ 437us) service_pool.cc:224] Handling call
0925 01:50:08.206374 (+3350430us) ts_tablet_manager.cc:1151] Deleting tablet 98ffeb9d70374afdb72a728d7b211d33
0925 01:50:08.206384 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.254299 (+ 47915us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.257395 (+ 3096us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.259087 (+ 1692us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3350289}
I20260925 01:50:08.259831 11754 tablet_bootstrap.cc:654] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.259886 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 98ffeb9d70374afdb72a728d7b211d33 (table default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]) successfully deleted
I20260925 01:50:08.260217 11946 tablet_replica.cc:333] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.260478 11946 raft_consensus.cc:2243] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:08.260828 11946 raft_consensus.cc:2272] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.261623 11946 ts_tablet_manager.cc:1916] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:08.268590 11314 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
W20260925 01:50:08.268895 11314 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 73d9a26bbfd74a30a2ae0a61aacca4d1
W20260925 01:50:08.269646 11314 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
W20260925 01:50:08.271188 11457 leader_election.cc:343] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:08.272008 11457 consensus_peers.cc:597] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:08.272501 11457 leader_election.cc:343] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.275005 11457 leader_election.cc:304] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.275543 13276 raft_consensus.cc:2804] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:50:08.275607 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db1339652d744cda9215d84e846d1e8e consensus state has no leader
I20260925 01:50:08.275884 13276 raft_consensus.cc:697] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:08.276183 13276 consensus_queue.cc:237] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.279132 11754 tablet_bootstrap.cc:492] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.279440 11754 ts_tablet_manager.cc:1403] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.004s
I20260925 01:50:08.280622 11754 raft_consensus.cc:359] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.281032 11754 raft_consensus.cc:385] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.281222 11754 raft_consensus.cc:740] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.281620 11754 consensus_queue.cc:260] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:08.283082 11457 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.283196 11457 leader_election.cc:304] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.283674 13162 raft_consensus.cc:2749] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:08.283697 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f
I20260925 01:50:08.284826 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:08.284799 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_290135088f3644b3b2f1bb06a39ab673" } new_table_name: "default.Table_7f46696dc29f42c98ad3344509e8397d" modify_external_catalogs: true
I20260925 01:50:08.284058 11755 tablet_bootstrap.cc:492] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:08.285897 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:08.286650 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.287750 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 1f1d2d998d834c21ab83694daae37520 (table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]) successfully deleted
I20260925 01:50:08.288282 11754 ts_tablet_manager.cc:1434] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
W20260925 01:50:08.295511 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7809737ca3d24bfe8829f17d5e3215f5 consensus state has no leader
I20260925 01:50:08.296190 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d90f452532144ce98c7d4e351a71190b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.297176 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d90f452532144ce98c7d4e351a71190b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.306290 13260 raft_consensus.cc:493] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.306627 13260 raft_consensus.cc:515] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.307598 13260 leader_election.cc:290] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.308861 11678 catalog_manager.cc:5838] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:08.309473 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
W20260925 01:50:08.314513 13126 log.cc:927] Time spent T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Append to log took a long time: real 0.068s user 0.000s sys 0.004s
W20260925 01:50:08.315681 11677 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.194:58253 (request call id 130) took 781 ms (client timeout 1000 ms). Trace:
W20260925 01:50:08.315840 11677 rpcz_store.cc:269] 0925 01:50:07.534698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.539790 (+ 5092us) service_pool.cc:224] Handling call
0925 01:50:07.557891 (+ 18101us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00007f46ca49765d 00007f46ca497753 00007f46c7014db1 00007f46cee03acd 00007f46cef8d738 00007f46c59611f6 00007f46c5960f25 00007f46c206763e 00007f46c206651e 00007f46c206c758 00007f46c206d0bf
0925 01:50:08.315621 (+757730us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":36395264}
I20260925 01:50:08.318198 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.319303 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.319330 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 829d167dc0214890b722c0197500f159 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.319531 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet b306496f992f45a9b64b05b73712cb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.319543 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e96576354fe46bf9bfcde18f0a53390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.319713 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet a9068770de0b473488bd8ea4752fb15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.319973 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ffeb9d70374afdb72a728d7b211d33 with delete_type TABLET_DATA_DELETED (replaced by tablet a8055cc9b06045449e6133298c8074e1) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.321239 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6a9abc8df95942d3bcedfec0598b296c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.321837 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a9abc8df95942d3bcedfec0598b296c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.322772 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_30f2b681c35d4fba9fa318b24ecb1033"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.323549 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30f2b681c35d4fba9fa318b24ecb1033 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.324321 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1f98ed2304fb4bfaa17e725eca54b7ce" } new_table_name: "default.Table_f226421d7bef40f38eb7b5256c57e830" modify_external_catalogs: true
I20260925 01:50:08.326437 11946 ts_tablet_manager.cc:1929] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:08.326573 11946 log.cc:1199] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:50:08.327041 11946 ts_tablet_manager.cc:1950] T 01d50e428bfc46caa130f96ccc7e8f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.327456 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 698) took 3470 ms. Trace:
I20260925 01:50:08.327564 11946 rpcz_store.cc:276] 0925 01:50:04.857350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.857415 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:08.260166 (+3402751us) ts_tablet_manager.cc:1151] Deleting tablet 01d50e428bfc46caa130f96ccc7e8f40
0925 01:50:08.260177 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.298839 (+ 38662us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.326359 (+ 27520us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.327434 (+ 1075us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3402575}
I20260925 01:50:08.300808 13245 tablet_replica.cc:333] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:08.339818 11946 tablet_replica.cc:333] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.340096 11946 raft_consensus.cc:2243] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:08.340370 11946 pending_rounds.cc:70] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:08.340425 11946 pending_rounds.cc:77] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072929902747648 op_type: NO_OP noop_request { }
I20260925 01:50:08.340543 11946 raft_consensus.cc:2889] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:08.340641 11946 raft_consensus.cc:2272] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.340701 11755 tablet_bootstrap.cc:654] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.343468 11754 tablet_bootstrap.cc:492] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.344492 13306 raft_consensus.cc:493] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.344882 13245 raft_consensus.cc:2243] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:08.345453 13306 raft_consensus.cc:515] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.346501 13306 leader_election.cc:290] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.347231 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce91b00d3a14e6398abacad61ff5b0f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.347695 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce91b00d3a14e6398abacad61ff5b0f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:08.347954 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 95ac080782664fca8661c188ab822e89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.348726 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 06fca09010f841c5a7b58678560065f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:08.348687 11176 leader_election.cc:343] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.348809 11754 tablet_bootstrap.cc:654] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:08.348901 11177 leader_election.cc:343] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.349828 11177 leader_election.cc:304] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:08.349967 13245 pending_rounds.cc:70] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:08.352716 11953 ts_tablet_manager.cc:1929] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:08.353979 13306 raft_consensus.cc:2749] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:08.356381 13245 pending_rounds.cc:77] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072926767120384 op_type: NO_OP noop_request { }
I20260925 01:50:08.356765 13245 raft_consensus.cc:2889] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:08.357108 13245 raft_consensus.cc:2272] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.357048 11953 log.cc:1199] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8152c9e0b0af4ab2a18c5a0080e22ffc
I20260925 01:50:08.358592 13245 ts_tablet_manager.cc:1916] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.360652 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829d167dc0214890b722c0197500f159" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:08.360839 11516 raft_consensus.cc:3060] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.363667 11516 raft_consensus.cc:2468] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aac4ec033f794d7a90b52aa4e0b6155d in term 1.
I20260925 01:50:08.328187 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 01d50e428bfc46caa130f96ccc7e8f40 (table default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]) successfully deleted
I20260925 01:50:08.328670 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2e839ce4c66c40eba5553a81e865a12a
I20260925 01:50:08.365731 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:08.365967 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e839ce4c66c40eba5553a81e865a12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:08.366812 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e839ce4c66c40eba5553a81e865a12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:08.368482 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e839ce4c66c40eba5553a81e865a12a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.368664 11946 ts_tablet_manager.cc:1916] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.369077 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 03232387650b450c97c41701b306ac77 (DEFAULT_TABLE table=default.Table_f4f4ecc9e22d4728b850f0f8bd4170bd [id=9b5ee9c1ff29478698503891f2929ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.369880 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 03232387650b450c97c41701b306ac77 (DEFAULT_TABLE table=default.Table_f4f4ecc9e22d4728b850f0f8bd4170bd [id=9b5ee9c1ff29478698503891f2929ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.370265 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03232387650b450c97c41701b306ac77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.368688 11953 ts_tablet_manager.cc:1950] T 8152c9e0b0af4ab2a18c5a0080e22ffc P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:08.374354 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03232387650b450c97c41701b306ac77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:08.382458 13126 log.cc:927] Time spent T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Append to log took a long time: real 0.060s user 0.004s sys 0.000s
I20260925 01:50:08.385005 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7cb273ff7b084ffdb33b8ca9b9e136fe
I20260925 01:50:08.385838 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0723b14a66f248a394aad936376c3cbc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.386463 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0723b14a66f248a394aad936376c3cbc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.387259 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.387665 13271 raft_consensus.cc:493] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.387820 13271 raft_consensus.cc:515] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.388458 13271 leader_election.cc:290] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.389405 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:08.389588 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:08.391371 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 523) took 8245 ms. Trace:
W20260925 01:50:08.392719 11314 leader_election.cc:343] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 644b28192e3b45e7b5370d55804cb043
I20260925 01:50:08.392554 11953 rpcz_store.cc:276] 0925 01:50:00.146312 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.146499 (+ 187us) service_pool.cc:224] Handling call
0925 01:50:08.235865 (+8089366us) ts_tablet_manager.cc:1151] Deleting tablet 8152c9e0b0af4ab2a18c5a0080e22ffc
0925 01:50:08.241778 (+ 5913us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.289001 (+ 47223us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.352633 (+ 63632us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.391274 (+ 38641us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8089117}
I20260925 01:50:08.395512 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 854549ed223142429513c1d80c026793
I20260925 01:50:08.394578 11314 leader_election.cc:304] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.396533 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 854549ed223142429513c1d80c026793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.398350 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8a00b69e42e1465981d6c3eec217393f
W20260925 01:50:08.398211 11314 raft_consensus.cc:2686] T 644b28192e3b45e7b5370d55804cb043 P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:08.399152 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_30cf8a0d9f664848b66efda848625415"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.399801 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30cf8a0d9f664848b66efda848625415 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.400238 13271 raft_consensus.cc:493] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.400398 13271 raft_consensus.cc:515] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.401028 13271 leader_election.cc:290] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.399725 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 535) took 7731 ms. Trace:
I20260925 01:50:08.402299 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a00b69e42e1465981d6c3eec217393f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:08.402726 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a00b69e42e1465981d6c3eec217393f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.403195 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a00b69e42e1465981d6c3eec217393f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:08.403030 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 854549ed223142429513c1d80c026793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:08.403551 13245 ts_tablet_manager.cc:1929] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:08.404256 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_888d29cf77974252be89bea321d7542b" } new_table_name: "default.Table_647e39b3326e47a8b9b6af790794b66d" modify_external_catalogs: true
I20260925 01:50:08.406140 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 854549ed223142429513c1d80c026793 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:08.403638 11953 rpcz_store.cc:276] 0925 01:50:00.668481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.668693 (+ 212us) service_pool.cc:224] Handling call
0925 01:50:08.397760 (+7729067us) ts_tablet_manager.cc:1151] Deleting tablet 5695f3af46974cb6a662f8788f9543e0
0925 01:50:08.397773 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.399383 (+ 1610us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7728523}
W20260925 01:50:08.409354 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5695f3af46974cb6a662f8788f9543e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5695f3af46974cb6a662f8788f9543e0 already in progress: creating tablet
W20260925 01:50:08.410002 11314 leader_election.cc:343] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:50:08.410478 13245 log.cc:1199] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ae948bf42ae34a7ab72112d5f1f02585
I20260925 01:50:08.411209 13245 ts_tablet_manager.cc:1950] T ae948bf42ae34a7ab72112d5f1f02585 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:08.413338 11946 ts_tablet_manager.cc:1929] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:08.414788 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ae948bf42ae34a7ab72112d5f1f02585 (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]) successfully deleted
I20260925 01:50:08.412804 11754 tablet_bootstrap.cc:492] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.415741 11754 ts_tablet_manager.cc:1403] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.117s user 0.007s sys 0.008s
I20260925 01:50:08.416133 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 3646554c68c84b3695c58abcbcf814e7 (DEFAULT_TABLE table=default.Table_2515048189c844839baa558b149e5b60 [id=a3496d011dc74499b9f5eecc312b0e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.416604 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3646554c68c84b3695c58abcbcf814e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.416896 11754 raft_consensus.cc:359] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.417119 11754 raft_consensus.cc:385] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.417203 11754 raft_consensus.cc:740] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.417551 11754 consensus_queue.cc:260] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.419699 11204 tablet_service.cc:1511] Processing CreateTablet for tablet acae1c6d9f0e48709dfcd4dbabbdd6ec (DEFAULT_TABLE table=default.Table_5b919c91b3c64811b8fe08b683e9d6e1 [id=41de0e1d21934efcbd1a7ce8d1f26fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.420086 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acae1c6d9f0e48709dfcd4dbabbdd6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.420462 11754 ts_tablet_manager.cc:1434] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:50:08.423619 11221 tablet_service.cc:1511] Processing CreateTablet for tablet c41e53ebb5f54a07bb7afc3352fec0f0 (DEFAULT_TABLE table=default.Table_f2a993f348294efa9dd4d14d80c38492 [id=e23bfef060e240779420f864fddcae71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.425626 11946 log.cc:1199] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:08.427755 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41e53ebb5f54a07bb7afc3352fec0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.422329 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 3646554c68c84b3695c58abcbcf814e7 (DEFAULT_TABLE table=default.Table_2515048189c844839baa558b149e5b60 [id=a3496d011dc74499b9f5eecc312b0e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.417691 11496 tablet_service.cc:1511] Processing CreateTablet for tablet c41e53ebb5f54a07bb7afc3352fec0f0 (DEFAULT_TABLE table=default.Table_f2a993f348294efa9dd4d14d80c38492 [id=e23bfef060e240779420f864fddcae71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.430411 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3646554c68c84b3695c58abcbcf814e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.430639 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41e53ebb5f54a07bb7afc3352fec0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.434242 13306 raft_consensus.cc:493] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.434414 13306 raft_consensus.cc:515] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.435117 13306 leader_election.cc:290] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.435694 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.435897 11516 raft_consensus.cc:2468] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:08.436189 11754 tablet_bootstrap.cc:492] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.436407 11176 leader_election.cc:304] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.436723 13306 raft_consensus.cc:2804] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.436825 13306 raft_consensus.cc:493] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.436944 13306 raft_consensus.cc:3060] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.437788 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]). Expected version 2 got 0
I20260925 01:50:08.438180 11754 tablet_bootstrap.cc:654] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.414814 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 03232387650b450c97c41701b306ac77 (DEFAULT_TABLE table=default.Table_f4f4ecc9e22d4728b850f0f8bd4170bd [id=9b5ee9c1ff29478698503891f2929ba9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.415721 11342 tablet_service.cc:1511] Processing CreateTablet for tablet c41e53ebb5f54a07bb7afc3352fec0f0 (DEFAULT_TABLE table=default.Table_f2a993f348294efa9dd4d14d80c38492 [id=e23bfef060e240779420f864fddcae71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.423332 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 3646554c68c84b3695c58abcbcf814e7 (DEFAULT_TABLE table=default.Table_2515048189c844839baa558b149e5b60 [id=a3496d011dc74499b9f5eecc312b0e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.427387 11755 tablet_bootstrap.cc:492] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:08.442889 11755 ts_tablet_manager.cc:1403] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.162s user 0.003s sys 0.003s
I20260925 01:50:08.435695 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:08.445564 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8e28aeabdf724784b8ed27535ea0701b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e28aeabdf724784b8ed27535ea0701b already in progress: creating tablet
W20260925 01:50:08.445971 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet cdd615a0405742fcb472d92829a8d7c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdd615a0405742fcb472d92829a8d7c7 already in progress: creating tablet
W20260925 01:50:08.446312 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d549d73cf407467faa68cbfb68306190 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d549d73cf407467faa68cbfb68306190 already in progress: creating tablet
I20260925 01:50:08.446595 11946 ts_tablet_manager.cc:1950] T be89c0911dfa4b9d83d6bd88755be2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:08.446667 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f already in progress: creating tablet
I20260925 01:50:08.447382 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 700) took 3589 ms. Trace:
W20260925 01:50:08.447429 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5d23c5d52faa4b6da2996fabb16bd74a because the tablet was not found. No further retry: Not found: Tablet not found: 5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:50:08.447477 11946 rpcz_store.cc:276] 0925 01:50:04.857570 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.857628 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:08.339749 (+3482121us) ts_tablet_manager.cc:1151] Deleting tablet be89c0911dfa4b9d83d6bd88755be2b2
0925 01:50:08.339764 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.380418 (+ 40654us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.413268 (+ 32850us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.447357 (+ 34089us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3481946}
W20260925 01:50:08.447757 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2e839ce4c66c40eba5553a81e865a12a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e839ce4c66c40eba5553a81e865a12a already in progress: creating tablet
W20260925 01:50:08.448033 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cb273ff7b084ffdb33b8ca9b9e136fe already in progress: creating tablet
W20260925 01:50:08.448351 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8a00b69e42e1465981d6c3eec217393f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a00b69e42e1465981d6c3eec217393f already in progress: creating tablet
I20260925 01:50:08.448534 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_20ebf4c7095a4388acf30cfc1ee53c59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.448700 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 854549ed223142429513c1d80c026793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 854549ed223142429513c1d80c026793 already in progress: creating tablet
I20260925 01:50:08.449004 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet be89c0911dfa4b9d83d6bd88755be2b2 (table default.Table_3ce60e2486054c3081ecab5a46f58e16 [id=653678819a1849b2a923a6793976ae8c]) successfully deleted
W20260925 01:50:08.449306 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20ebf4c7095a4388acf30cfc1ee53c59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.444233 11755 raft_consensus.cc:359] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.449855 11755 raft_consensus.cc:385] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.449962 11755 raft_consensus.cc:740] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.450322 11755 consensus_queue.cc:260] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.454052 11946 tablet_replica.cc:333] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.440938 13306 raft_consensus.cc:515] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.454308 11946 raft_consensus.cc:2243] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:08.443893 11177 leader_election.cc:343] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.454586 11946 raft_consensus.cc:2272] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.455220 11946 ts_tablet_manager.cc:1916] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.455359 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:08.455571 11516 raft_consensus.cc:3060] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.459265 13306 leader_election.cc:290] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.459738 11516 raft_consensus.cc:2468] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:08.460255 11176 leader_election.cc:304] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.460736 13306 raft_consensus.cc:2804] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.460902 13306 raft_consensus.cc:697] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:08.461196 13306 consensus_queue.cc:237] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.463014 11755 ts_tablet_manager.cc:1434] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260925 01:50:08.463433 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 536) took 7794 ms. Trace:
I20260925 01:50:08.463896 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:08.463688 11953 rpcz_store.cc:276] 0925 01:50:00.668619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.668969 (+ 350us) service_pool.cc:224] Handling call
0925 01:50:08.441245 (+7772276us) ts_tablet_manager.cc:1151] Deleting tablet 47b62644673447239feb0f8f851012ef
0925 01:50:08.463214 (+ 21969us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.463396 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7769820}
I20260925 01:50:08.464450 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03232387650b450c97c41701b306ac77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:08.464654 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 47b62644673447239feb0f8f851012ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b62644673447239feb0f8f851012ef already in progress: creating tablet
I20260925 01:50:08.465303 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41e53ebb5f54a07bb7afc3352fec0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.470270 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3646554c68c84b3695c58abcbcf814e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.472527 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5fb6a5e0ac944a3bacc808d58b0d6c7e" } new_table_name: "default.Table_b165001c5a09432cbac6ce79abb7b5d2" modify_external_catalogs: true
I20260925 01:50:08.473272 11946 ts_tablet_manager.cc:1929] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.473373 11946 log.cc:1199] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/06fca09010f841c5a7b58678560065f3
I20260925 01:50:08.473646 11946 ts_tablet_manager.cc:1950] T 06fca09010f841c5a7b58678560065f3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.477377 13210 raft_consensus.cc:493] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.477564 13210 raft_consensus.cc:515] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.478367 13210 leader_election.cc:290] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.479712 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d253f8b1e4ac41388a885178f2ed0f40" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.480072 11516 raft_consensus.cc:2468] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:08.480616 13210 raft_consensus.cc:493] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.480765 13210 raft_consensus.cc:515] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.481372 13210 leader_election.cc:290] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.481959 11176 leader_election.cc:304] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.482554 13210 raft_consensus.cc:2804] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.482661 13210 raft_consensus.cc:493] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.482752 13210 raft_consensus.cc:3060] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.484428 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 702) took 3626 ms. Trace:
I20260925 01:50:08.484529 11946 rpcz_store.cc:276] 0925 01:50:04.857853 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.857906 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:08.453996 (+3596090us) ts_tablet_manager.cc:1151] Deleting tablet 06fca09010f841c5a7b58678560065f3
0925 01:50:08.454007 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.459442 (+ 5435us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.473212 (+ 13770us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.484407 (+ 11195us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3595954}
I20260925 01:50:08.484884 11946 tablet_replica.cc:333] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.485085 11946 raft_consensus.cc:2243] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.485208 11946 raft_consensus.cc:2272] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.485577 13210 raft_consensus.cc:515] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.485685 11946 ts_tablet_manager.cc:1916] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.486538 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.486793 11516 raft_consensus.cc:2468] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:08.487335 11176 leader_election.cc:304] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.487640 13209 raft_consensus.cc:2804] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.487736 13209 raft_consensus.cc:493] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.487809 13209 raft_consensus.cc:3060] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.487874 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 06fca09010f841c5a7b58678560065f3 (table default.Table_ef187190ed9e4b7d910df53df764f469 [id=4d572d97dbaa43e5879f88f200a962ba]) successfully deleted
I20260925 01:50:08.488330 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fd4295340ebf4ad28e0eb3568a272fcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.488973 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd4295340ebf4ad28e0eb3568a272fcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.489348 13210 leader_election.cc:290] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.489933 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d253f8b1e4ac41388a885178f2ed0f40" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:08.490134 11516 raft_consensus.cc:3060] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.490643 13209 raft_consensus.cc:515] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.491222 13209 leader_election.cc:290] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.492357 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:08.492506 11522 raft_consensus.cc:3060] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.492750 11516 raft_consensus.cc:2468] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:08.493160 11176 leader_election.cc:304] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.493423 13209 raft_consensus.cc:2804] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.493548 13209 raft_consensus.cc:697] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:08.493793 13209 consensus_queue.cc:237] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.495301 11522 raft_consensus.cc:2468] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:08.495896 11176 leader_election.cc:304] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.496290 13210 raft_consensus.cc:2804] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.496513 13210 raft_consensus.cc:697] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:08.497013 13210 consensus_queue.cc:237] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.502560 11753 tablet_bootstrap.cc:492] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:08.502765 11753 ts_tablet_manager.cc:1403] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.729s user 0.024s sys 0.000s
I20260925 01:50:08.510387 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a92e93e5478846c7ac2eee8a8e76c7aa
I20260925 01:50:08.510915 11672 catalog_manager.cc:6934] ReplaceTablet: tablet a92e93e5478846c7ac2eee8a8e76c7aa deleted and replaced by tablet 3a1510ec076a4483bc1e3c2eeb5b7b51
I20260925 01:50:08.511349 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7cec5add800b426a95a58ae9947ca146"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.511925 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cec5add800b426a95a58ae9947ca146 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.512369 11946 ts_tablet_manager.cc:1929] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.512468 11946 log.cc:1199] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c7944aa1ac8f4c5d8ea3aa2acae41257
I20260925 01:50:08.512782 11946 ts_tablet_manager.cc:1950] T c7944aa1ac8f4c5d8ea3aa2acae41257 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.513535 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 701) took 3655 ms. Trace:
I20260925 01:50:08.513625 11946 rpcz_store.cc:276] 0925 01:50:04.857728 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.858082 (+ 354us) service_pool.cc:224] Handling call
0925 01:50:08.484833 (+3626751us) ts_tablet_manager.cc:1151] Deleting tablet c7944aa1ac8f4c5d8ea3aa2acae41257
0925 01:50:08.484844 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.509255 (+ 24411us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.512311 (+ 3056us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.513513 (+ 1202us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3626632}
W20260925 01:50:08.513836 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8e57874af21422ba2364603c6df04d1 consensus state has no leader
I20260925 01:50:08.514909 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ca45acb19bb2490c9022438afee35414"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.515491 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca45acb19bb2490c9022438afee35414 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.516824 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c7944aa1ac8f4c5d8ea3aa2acae41257 (table default.Table_467dcbd96d384165bd59850e07759dae [id=454ea19fdacb465b93f5761ffcdf4ff2]) successfully deleted
I20260925 01:50:08.517400 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet a92e93e5478846c7ac2eee8a8e76c7aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1510ec076a4483bc1e3c2eeb5b7b51) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:08.518760 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet a92e93e5478846c7ac2eee8a8e76c7aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1510ec076a4483bc1e3c2eeb5b7b51) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:08.519586 11675 catalog_manager.cc:5838] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:08.520015 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 4 got 0
I20260925 01:50:08.520270 11675 catalog_manager.cc:5838] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
W20260925 01:50:08.520771 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a92e93e5478846c7ac2eee8a8e76c7aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a92e93e5478846c7ac2eee8a8e76c7aa already in progress: creating tablet
I20260925 01:50:08.520807 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:08.521083 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 6a9ccd099cba4b92909bb17c45dfce8a (table default.Table_a6b67f9415ae41dbaf3903dbbaec308f [id=c23a94a77b36437f843f323488d4ed42]). Expected version 1 got 0
I20260925 01:50:08.521292 11675 catalog_manager.cc:5838] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:08.521672 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 60411b0feafe4fef9c4fdc364163f1df (table default.Table_9c96e3747586472d861731441a16b7eb [id=0848b51bdadb45b5b1a5357208cfcd58]). Expected version 4 got 0
I20260925 01:50:08.521891 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]). Expected version 2 got 0
I20260925 01:50:08.531473 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4a4a414c1da142179c47230a40b1945d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:08.532049 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a4a414c1da142179c47230a40b1945d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:08.540750 11494 tablet_service.cc:1511] Processing CreateTablet for tablet acae1c6d9f0e48709dfcd4dbabbdd6ec (DEFAULT_TABLE table=default.Table_5b919c91b3c64811b8fe08b683e9d6e1 [id=41de0e1d21934efcbd1a7ce8d1f26fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.543069 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5ae053efd23b4d5abcdb46465e6e381b" } new_table_name: "default.Table_72072fbf36e743aa92a12c27cc05bc77" modify_external_catalogs: true
I20260925 01:50:08.543017 11221 tablet_service.cc:1511] Processing CreateTablet for tablet d3155a38167e40be86d5d95017963dad (DEFAULT_TABLE table=default.Table_c85d24f369ed472bb3f0817e03b0eb7d [id=7347ffea2b074463b9436023aa1f7a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.543633 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3155a38167e40be86d5d95017963dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.546420 11754 tablet_bootstrap.cc:492] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.546629 11754 ts_tablet_manager.cc:1403] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.111s user 0.007s sys 0.015s
I20260925 01:50:08.547426 11754 raft_consensus.cc:359] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.547709 11754 raft_consensus.cc:385] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.547806 11754 raft_consensus.cc:740] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.548110 11754 consensus_queue.cc:260] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.548640 11754 ts_tablet_manager.cc:1434] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:08.548981 11754 tablet_bootstrap.cc:492] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:08.550333 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab8682686f894beaaa58f4818c0651c4 consensus state has no leader
I20260925 01:50:08.550740 11754 tablet_bootstrap.cc:654] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.552909 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 243fef66e94a4277bada406bacc1d586 (DEFAULT_TABLE table=default.Table_a7a72b74c92b448598d04690c8785cfa [id=43fff46100a6453f8ec5cb94dab7520a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.553270 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243fef66e94a4277bada406bacc1d586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.554699 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d0fc550ce5ff4bdf9c47eaa60bc71b36" } modify_external_catalogs: true
I20260925 01:50:08.554919 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d0fc550ce5ff4bdf9c47eaa60bc71b36" } modify_external_catalogs: true
I20260925 01:50:08.556053 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 81dda98d1647435fa7120d757b8558c7 (DEFAULT_TABLE table=default.Table_25da9be7f25c439ea91214ed02f5bd2d [id=e0988f6b5cfd4d6cb88711d26bd6b270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.556384 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dda98d1647435fa7120d757b8558c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.553967 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 243fef66e94a4277bada406bacc1d586 (DEFAULT_TABLE table=default.Table_a7a72b74c92b448598d04690c8785cfa [id=43fff46100a6453f8ec5cb94dab7520a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.551623 11496 tablet_service.cc:1511] Processing CreateTablet for tablet d3155a38167e40be86d5d95017963dad (DEFAULT_TABLE table=default.Table_c85d24f369ed472bb3f0817e03b0eb7d [id=7347ffea2b074463b9436023aa1f7a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.547811 11753 raft_consensus.cc:359] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.556706 11753 raft_consensus.cc:385] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.556758 11753 raft_consensus.cc:740] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.557024 11753 consensus_queue.cc:260] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.561249 11753 ts_tablet_manager.cc:1434] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.058s user 0.002s sys 0.000s
W20260925 01:50:08.563234 11177 leader_election.cc:343] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.569231 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 81dda98d1647435fa7120d757b8558c7 (DEFAULT_TABLE table=default.Table_25da9be7f25c439ea91214ed02f5bd2d [id=e0988f6b5cfd4d6cb88711d26bd6b270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.570914 11754 tablet_bootstrap.cc:492] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.571110 11754 ts_tablet_manager.cc:1403] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.003s
I20260925 01:50:08.571678 11344 tablet_service.cc:1511] Processing CreateTablet for tablet acae1c6d9f0e48709dfcd4dbabbdd6ec (DEFAULT_TABLE table=default.Table_5b919c91b3c64811b8fe08b683e9d6e1 [id=41de0e1d21934efcbd1a7ce8d1f26fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.571834 11754 raft_consensus.cc:359] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.572081 11754 raft_consensus.cc:385] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.572168 11754 raft_consensus.cc:740] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.572412 11754 consensus_queue.cc:260] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.572906 11355 tablet_service.cc:1511] Processing CreateTablet for tablet d3155a38167e40be86d5d95017963dad (DEFAULT_TABLE table=default.Table_c85d24f369ed472bb3f0817e03b0eb7d [id=7347ffea2b074463b9436023aa1f7a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.572999 11754 ts_tablet_manager.cc:1434] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:08.573252 11754 tablet_bootstrap.cc:492] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.573361 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 243fef66e94a4277bada406bacc1d586 (DEFAULT_TABLE table=default.Table_a7a72b74c92b448598d04690c8785cfa [id=43fff46100a6453f8ec5cb94dab7520a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.573875 13277 raft_consensus.cc:493] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.574004 13277 raft_consensus.cc:515] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.574735 11754 tablet_bootstrap.cc:654] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.574714 13277 leader_election.cc:290] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.577127 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d253f8b1e4ac41388a885178f2ed0f40" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:08.577283 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:08.577535 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d253f8b1e4ac41388a885178f2ed0f40" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:08.577127 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet a92e93e5478846c7ac2eee8a8e76c7aa with delete_type TABLET_DATA_DELETED (replaced by tablet 3a1510ec076a4483bc1e3c2eeb5b7b51) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.577899 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:08.577745 11177 leader_election.cc:343] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:08.578249 11177 leader_election.cc:343] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:08.578486 11177 leader_election.cc:343] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.583699 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acae1c6d9f0e48709dfcd4dbabbdd6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.583710 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 699) took 3726 ms. Trace:
I20260925 01:50:08.583967 11946 rpcz_store.cc:276] 0925 01:50:04.857458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.858195 (+ 737us) service_pool.cc:224] Handling call
0925 01:50:08.543351 (+3685156us) ts_tablet_manager.cc:1151] Deleting tablet 7ee95aba7a8f4d8db4ed0b8a862dab63
0925 01:50:08.583541 (+ 40190us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.583683 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3684993}
I20260925 01:50:08.584393 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 697) took 3727 ms. Trace:
I20260925 01:50:08.584453 11946 rpcz_store.cc:276] 0925 01:50:04.857198 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.858393 (+ 1195us) service_pool.cc:224] Handling call
0925 01:50:08.584304 (+3725911us) ts_tablet_manager.cc:1151] Deleting tablet 3e3a033c9e7545479130c7a3c48ac254
0925 01:50:08.584313 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.584377 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3725785}
I20260925 01:50:08.584686 11946 tablet_replica.cc:333] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.584741 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6386bd0cb4894068985fe152299f0b47" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:08.584859 11946 raft_consensus.cc:2243] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.584914 11237 raft_consensus.cc:2468] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:08.585012 11946 raft_consensus.cc:2272] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.585569 11946 ts_tablet_manager.cc:1916] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:08.585602 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 because the tablet was not found. No further retry: Not found: Tablet not found: 7ee95aba7a8f4d8db4ed0b8a862dab63
I20260925 01:50:08.587816 11314 leader_election.cc:304] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.588665 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3155a38167e40be86d5d95017963dad. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:08.588876 11177 leader_election.cc:343] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.588958 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243fef66e94a4277bada406bacc1d586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.589564 11456 leader_election.cc:304] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.589926 13162 raft_consensus.cc:2804] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.590001 13162 raft_consensus.cc:493] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.590104 13162 raft_consensus.cc:3060] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.592666 13162 raft_consensus.cc:515] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.593514 13162 leader_election.cc:290] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:08.594175 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3e3a033c9e7545479130c7a3c48ac254 because the tablet was not found. No further retry: Not found: Tablet not found: 3e3a033c9e7545479130c7a3c48ac254
I20260925 01:50:08.595201 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6386bd0cb4894068985fe152299f0b47" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:08.595417 11236 raft_consensus.cc:3060] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.602138 13210 consensus_queue.cc:1048] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:08.604745 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dda98d1647435fa7120d757b8558c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.606899 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acae1c6d9f0e48709dfcd4dbabbdd6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.607039 11946 ts_tablet_manager.cc:1929] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.607131 11946 log.cc:1199] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a9068770de0b473488bd8ea4752fb15d
I20260925 01:50:08.607407 11946 ts_tablet_manager.cc:1950] T a9068770de0b473488bd8ea4752fb15d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.608176 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f778b87d307483b9edb17dce7355a65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:08.610479 13271 raft_consensus.cc:2749] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:08.614254 11236 raft_consensus.cc:2468] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:08.614429 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243fef66e94a4277bada406bacc1d586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.616775 11456 leader_election.cc:304] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.617064 13277 raft_consensus.cc:2804] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.617163 13277 raft_consensus.cc:697] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:08.617401 13277 consensus_queue.cc:237] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.618368 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3155a38167e40be86d5d95017963dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.626782 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 696) took 3769 ms. Trace:
I20260925 01:50:08.626905 11946 rpcz_store.cc:276] 0925 01:50:04.857085 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.858553 (+ 1468us) service_pool.cc:224] Handling call
0925 01:50:08.584642 (+3726089us) ts_tablet_manager.cc:1151] Deleting tablet a9068770de0b473488bd8ea4752fb15d
0925 01:50:08.584652 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.588620 (+ 3968us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.606988 (+ 18368us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.626758 (+ 19770us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3725970}
I20260925 01:50:08.627379 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a9068770de0b473488bd8ea4752fb15d (table default.Table_bb67fea9df444e16a94bb2a276fc99be [id=b527a6ca23af495195c09be2d49de223]) successfully deleted
I20260925 01:50:08.628285 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 709) took 3413 ms. Trace:
I20260925 01:50:08.628365 11946 rpcz_store.cc:276] 0925 01:50:05.215344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.216332 (+ 988us) service_pool.cc:224] Handling call
0925 01:50:08.628158 (+3411826us) ts_tablet_manager.cc:1151] Deleting tablet 62eeb75b322e45a5bdbd63dbd4c6e582
0925 01:50:08.628169 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.628268 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3411634}
I20260925 01:50:08.628796 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6734b38bddb6462f81a668efbe01fad0" } new_table_name: "default.Table_320d2038849e40c199abf2f5df73274b" modify_external_catalogs: true
W20260925 01:50:08.628973 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62eeb75b322e45a5bdbd63dbd4c6e582 already in progress: creating tablet
I20260925 01:50:08.630300 11753 tablet_bootstrap.cc:492] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:08.630398 11755 tablet_bootstrap.cc:492] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:08.634140 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 534) took 7980 ms. Trace:
I20260925 01:50:08.634311 11953 rpcz_store.cc:276] 0925 01:50:00.653938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.654533 (+ 595us) service_pool.cc:224] Handling call
0925 01:50:08.517582 (+7863049us) ts_tablet_manager.cc:1151] Deleting tablet 3702f09e45a14c80af716d642d30cdfa
0925 01:50:08.588161 (+ 70579us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.634113 (+ 45952us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7845040}
W20260925 01:50:08.634907 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 3702f09e45a14c80af716d642d30cdfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3702f09e45a14c80af716d642d30cdfa already in progress: creating tablet
W20260925 01:50:08.636754 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 186770us
W20260925 01:50:08.638339 11314 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:08.638592 11314 leader_election.cc:304] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.638942 13271 raft_consensus.cc:2749] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260925 01:50:08.639210 11314 leader_election.cc:343] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a9068770de0b473488bd8ea4752fb15d
I20260925 01:50:08.639299 11314 leader_election.cc:304] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.639503 13271 raft_consensus.cc:3060] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:08.639756 11314 leader_election.cc:343] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 98ffeb9d70374afdb72a728d7b211d33
W20260925 01:50:08.639932 11314 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 95ac080782664fca8661c188ab822e89
W20260925 01:50:08.640177 11314 leader_election.cc:343] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 829d167dc0214890b722c0197500f159
W20260925 01:50:08.640298 11314 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:08.642864 13261 raft_consensus.cc:493] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:08.643006 13261 raft_consensus.cc:515] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:08.643591 13261 leader_election.cc:290] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.643882 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6386bd0cb4894068985fe152299f0b47" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:08.644202 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 537) took 7972 ms. Trace:
I20260925 01:50:08.644299 11953 rpcz_store.cc:276] 0925 01:50:00.671991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.672070 (+ 79us) service_pool.cc:224] Handling call
0925 01:50:08.634668 (+7962598us) ts_tablet_manager.cc:1151] Deleting tablet 774d14d5c7884f4e96662779b3100056
0925 01:50:08.634679 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.644188 (+ 9509us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7959353}
I20260925 01:50:08.644661 11953 tablet_replica.cc:333] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:08.644901 11953 raft_consensus.cc:2243] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:08.645013 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 774d14d5c7884f4e96662779b3100056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 774d14d5c7884f4e96662779b3100056 already in progress: creating tablet
I20260925 01:50:08.645098 11953 raft_consensus.cc:2272] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.646427 11953 ts_tablet_manager.cc:1916] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.651558 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf7f544827d4bca97aa6b63c0c48c0d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:08.652316 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6386bd0cb4894068985fe152299f0b47" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:08.652676 11177 consensus_peers.cc:597] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:08.653931 11755 tablet_bootstrap.cc:654] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.644661 13271 raft_consensus.cc:2749] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:08.664934 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 81dda98d1647435fa7120d757b8558c7 (DEFAULT_TABLE table=default.Table_25da9be7f25c439ea91214ed02f5bd2d [id=e0988f6b5cfd4d6cb88711d26bd6b270]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.668082 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 710) took 3450 ms. Trace:
I20260925 01:50:08.668233 11946 rpcz_store.cc:276] 0925 01:50:05.217720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.217891 (+ 171us) service_pool.cc:224] Handling call
0925 01:50:08.667868 (+3449977us) ts_tablet_manager.cc:1151] Deleting tablet ae05900043cb49d29f528fcbe4c8ada0
0925 01:50:08.667886 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.668046 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3449811}
W20260925 01:50:08.668972 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet ae05900043cb49d29f528fcbe4c8ada0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae05900043cb49d29f528fcbe4c8ada0 already in progress: creating tablet
I20260925 01:50:08.670449 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfde700aff8049f4b10c46059da6907f" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.670739 11519 raft_consensus.cc:2393] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:50:08.671074 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 711) took 3453 ms. Trace:
I20260925 01:50:08.671348 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdf7f544827d4bca97aa6b63c0c48c0d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:08.676249 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dda98d1647435fa7120d757b8558c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.671293 11946 rpcz_store.cc:276] 0925 01:50:05.217886 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.218091 (+ 205us) service_pool.cc:224] Handling call
0925 01:50:08.670924 (+3452833us) ts_tablet_manager.cc:1151] Deleting tablet b97f703869d4471cb940ef654203ec2b
0925 01:50:08.670936 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.671052 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3452723}
W20260925 01:50:08.676851 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b97f703869d4471cb940ef654203ec2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97f703869d4471cb940ef654203ec2b already in progress: creating tablet
I20260925 01:50:08.677189 11753 tablet_bootstrap.cc:654] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.677340 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 708) took 3464 ms. Trace:
I20260925 01:50:08.677479 11946 rpcz_store.cc:276] 0925 01:50:05.213349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.222539 (+ 9190us) service_pool.cc:224] Handling call
0925 01:50:08.677228 (+3454689us) ts_tablet_manager.cc:1151] Deleting tablet 9b75b12794fa4f4fa53156c212632cdc
0925 01:50:08.677238 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.677323 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3454146}
W20260925 01:50:08.678236 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9b75b12794fa4f4fa53156c212632cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b75b12794fa4f4fa53156c212632cdc already in progress: creating tablet
I20260925 01:50:08.678602 11946 tablet_replica.cc:333] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.678848 11946 raft_consensus.cc:2243] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.682510 11946 raft_consensus.cc:2272] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.683017 11221 tablet_service.cc:1511] Processing CreateTablet for tablet ba0bfa95a1ec4305b9c8b5d920202a17 (DEFAULT_TABLE table=default.Table_32d3c6acd9044e7ea09f6dfae4086ed1 [id=eaef2cf71fcd454fa907ff21c51c4e75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.683180 11946 ts_tablet_manager.cc:1916] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.683473 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0bfa95a1ec4305b9c8b5d920202a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.687436 13162 consensus_queue.cc:1048] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:08.688660 11501 tablet_service.cc:1511] Processing CreateTablet for tablet ba0bfa95a1ec4305b9c8b5d920202a17 (DEFAULT_TABLE table=default.Table_32d3c6acd9044e7ea09f6dfae4086ed1 [id=eaef2cf71fcd454fa907ff21c51c4e75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.689025 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0bfa95a1ec4305b9c8b5d920202a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.694363 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9d0c2d707042e88de399d2afd1d506 (DEFAULT_TABLE table=default.Table_6985e5ccae48472cbdb3cb8d3b387f4c [id=589132d56ea84f04a4c81ffb43bcc591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.694808 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9d0c2d707042e88de399d2afd1d506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.694751 11346 tablet_service.cc:1511] Processing CreateTablet for tablet ba0bfa95a1ec4305b9c8b5d920202a17 (DEFAULT_TABLE table=default.Table_32d3c6acd9044e7ea09f6dfae4086ed1 [id=eaef2cf71fcd454fa907ff21c51c4e75]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.698542 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:08.700024 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba0bfa95a1ec4305b9c8b5d920202a17. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:08.716107 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9845a915c8b94fff8660e2e7e86731f3 consensus state has no leader
I20260925 01:50:08.720495 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet 5366f2487b444e12ad9d63d6825d5e97 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:08.724654 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9d0c2d707042e88de399d2afd1d506 (DEFAULT_TABLE table=default.Table_6985e5ccae48472cbdb3cb8d3b387f4c [id=589132d56ea84f04a4c81ffb43bcc591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.725018 13271 raft_consensus.cc:493] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.725194 13271 raft_consensus.cc:515] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.725420 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9d0c2d707042e88de399d2afd1d506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.725879 13271 leader_election.cc:290] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:08.725873 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6fff10858b41c8aaf8c32ecb0f9014 (DEFAULT_TABLE table=default.Table_3a09c19d055e4424be5eb589bf3b541a [id=2cc9dc6beafa44cfa5de3f810cb823fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.726300 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6fff10858b41c8aaf8c32ecb0f9014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.730198 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 758e4d8bc0f5479a9cbca8854a2dd371 (DEFAULT_TABLE table=default.Table_69e8886705ed402ebb51426039c18caf [id=89009e10ee1944ec86e514f8e872fb47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.730310 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6fff10858b41c8aaf8c32ecb0f9014 (DEFAULT_TABLE table=default.Table_3a09c19d055e4424be5eb589bf3b541a [id=2cc9dc6beafa44cfa5de3f810cb823fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.730671 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758e4d8bc0f5479a9cbca8854a2dd371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.730722 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6fff10858b41c8aaf8c32ecb0f9014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.736331 13210 consensus_queue.cc:1048] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:08.742614 11953 ts_tablet_manager.cc:1929] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.742849 11953 log.cc:1199] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/73d9a26bbfd74a30a2ae0a61aacca4d1
I20260925 01:50:08.745529 11754 tablet_bootstrap.cc:492] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:08.745852 11754 ts_tablet_manager.cc:1403] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.173s user 0.029s sys 0.037s
I20260925 01:50:08.746666 11754 raft_consensus.cc:359] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.748342 11754 raft_consensus.cc:385] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.748483 11754 raft_consensus.cc:740] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.748822 11754 consensus_queue.cc:260] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.749720 11754 ts_tablet_manager.cc:1434] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:08.753130 11946 ts_tablet_manager.cc:1929] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.753520 13210 consensus_queue.cc:1048] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 01:50:08.757689 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 44523.6us
W20260925 01:50:08.762578 11457 leader_election.cc:343] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.763803 11946 log.cc:1199] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/d3150980bb72435886486156aa98d342
W20260925 01:50:08.764566 11177 consensus_peers.cc:597] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:08.764969 11946 ts_tablet_manager.cc:1950] T d3150980bb72435886486156aa98d342 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.765213 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 4f9d0c2d707042e88de399d2afd1d506 (DEFAULT_TABLE table=default.Table_6985e5ccae48472cbdb3cb8d3b387f4c [id=589132d56ea84f04a4c81ffb43bcc591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.765669 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f9d0c2d707042e88de399d2afd1d506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.770363 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 718) took 3436 ms. Trace:
W20260925 01:50:08.770629 11177 consensus_peers.cc:597] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:08.771018 11946 rpcz_store.cc:276] 0925 01:50:05.334242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.334296 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:08.678558 (+3344262us) ts_tablet_manager.cc:1151] Deleting tablet d3150980bb72435886486156aa98d342
0925 01:50:08.678566 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.711673 (+ 33107us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.753070 (+ 41397us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.770337 (+ 17267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3344092}
I20260925 01:50:08.771857 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet d3150980bb72435886486156aa98d342 (table default.Table_2428d63259334c4e96044516c1560465 [id=374d5a46f2b2482598aec3f5cc801aef]) successfully deleted
I20260925 01:50:08.764575 11753 tablet_bootstrap.cc:492] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:08.772426 11753 ts_tablet_manager.cc:1403] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.166s user 0.009s sys 0.000s
I20260925 01:50:08.773389 11753 raft_consensus.cc:359] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.773809 11753 raft_consensus.cc:385] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.773900 11753 raft_consensus.cc:740] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.773748 11946 tablet_replica.cc:333] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.774595 11946 raft_consensus.cc:2243] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.774852 11946 raft_consensus.cc:2272] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.775635 11946 ts_tablet_manager.cc:1916] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.775833 11753 consensus_queue.cc:260] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.778234 11753 ts_tablet_manager.cc:1434] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260925 01:50:08.780560 11753 tablet_bootstrap.cc:492] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:08.790045 11753 tablet_bootstrap.cc:654] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.789986 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6fff10858b41c8aaf8c32ecb0f9014 (DEFAULT_TABLE table=default.Table_3a09c19d055e4424be5eb589bf3b541a [id=2cc9dc6beafa44cfa5de3f810cb823fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.791070 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6fff10858b41c8aaf8c32ecb0f9014. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:08.795190 11177 consensus_peers.cc:597] T 9b4f4321544a4f1d9de2e50aa5d7b42a P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:08.799196 11753 tablet_bootstrap.cc:492] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:08.799412 11753 ts_tablet_manager.cc:1403] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.001s
I20260925 01:50:08.800436 11753 raft_consensus.cc:359] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.801625 11753 raft_consensus.cc:385] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.801853 11753 raft_consensus.cc:740] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.802239 11753 consensus_queue.cc:260] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.803284 11753 ts_tablet_manager.cc:1434] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260925 01:50:08.805505 11753 tablet_bootstrap.cc:492] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:08.806223 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 758e4d8bc0f5479a9cbca8854a2dd371 (DEFAULT_TABLE table=default.Table_69e8886705ed402ebb51426039c18caf [id=89009e10ee1944ec86e514f8e872fb47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.806607 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758e4d8bc0f5479a9cbca8854a2dd371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.807571 11753 tablet_bootstrap.cc:654] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:08.809413 11314 leader_election.cc:343] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 98ffeb9d70374afdb72a728d7b211d33
I20260925 01:50:08.809542 11314 leader_election.cc:304] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.809747 13321 raft_consensus.cc:2749] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260925 01:50:08.810161 11314 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 95ac080782664fca8661c188ab822e89
I20260925 01:50:08.810369 11314 leader_election.cc:304] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.810626 13321 raft_consensus.cc:2749] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:08.811441 11314 leader_election.cc:304] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d; no voters: b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.811730 13321 raft_consensus.cc:2804] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.811836 13321 raft_consensus.cc:697] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Becoming Leader. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Running, Role: LEADER
I20260925 01:50:08.812073 13321 consensus_queue.cc:237] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:08.812816 11314 leader_election.cc:343] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:08.812983 11314 leader_election.cc:304] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.813649 13261 raft_consensus.cc:2749] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 01:50:08.815276 11314 leader_election.cc:343] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 53d30f4940c44bcf900a8cf0de91a66d
W20260925 01:50:08.815622 11314 leader_election.cc:343] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 45a794ad0d87475a88efc02f5ae080f4
W20260925 01:50:08.816004 11457 leader_election.cc:343] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.820092 11753 tablet_bootstrap.cc:492] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:08.820771 11753 ts_tablet_manager.cc:1403] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260925 01:50:08.821295 11754 tablet_bootstrap.cc:492] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:08.822190 11753 raft_consensus.cc:359] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.822896 11754 tablet_bootstrap.cc:654] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.823442 11753 raft_consensus.cc:385] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.823678 11753 raft_consensus.cc:740] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.823715 13333 consensus_queue.cc:1048] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:08.824159 11753 consensus_queue.cc:260] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.840106 11346 tablet_service.cc:1511] Processing CreateTablet for tablet f159753f46d149e4b5c9e9693f1d0669 (DEFAULT_TABLE table=default.Table_22675d05bfd1432b9c80db3a21a31625 [id=2edb1b6574144635b56174cc0bd83513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.840787 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f159753f46d149e4b5c9e9693f1d0669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.843713 11953 ts_tablet_manager.cc:1950] T 73d9a26bbfd74a30a2ae0a61aacca4d1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:08.844606 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 538) took 8118 ms. Trace:
I20260925 01:50:08.844707 11953 rpcz_store.cc:276] 0925 01:50:00.732498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.732791 (+ 293us) service_pool.cc:224] Handling call
0925 01:50:08.644606 (+7911815us) ts_tablet_manager.cc:1151] Deleting tablet 73d9a26bbfd74a30a2ae0a61aacca4d1
0925 01:50:08.644618 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.689417 (+ 44799us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.742528 (+ 53111us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.844583 (+102055us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7898205}
I20260925 01:50:08.845072 11953 tablet_replica.cc:333] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:08.845274 11953 raft_consensus.cc:2243] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.845448 11953 raft_consensus.cc:2272] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.849327 13333 raft_consensus.cc:493] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.849519 13333 raft_consensus.cc:515] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.850695 13333 leader_election.cc:290] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.829548 11946 ts_tablet_manager.cc:1929] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.833266 11501 tablet_service.cc:1511] Processing CreateTablet for tablet f159753f46d149e4b5c9e9693f1d0669 (DEFAULT_TABLE table=default.Table_22675d05bfd1432b9c80db3a21a31625 [id=2edb1b6574144635b56174cc0bd83513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.851828 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f159753f46d149e4b5c9e9693f1d0669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.854230 11946 log.cc:1199] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/1f778b87d307483b9edb17dce7355a65
I20260925 01:50:08.854400 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 758e4d8bc0f5479a9cbca8854a2dd371 (DEFAULT_TABLE table=default.Table_69e8886705ed402ebb51426039c18caf [id=89009e10ee1944ec86e514f8e872fb47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.854595 11946 ts_tablet_manager.cc:1950] T 1f778b87d307483b9edb17dce7355a65 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.854828 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758e4d8bc0f5479a9cbca8854a2dd371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.858194 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 719) took 3520 ms. Trace:
I20260925 01:50:08.858286 11946 rpcz_store.cc:276] 0925 01:50:05.334366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.334496 (+ 130us) service_pool.cc:224] Handling call
0925 01:50:08.773695 (+3439199us) ts_tablet_manager.cc:1151] Deleting tablet 1f778b87d307483b9edb17dce7355a65
0925 01:50:08.773706 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.794899 (+ 21193us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.829479 (+ 34580us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.854873 (+ 25394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3439062}
I20260925 01:50:08.858800 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 1f778b87d307483b9edb17dce7355a65 (table default.Table_78fa9227d15c432fb2a7b5f1bba2b14c [id=7403f961d61b4ab2b2042f88d1b80db0]) successfully deleted
I20260925 01:50:08.858999 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 73d9a26bbfd74a30a2ae0a61aacca4d1 (table default.Table_62819e2601e6498796cbf6ba500c43de [id=091267034b9049728ddece813abe0fed]) successfully deleted
I20260925 01:50:08.859169 11946 tablet_replica.cc:333] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.859340 11946 raft_consensus.cc:2243] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.859474 11946 raft_consensus.cc:2272] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.846010 11953 ts_tablet_manager.cc:1916] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.860138 11946 ts_tablet_manager.cc:1916] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.876571 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3077f21374d969626972654c7e5e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:08.877174 11753 ts_tablet_manager.cc:1434] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.056s user 0.002s sys 0.000s
I20260925 01:50:08.878204 11314 leader_election.cc:304] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.878803 13261 raft_consensus.cc:2749] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:08.879385 11314 leader_election.cc:343] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: dfde700aff8049f4b10c46059da6907f
I20260925 01:50:08.879962 11314 leader_election.cc:304] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.880467 13261 raft_consensus.cc:3060] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.880789 11753 tablet_bootstrap.cc:492] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:08.882477 11314 leader_election.cc:343] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 53d30f4940c44bcf900a8cf0de91a66d
I20260925 01:50:08.887145 11946 ts_tablet_manager.cc:1929] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.890151 11946 log.cc:1199] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:50:08.895828 11946 ts_tablet_manager.cc:1950] T 5d23c5d52faa4b6da2996fabb16bd74a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:08.896201 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 720) took 3561 ms. Trace:
I20260925 01:50:08.896368 11753 tablet_bootstrap.cc:654] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.896416 11946 rpcz_store.cc:276] 0925 01:50:05.334476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.334660 (+ 184us) service_pool.cc:224] Handling call
0925 01:50:08.859121 (+3524461us) ts_tablet_manager.cc:1151] Deleting tablet 5d23c5d52faa4b6da2996fabb16bd74a
0925 01:50:08.859131 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.867232 (+ 8101us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.887075 (+ 19843us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.896185 (+ 9110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3524317}
I20260925 01:50:08.897929 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5d23c5d52faa4b6da2996fabb16bd74a (table default.Table_82ebda3635eb4fdbb40fd316f06241b8 [id=afe7e3c8eceb40f5b1b0c3809f94e503]) successfully deleted
I20260925 01:50:08.898283 11946 tablet_replica.cc:333] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:08.898499 11946 raft_consensus.cc:2243] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:08.898680 11946 raft_consensus.cc:2272] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:08.901861 11946 ts_tablet_manager.cc:1916] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:08.887125 11755 tablet_bootstrap.cc:492] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:08.907523 11314 leader_election.cc:304] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.907614 11755 ts_tablet_manager.cc:1403] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.400s user 0.004s sys 0.011s
I20260925 01:50:08.902299 13261 raft_consensus.cc:2749] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:08.904848 11379 raft_consensus.cc:3060] T bdf7f544827d4bca97aa6b63c0c48c0d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.913684 13260 raft_consensus.cc:2749] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:08.914435 11755 raft_consensus.cc:359] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.914629 11755 raft_consensus.cc:385] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.914705 11755 raft_consensus.cc:740] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:08.914901 11755 consensus_queue.cc:260] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.915427 11755 ts_tablet_manager.cc:1434] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260925 01:50:08.915714 11755 tablet_bootstrap.cc:492] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:08.918936 11755 tablet_bootstrap.cc:654] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.919159 11753 tablet_bootstrap.cc:492] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:08.919389 11753 ts_tablet_manager.cc:1403] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260925 01:50:08.920430 11753 raft_consensus.cc:359] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.920702 11753 raft_consensus.cc:385] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:08.920807 11753 raft_consensus.cc:740] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:08.921463 11314 leader_election.cc:343] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 45a794ad0d87475a88efc02f5ae080f4
I20260925 01:50:08.921401 11753 consensus_queue.cc:260] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.921641 11314 leader_election.cc:304] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:08.922127 13261 raft_consensus.cc:2749] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:08.922240 11753 ts_tablet_manager.cc:1434] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:08.922633 11753 tablet_bootstrap.cc:492] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:08.928606 11314 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 06fca09010f841c5a7b58678560065f3
I20260925 01:50:08.931689 11753 tablet_bootstrap.cc:654] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:08.830425 11221 tablet_service.cc:1511] Processing CreateTablet for tablet f159753f46d149e4b5c9e9693f1d0669 (DEFAULT_TABLE table=default.Table_22675d05bfd1432b9c80db3a21a31625 [id=2edb1b6574144635b56174cc0bd83513]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.938308 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f159753f46d149e4b5c9e9693f1d0669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.940356 13209 consensus_queue.cc:1048] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:08.941139 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 821d0330c0ad4fe6bc9cfdb059ff865a (DEFAULT_TABLE table=default.Table_34acdfc8c4114f2faf38426ee11720cb [id=69383c0e5c1a438f8426cb216d8311e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.941521 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821d0330c0ad4fe6bc9cfdb059ff865a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.833024 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 821d0330c0ad4fe6bc9cfdb059ff865a (DEFAULT_TABLE table=default.Table_34acdfc8c4114f2faf38426ee11720cb [id=69383c0e5c1a438f8426cb216d8311e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.942559 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821d0330c0ad4fe6bc9cfdb059ff865a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.851550 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3077f21374d969626972654c7e5e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:08.946264 11237 raft_consensus.cc:2468] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:08.946622 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 0607723d7c4640f9842db4d658626435 (DEFAULT_TABLE table=default.Table_dc930962532b405ea882720e38cde06c [id=5067e2fd5ab841dcaa440259ebd654b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.947043 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0607723d7c4640f9842db4d658626435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.947067 11456 leader_election.cc:304] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.947357 13333 raft_consensus.cc:2804] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:08.947445 13333 raft_consensus.cc:493] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:08.947513 13333 raft_consensus.cc:3060] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.915684 13140 consensus_queue.cc:1048] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:08.950826 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 0607723d7c4640f9842db4d658626435 (DEFAULT_TABLE table=default.Table_dc930962532b405ea882720e38cde06c [id=5067e2fd5ab841dcaa440259ebd654b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.951190 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0607723d7c4640f9842db4d658626435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.951478 11953 ts_tablet_manager.cc:1929] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:08.951607 11953 log.cc:1199] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/38082c23d99148bb916b0ae74fd474b8
I20260925 01:50:08.951954 11953 ts_tablet_manager.cc:1950] T 38082c23d99148bb916b0ae74fd474b8 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:08.952302 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 539) took 8219 ms. Trace:
I20260925 01:50:08.952389 11953 rpcz_store.cc:276] 0925 01:50:00.732683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.732743 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:08.845009 (+8112266us) ts_tablet_manager.cc:1151] Deleting tablet 38082c23d99148bb916b0ae74fd474b8
0925 01:50:08.845024 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.898790 (+ 53766us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.951401 (+ 52611us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:08.952281 (+ 880us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8097240}
I20260925 01:50:08.952960 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 38082c23d99148bb916b0ae74fd474b8 (table default.Table_c6503d38584945e3a845e2f96ab5a4fc [id=093f5fa0a0d340b381d7794eede8d93a]) successfully deleted
I20260925 01:50:08.950040 13333 raft_consensus.cc:515] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.954854 13333 leader_election.cc:290] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:08.955502 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3077f21374d969626972654c7e5e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:08.955694 11237 raft_consensus.cc:3060] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:08.957868 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_12bac6f78c7944d9bb5310a1c312abe3" } modify_external_catalogs: true
I20260925 01:50:08.958086 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_12bac6f78c7944d9bb5310a1c312abe3" } modify_external_catalogs: true
I20260925 01:50:08.959028 11237 raft_consensus.cc:2468] T f1d3077f21374d969626972654c7e5e1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:08.959584 11456 leader_election.cc:304] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:08.961599 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7f46696dc29f42c98ad3344509e8397d" } modify_external_catalogs: true
I20260925 01:50:08.961773 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7f46696dc29f42c98ad3344509e8397d" } modify_external_catalogs: true
I20260925 01:50:08.963263 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b9496066fd384ed5a55cddc646c482f0" } modify_external_catalogs: true
I20260925 01:50:08.963423 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b9496066fd384ed5a55cddc646c482f0" } modify_external_catalogs: true
I20260925 01:50:08.965497 11678 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_7bf2059d1939417f9dc9b05d8a716c76 [id=03d3184bbc30406db8afae3e9f64fb9b] alter complete (version 1)
W20260925 01:50:08.967691 11457 consensus_peers.cc:597] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:08.967947 13333 raft_consensus.cc:2804] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:08.969717 13261 raft_consensus.cc:493] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:08.969926 13261 raft_consensus.cc:515] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:08.968700 11457 consensus_peers.cc:597] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:08.970713 13261 leader_election.cc:290] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:08.970700 11457 leader_election.cc:343] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:08.971154 13333 raft_consensus.cc:697] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:08.971421 13333 consensus_queue.cc:237] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:08.973439 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 821d0330c0ad4fe6bc9cfdb059ff865a (DEFAULT_TABLE table=default.Table_34acdfc8c4114f2faf38426ee11720cb [id=69383c0e5c1a438f8426cb216d8311e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.973945 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821d0330c0ad4fe6bc9cfdb059ff865a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:08.999147 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 9845a915c8b94fff8660e2e7e86731f3 (table default.Table_b165001c5a09432cbac6ce79abb7b5d2 [id=13825238e94d418694c22d3d5aefb4e1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9845a915c8b94fff8660e2e7e86731f3 consensus state has no leader
I20260925 01:50:08.998857 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 0607723d7c4640f9842db4d658626435 (DEFAULT_TABLE table=default.Table_dc930962532b405ea882720e38cde06c [id=5067e2fd5ab841dcaa440259ebd654b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.999444 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 2eeb5080c601401fbf205d1e1f4dad43 (DEFAULT_TABLE table=default.Table_c48a0c5780c147a49cd23624e0868842 [id=4aaad05f72b54ce2975a2c8379643d84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:08.999756 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0607723d7c4640f9842db4d658626435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:08.999935 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eeb5080c601401fbf205d1e1f4dad43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.000202 11946 ts_tablet_manager.cc:1929] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.001238 11946 log.cc:1199] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/dfde700aff8049f4b10c46059da6907f
I20260925 01:50:09.001627 11946 ts_tablet_manager.cc:1950] T dfde700aff8049f4b10c46059da6907f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.001945 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 721) took 3667 ms. Trace:
W20260925 01:50:09.006371 11314 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 06fca09010f841c5a7b58678560065f3
I20260925 01:50:09.006488 11314 leader_election.cc:304] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.006917 13260 raft_consensus.cc:2749] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.007422 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 2eeb5080c601401fbf205d1e1f4dad43 (DEFAULT_TABLE table=default.Table_c48a0c5780c147a49cd23624e0868842 [id=4aaad05f72b54ce2975a2c8379643d84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.009385 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eeb5080c601401fbf205d1e1f4dad43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.009766 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3077f21374d969626972654c7e5e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:09.010435 11314 leader_election.cc:343] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8c1abd3c2cb34915a595ea73a8d10743
I20260925 01:50:09.014096 11946 rpcz_store.cc:276] 0925 01:50:05.334619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.334666 (+ 47us) service_pool.cc:224] Handling call
0925 01:50:08.898237 (+3563571us) ts_tablet_manager.cc:1151] Deleting tablet dfde700aff8049f4b10c46059da6907f
0925 01:50:08.898246 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:08.924434 (+ 26188us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.000142 (+ 75708us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.001930 (+ 1788us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3563404}
I20260925 01:50:09.015120 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet dfde700aff8049f4b10c46059da6907f (table default.Table_32aa0edcb40b42d39d7a738c77b857fb [id=1ee74b5ac91243c9b7f65e894bbbb7a8]) successfully deleted
I20260925 01:50:09.015479 11946 tablet_replica.cc:333] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.015682 11946 raft_consensus.cc:2243] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.015978 11946 raft_consensus.cc:2272] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:09.019105 11457 leader_election.cc:343] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.014232 11953 tablet_replica.cc:333] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:09.020408 11953 raft_consensus.cc:2243] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.020641 11953 raft_consensus.cc:2272] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.021294 11953 ts_tablet_manager.cc:1916] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.024802 13321 raft_consensus.cc:493] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:09.024977 13321 raft_consensus.cc:515] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.025565 13321 leader_election.cc:290] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:09.030217 11314 leader_election.cc:343] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 8c1abd3c2cb34915a595ea73a8d10743
I20260925 01:50:09.030362 11314 leader_election.cc:304] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.030869 13260 raft_consensus.cc:2749] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:09.040676 11314 leader_election.cc:343] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 96b68399843a422b8da3ddfab2c522e6
W20260925 01:50:09.040969 11314 leader_election.cc:343] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 96b68399843a422b8da3ddfab2c522e6
I20260925 01:50:09.041091 11314 leader_election.cc:304] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.042296 13321 raft_consensus.cc:2749] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:09.043507 11314 consensus_peers.cc:597] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a9944a1422d14ae2b22451e67c477d5b. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:09.050350 11754 tablet_bootstrap.cc:492] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:09.050570 11754 ts_tablet_manager.cc:1403] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.229s user 0.005s sys 0.000s
I20260925 01:50:09.051354 11754 raft_consensus.cc:359] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.051625 11754 raft_consensus.cc:385] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.051735 11754 raft_consensus.cc:740] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.052183 11754 consensus_queue.cc:260] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.053475 11754 ts_tablet_manager.cc:1434] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:09.057166 11753 tablet_bootstrap.cc:492] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.057348 11753 ts_tablet_manager.cc:1403] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.135s user 0.005s sys 0.001s
I20260925 01:50:09.058032 11753 raft_consensus.cc:359] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.058243 11753 raft_consensus.cc:385] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.058316 11753 raft_consensus.cc:740] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.058534 11753 consensus_queue.cc:260] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.059082 11753 ts_tablet_manager.cc:1434] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260925 01:50:09.059540 11953 ts_tablet_manager.cc:1929] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:09.059669 11953 log.cc:1199] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/7ee95aba7a8f4d8db4ed0b8a862dab63
I20260925 01:50:09.060062 11753 tablet_bootstrap.cc:492] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.060073 11953 ts_tablet_manager.cc:1950] T 7ee95aba7a8f4d8db4ed0b8a862dab63 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:09.061007 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 540) took 8196 ms. Trace:
I20260925 01:50:09.062103 11953 rpcz_store.cc:276] 0925 01:50:00.864622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:00.864689 (+ 67us) service_pool.cc:224] Handling call
0925 01:50:09.014177 (+8149488us) ts_tablet_manager.cc:1151] Deleting tablet 7ee95aba7a8f4d8db4ed0b8a862dab63
0925 01:50:09.014188 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.043637 (+ 29449us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.059475 (+ 15838us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.060991 (+ 1516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8149308}
I20260925 01:50:09.062714 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 7ee95aba7a8f4d8db4ed0b8a862dab63 (table default.Table_f4d283936a5f426f85bb58068bf1ba85 [id=56d41c65456f4cf691b9f87319014030]) successfully deleted
I20260925 01:50:09.063618 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 542) took 7904 ms. Trace:
I20260925 01:50:09.063773 11953 rpcz_store.cc:276] 0925 01:50:01.158721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.162408 (+ 3687us) service_pool.cc:224] Handling call
0925 01:50:09.063491 (+7901083us) ts_tablet_manager.cc:1151] Deleting tablet ea0fa393abfe4c5cb5a7f821ffdfaea7
0925 01:50:09.063501 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.063582 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7900916}
W20260925 01:50:09.064320 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ea0fa393abfe4c5cb5a7f821ffdfaea7 because the tablet was not found. No further retry: Not found: Tablet not found: ea0fa393abfe4c5cb5a7f821ffdfaea7
I20260925 01:50:09.066322 11953 tablet_replica.cc:333] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:09.066606 11953 raft_consensus.cc:2243] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.066839 11953 raft_consensus.cc:2272] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.069132 11753 tablet_bootstrap.cc:654] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.069164 11946 ts_tablet_manager.cc:1916] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.073557 11221 tablet_service.cc:1511] Processing CreateTablet for tablet fa4380a06af440308d98a9d29db76313 (DEFAULT_TABLE table=default.Table_802f781d29a44950921e75c254835e2a [id=a5ea17b678514509a9f726696072f5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.074004 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4380a06af440308d98a9d29db76313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.074887 11495 tablet_service.cc:1511] Processing CreateTablet for tablet fa4380a06af440308d98a9d29db76313 (DEFAULT_TABLE table=default.Table_802f781d29a44950921e75c254835e2a [id=a5ea17b678514509a9f726696072f5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.075330 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4380a06af440308d98a9d29db76313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.074906 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 2eeb5080c601401fbf205d1e1f4dad43 (DEFAULT_TABLE table=default.Table_c48a0c5780c147a49cd23624e0868842 [id=4aaad05f72b54ce2975a2c8379643d84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.076208 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eeb5080c601401fbf205d1e1f4dad43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:09.082592 11177 consensus_peers.cc:597] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:09.088353 11753 tablet_bootstrap.cc:492] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.088562 11753 ts_tablet_manager.cc:1403] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.005s
I20260925 01:50:09.089593 11753 raft_consensus.cc:359] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.089823 11753 raft_consensus.cc:385] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.089906 11753 raft_consensus.cc:740] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.090263 11753 consensus_queue.cc:260] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.090888 11753 ts_tablet_manager.cc:1434] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:09.092069 11753 tablet_bootstrap.cc:492] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.092082 11953 ts_tablet_manager.cc:1916] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.092751 13276 raft_consensus.cc:493] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.092895 13276 raft_consensus.cc:515] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.093677 13276 leader_election.cc:290] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.095666 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61b1bf5a8d446918edc6d166b7712ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.095649 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61b1bf5a8d446918edc6d166b7712ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:09.095911 11238 raft_consensus.cc:2468] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:09.096599 11456 leader_election.cc:304] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:09.096818 13276 raft_consensus.cc:2804] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:09.096925 13276 raft_consensus.cc:493] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:09.097005 13276 raft_consensus.cc:3060] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:09.098326 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d28dc51fc345487ba74c56b9b8f1ad42 consensus state has no leader
I20260925 01:50:09.099095 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5204f01643654d3a9a5e6909f6601bb5
I20260925 01:50:09.099522 11754 tablet_bootstrap.cc:492] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:09.100092 13276 raft_consensus.cc:515] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:09.100608 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0492ea6f9d0a4cdf9e339920863b54f9 consensus state has no leader
I20260925 01:50:09.101053 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61b1bf5a8d446918edc6d166b7712ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:09.101209 11238 raft_consensus.cc:3060] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:09.101434 11754 tablet_bootstrap.cc:654] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.101917 11946 ts_tablet_manager.cc:1929] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.102005 11946 log.cc:1199] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b306496f992f45a9b64b05b73712cb5b
I20260925 01:50:09.102182 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 5204f01643654d3a9a5e6909f6601bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:09.102372 11457 leader_election.cc:343] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.104148 11753 tablet_bootstrap.cc:654] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.104967 11238 raft_consensus.cc:2468] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:09.104846 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 5204f01643654d3a9a5e6909f6601bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.102385 11946 ts_tablet_manager.cc:1950] T b306496f992f45a9b64b05b73712cb5b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.113863 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac251aa75344cf8ac29dd30c893d84b (DEFAULT_TABLE table=default.Table_ef8e5edec85740b59397191a9adfb275 [id=05ff6999bd6d41508e65bef07afeaaa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.114388 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac251aa75344cf8ac29dd30c893d84b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.115208 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cf2d103c478e4c228e3e9e3156096833" } modify_external_catalogs: true
I20260925 01:50:09.105353 11456 leader_election.cc:304] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:09.115517 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_cf2d103c478e4c228e3e9e3156096833" } modify_external_catalogs: true
I20260925 01:50:09.115986 13333 raft_consensus.cc:2804] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:09.116101 13333 raft_consensus.cc:697] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:09.116335 13333 consensus_queue.cc:237] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.116627 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 27eeac6081f047c6aa90ef707e1e864d (DEFAULT_TABLE table=default.Table_7aa08be59d354d23b4bcdd766febd19c [id=d21ab55c20b748f7adec08689cc41469]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.117157 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6d210730598c4d58b3e79667f69388b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.117520 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac251aa75344cf8ac29dd30c893d84b (DEFAULT_TABLE table=default.Table_ef8e5edec85740b59397191a9adfb275 [id=05ff6999bd6d41508e65bef07afeaaa5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:09.117808 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d210730598c4d58b3e79667f69388b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.118356 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_38b0c6e5f96842ad958e8d24379e8b22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.118479 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 27eeac6081f047c6aa90ef707e1e864d (DEFAULT_TABLE table=default.Table_7aa08be59d354d23b4bcdd766febd19c [id=d21ab55c20b748f7adec08689cc41469]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.118784 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 592e3eebb507494bbb28a03482c11392 (DEFAULT_TABLE table=default.Table_e7b218fb25c34d70b618138a743d1070 [id=6ad1f799808e4508a22cf8558b1facaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.118994 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27eeac6081f047c6aa90ef707e1e864d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:09.119004 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38b0c6e5f96842ad958e8d24379e8b22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.119192 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592e3eebb507494bbb28a03482c11392. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:09.123782 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5204f01643654d3a9a5e6909f6601bb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5204f01643654d3a9a5e6909f6601bb5 already in progress: creating tablet
I20260925 01:50:09.124347 11671 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e26b1dc65fc84629a72029519919ae23 (table default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]). Expected version 1 got 0
I20260925 01:50:09.125826 13210 raft_consensus.cc:493] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.126006 13210 raft_consensus.cc:515] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.126708 13210 leader_election.cc:290] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.126865 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fb943909bd9f467ea5a0d11972b7ae55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.127069 13276 leader_election.cc:290] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:09.127498 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb943909bd9f467ea5a0d11972b7ae55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.136351 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5366f2487b444e12ad9d63d6825d5e97
I20260925 01:50:09.137126 11677 catalog_manager.cc:6934] ReplaceTablet: tablet 5366f2487b444e12ad9d63d6825d5e97 deleted and replaced by tablet 974467b4e375470094d56c16218cef9c
I20260925 01:50:09.137895 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_a9bdcb0034c84520a7d9881bc8927159 [id=372975f12d544860a00670c2763bbbb4] alter complete (version 3)
W20260925 01:50:09.140563 11675 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.193:42829 (request call id 143) took 787 ms (client timeout 1000 ms). Trace:
W20260925 01:50:09.142633 11678 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.195:44907 (request call id 148) took 815 ms (client timeout 1000 ms). Trace:
W20260925 01:50:09.142738 11678 rpcz_store.cc:269] 0925 01:50:08.326666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.349336 (+ 22670us) service_pool.cc:224] Handling call
0925 01:50:09.142576 (+793240us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:50:08.696846 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:50:08.696961 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:50:08.696966 (+ 5us) write_op.cc:435] Acquired schema lock
0925 01:50:08.696968 (+ 2us) tablet.cc:662] Decoding operations
0925 01:50:08.697043 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:50:08.697050 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0925 01:50:08.697055 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0925 01:50:08.697106 (+ 51us) tablet.cc:701] Row locks acquired
0925 01:50:08.697109 (+ 3us) write_op.cc:260] PREPARE: finished
0925 01:50:08.697142 (+ 33us) write_op.cc:270] Start()
0925 01:50:08.697173 (+ 31us) write_op.cc:276] Timestamp: P: 1790301008697119 usec, L: 0
0925 01:50:08.697178 (+ 5us) op_driver.cc:348] REPLICATION: starting
0925 01:50:08.697318 (+ 140us) log.cc:844] Serialized 356 byte log entry
0925 01:50:08.954673 (+257355us) op_driver.cc:464] REPLICATION: finished
0925 01:50:08.954842 (+ 169us) write_op.cc:301] APPLY: starting
0925 01:50:08.954861 (+ 19us) tablet.cc:1394] starting BulkCheckPresence
0925 01:50:08.964624 (+ 9763us) tablet.cc:1397] finished BulkCheckPresence
0925 01:50:08.964685 (+ 61us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:50:08.964775 (+ 90us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:50:08.964818 (+ 43us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 01:50:08.964830 (+ 12us) write_op.cc:312] APPLY: finished
0925 01:50:08.965000 (+ 170us) log.cc:844] Serialized 23 byte log entry
0925 01:50:08.965285 (+ 285us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:08.965306 (+ 21us) write_op.cc:454] Released schema lock
0925 01:50:08.965315 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0925 01:50:08.966240 (+ 925us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:08.966249 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":674,"apply.run_wall_time_us":11388,"num_ops":1,"prepare.queue_time_us":174859,"prepare.run_cpu_time_us":540,"prepare.run_wall_time_us":538,"replication_time_us":257423}]]}
I20260925 01:50:09.144212 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac251aa75344cf8ac29dd30c893d84b (DEFAULT_TABLE table=default.Table_ef8e5edec85740b59397191a9adfb275 [id=05ff6999bd6d41508e65bef07afeaaa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.144387 11355 tablet_service.cc:1511] Processing CreateTablet for tablet fa4380a06af440308d98a9d29db76313 (DEFAULT_TABLE table=default.Table_802f781d29a44950921e75c254835e2a [id=a5ea17b678514509a9f726696072f5d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.144599 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac251aa75344cf8ac29dd30c893d84b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.150862 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46004be36b543a395a783a13b1b14cf" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:09.151978 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac251aa75344cf8ac29dd30c893d84b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:09.140683 11675 rpcz_store.cc:269] 0925 01:50:08.353334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.365428 (+ 12094us) service_pool.cc:224] Handling call
0925 01:50:09.140524 (+775096us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:50:08.697420 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:50:08.697505 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:50:08.697509 (+ 4us) write_op.cc:435] Acquired schema lock
0925 01:50:08.697512 (+ 3us) tablet.cc:662] Decoding operations
0925 01:50:08.697700 (+ 188us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:50:08.697708 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0925 01:50:08.697712 (+ 4us) tablet.cc:685] Acquiring locks for 3 operations
0925 01:50:08.697786 (+ 74us) tablet.cc:701] Row locks acquired
0925 01:50:08.697788 (+ 2us) write_op.cc:260] PREPARE: finished
0925 01:50:08.697815 (+ 27us) write_op.cc:270] Start()
0925 01:50:08.697836 (+ 21us) write_op.cc:276] Timestamp: P: 1790301008697794 usec, L: 0
0925 01:50:08.697839 (+ 3us) op_driver.cc:348] REPLICATION: starting
0925 01:50:08.697967 (+ 128us) log.cc:844] Serialized 1302 byte log entry
0925 01:50:08.954867 (+256900us) op_driver.cc:464] REPLICATION: finished
0925 01:50:08.954948 (+ 81us) write_op.cc:301] APPLY: starting
0925 01:50:08.954957 (+ 9us) tablet.cc:1394] starting BulkCheckPresence
0925 01:50:08.955030 (+ 73us) tablet.cc:1397] finished BulkCheckPresence
0925 01:50:08.955070 (+ 40us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:50:08.955168 (+ 98us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:50:08.955210 (+ 42us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0925 01:50:08.955220 (+ 10us) write_op.cc:312] APPLY: finished
0925 01:50:08.955323 (+ 103us) log.cc:844] Serialized 35 byte log entry
0925 01:50:08.955389 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:08.955411 (+ 22us) write_op.cc:454] Released schema lock
0925 01:50:08.955419 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0925 01:50:08.955502 (+ 83us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:08.955506 (+ 4us) write_op.cc:454] Released schema lock
Related trace 'op':
0925 01:50:08.986175 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:50:08.986322 (+ 147us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:50:08.986351 (+ 29us) write_op.cc:435] Acquired schema lock
0925 01:50:08.986356 (+ 5us) tablet.cc:662] Decoding operations
0925 01:50:08.986511 (+ 155us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:50:08.986521 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0925 01:50:08.986526 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0925 01:50:08.986635 (+ 109us) tablet.cc:701] Row locks acquired
0925 01:50:08.986637 (+ 2us) write_op.cc:260] PREPARE: finished
0925 01:50:08.986693 (+ 56us) write_op.cc:270] Start()
0925 01:50:08.986722 (+ 29us) write_op.cc:276] Timestamp: P: 1790301008986615 usec, L: 0
0925 01:50:08.986726 (+ 4us) op_driver.cc:348] REPLICATION: starting
0925 01:50:08.987055 (+ 329us) log.cc:844] Serialized 356 byte log entry
0925 01:50:09.134782 (+147727us) op_driver.cc:464] REPLICATION: finished
0925 01:50:09.135490 (+ 708us) write_op.cc:301] APPLY: starting
0925 01:50:09.135504 (+ 14us) tablet.cc:1394] starting BulkCheckPresence
0925 01:50:09.135538 (+ 34us) tablet.cc:1397] finished BulkCheckPresence
0925 01:50:09.135565 (+ 27us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:50:09.135615 (+ 50us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:50:09.135647 (+ 32us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 01:50:09.135656 (+ 9us) write_op.cc:312] APPLY: finished
0925 01:50:09.135721 (+ 65us) log.cc:844] Serialized 23 byte log entry
0925 01:50:09.135769 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:09.135783 (+ 14us) write_op.cc:454] Released schema lock
0925 01:50:09.135791 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":37,"apply.run_cpu_time_us":543,"apply.run_wall_time_us":543,"num_ops":3,"prepare.queue_time_us":174142,"prepare.run_cpu_time_us":621,"prepare.run_wall_time_us":61696,"replication_time_us":256978}],["op",{"apply.queue_time_us":667,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":1,"prepare.queue_time_us":28969,"prepare.run_cpu_time_us":748,"prepare.run_wall_time_us":1283,"replication_time_us":147967}]]}
I20260925 01:50:09.154204 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 5366f2487b444e12ad9d63d6825d5e97 with delete_type TABLET_DATA_DELETED (replaced by tablet 974467b4e375470094d56c16218cef9c) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.154794 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 5366f2487b444e12ad9d63d6825d5e97 with delete_type TABLET_DATA_DELETED (replaced by tablet 974467b4e375470094d56c16218cef9c) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.154852 11493 tablet_service.cc:1558] Processing DeleteTablet for tablet 01d50e428bfc46caa130f96ccc7e8f40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.154981 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet be89c0911dfa4b9d83d6bd88755be2b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.155366 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c886579e1eb4cac958514f7dc53b7b8) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.156586 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.156793 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet f46004be36b543a395a783a13b1b14cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.156845 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c886579e1eb4cac958514f7dc53b7b8) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:09.157088 11176 leader_election.cc:343] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.157097 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet d253f8b1e4ac41388a885178f2ed0f40 with delete_type TABLET_DATA_DELETED (replaced by tablet 92cadafa2a624e08a4d98faf842cfcf0) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.157310 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.157480 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet fce91b00d3a14e6398abacad61ff5b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.158169 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa4380a06af440308d98a9d29db76313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.158524 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b61b1bf5a8d446918edc6d166b7712ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:09.159047 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:09.159288 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 52c716eb26d04a33b4c3b3c56a7fbac6
I20260925 01:50:09.159777 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 5366f2487b444e12ad9d63d6825d5e97 with delete_type TABLET_DATA_DELETED (replaced by tablet 974467b4e375470094d56c16218cef9c) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.159982 13356 tablet_replica.cc:333] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:09.160163 13356 raft_consensus.cc:2243] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.160323 13356 raft_consensus.cc:2272] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.161168 13356 ts_tablet_manager.cc:1916] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:09.161321 11457 leader_election.cc:343] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.162348 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.163182 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8e4a66ea46ca4aab97b4dda13f04a5b2" } new_table_name: "default.Table_129b517604f94f689b9418698f02a01f" modify_external_catalogs: true
I20260925 01:50:09.163753 11753 tablet_bootstrap.cc:492] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.163874 11753 ts_tablet_manager.cc:1403] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.072s user 0.011s sys 0.009s
I20260925 01:50:09.165319 11753 raft_consensus.cc:359] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.165344 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_20874b6d35274058ba18b6a7b09c2162"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.165503 11753 raft_consensus.cc:385] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.165551 11753 raft_consensus.cc:740] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:09.165944 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20874b6d35274058ba18b6a7b09c2162 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.166249 11753 consensus_queue.cc:260] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.167227 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.168850 13356 ts_tablet_manager.cc:1929] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.170464 13356 log.cc:1199] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/04f412cbebe04a629070aecf2753287c
I20260925 01:50:09.170432 13210 raft_consensus.cc:493] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.170922 13356 ts_tablet_manager.cc:1950] T 04f412cbebe04a629070aecf2753287c P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:09.170954 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f064ea2300ec4c6e809d8b54a18da7c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.170964 13210 raft_consensus.cc:515] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:09.171581 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f064ea2300ec4c6e809d8b54a18da7c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.171903 13210 leader_election.cc:290] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.174012 13356 tablet_replica.cc:333] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:09.176245 11676 catalog_manager.cc:5838] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:09.176743 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 6a9ccd099cba4b92909bb17c45dfce8a (table default.Table_a6b67f9415ae41dbaf3903dbbaec308f [id=c23a94a77b36437f843f323488d4ed42]). Expected version 1 got 0
I20260925 01:50:09.175027 13210 raft_consensus.cc:493] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.177004 13210 raft_consensus.cc:515] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.177273 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 04f412cbebe04a629070aecf2753287c (table default.Table_74c3e602a0454e0e8b4e734dc8dea4c6 [id=34ad0afe75be4b6b97e619d27ca2da1a]) successfully deleted
I20260925 01:50:09.177302 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31353cc95e014e5bb24e5e5cefab1503" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:09.177500 11516 raft_consensus.cc:2468] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:09.177070 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 60411b0feafe4fef9c4fdc364163f1df (table default.Table_9c96e3747586472d861731441a16b7eb [id=0848b51bdadb45b5b1a5357208cfcd58]). Expected version 4 got 0
I20260925 01:50:09.177663 13210 leader_election.cc:290] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.177783 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 724) took 3787 ms. Trace:
I20260925 01:50:09.177757 11676 catalog_manager.cc:5838] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:09.177867 11946 rpcz_store.cc:276] 0925 01:50:05.390689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.420984 (+ 30295us) service_pool.cc:224] Handling call
0925 01:50:09.015440 (+3594456us) ts_tablet_manager.cc:1151] Deleting tablet b306496f992f45a9b64b05b73712cb5b
0925 01:50:09.015448 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.083904 (+ 68456us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.101863 (+ 17959us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.177762 (+ 75899us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3588189}
I20260925 01:50:09.178154 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]). Expected version 2 got 0
I20260925 01:50:09.178340 11176 leader_election.cc:304] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:09.178426 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 4 got 0
I20260925 01:50:09.178397 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b306496f992f45a9b64b05b73712cb5b (table default.Table_04449fc82e9a480cbd1dfa613ef87dbd [id=5fff99035f0e4089bf06b22ac548e8d2]) successfully deleted
I20260925 01:50:09.178766 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:09.178808 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c01195f07b84b359a974fab5ed52582" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:50:09.179271 11176 leader_election.cc:343] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.179654 11753 ts_tablet_manager.cc:1434] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260925 01:50:09.179644 13210 raft_consensus.cc:2804] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:09.179724 13210 raft_consensus.cc:493] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:09.179832 13210 raft_consensus.cc:3060] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:09.181676 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e4d3293730684400a84f1ca62bb6a95d
I20260925 01:50:09.182833 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet e4d3293730684400a84f1ca62bb6a95d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.183166 13210 raft_consensus.cc:515] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.183337 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet e4d3293730684400a84f1ca62bb6a95d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.183920 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 7809737ca3d24bfe8829f17d5e3215f5
I20260925 01:50:09.184608 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31353cc95e014e5bb24e5e5cefab1503" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:09.184791 11516 raft_consensus.cc:3060] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:09.184798 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 7809737ca3d24bfe8829f17d5e3215f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.185504 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 7809737ca3d24bfe8829f17d5e3215f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.185575 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 007ee8e3087c4a70b9c5d8436a31659f
I20260925 01:50:09.186302 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 007ee8e3087c4a70b9c5d8436a31659f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.187109 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 007ee8e3087c4a70b9c5d8436a31659f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.187846 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e119f5d392bc4cae8bf871b63c0f9f40" } new_table_name: "default.Table_8807c2d9efbc4bab8578c7e71d0ec290" modify_external_catalogs: true
I20260925 01:50:09.188481 11516 raft_consensus.cc:2468] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:09.188839 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_29deefa840a94103b15dd6b08f23d076"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.189110 11176 leader_election.cc:304] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:50:09.189432 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29deefa840a94103b15dd6b08f23d076 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.189634 13140 raft_consensus.cc:2804] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:09.189682 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 592e3eebb507494bbb28a03482c11392 (DEFAULT_TABLE table=default.Table_e7b218fb25c34d70b618138a743d1070 [id=6ad1f799808e4508a22cf8558b1facaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.189766 13140 raft_consensus.cc:697] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:09.190047 13140 consensus_queue.cc:237] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.190362 13210 leader_election.cc:290] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.190505 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 5204f01643654d3a9a5e6909f6601bb5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.190729 13356 raft_consensus.cc:2243] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.190873 13356 raft_consensus.cc:2272] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.190923 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 27eeac6081f047c6aa90ef707e1e864d (DEFAULT_TABLE table=default.Table_7aa08be59d354d23b4bcdd766febd19c [id=d21ab55c20b748f7adec08689cc41469]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.191331 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27eeac6081f047c6aa90ef707e1e864d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.191432 13356 ts_tablet_manager.cc:1916] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.191727 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31353cc95e014e5bb24e5e5cefab1503" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.192086 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c01195f07b84b359a974fab5ed52582" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.192384 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31353cc95e014e5bb24e5e5cefab1503" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:09.193519 11177 leader_election.cc:343] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:09.193836 11177 leader_election.cc:343] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.193910 11177 leader_election.cc:304] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:09.194298 11177 leader_election.cc:343] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.194736 13209 raft_consensus.cc:2749] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.194825 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 7809737ca3d24bfe8829f17d5e3215f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.194957 11348 tablet_service.cc:1558] Processing DeleteTablet for tablet 007ee8e3087c4a70b9c5d8436a31659f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.194980 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet e4d3293730684400a84f1ca62bb6a95d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.195353 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 592e3eebb507494bbb28a03482c11392 (DEFAULT_TABLE table=default.Table_e7b218fb25c34d70b618138a743d1070 [id=6ad1f799808e4508a22cf8558b1facaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.195833 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592e3eebb507494bbb28a03482c11392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.198174 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:08 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.198770 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27eeac6081f047c6aa90ef707e1e864d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.198988 11946 tablet_replica.cc:333] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.199200 11946 raft_consensus.cc:2243] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.199342 11946 raft_consensus.cc:2272] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.199857 11946 ts_tablet_manager.cc:1916] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.205963 11946 ts_tablet_manager.cc:1929] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.206645 11946 log.cc:1199] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/829d167dc0214890b722c0197500f159
I20260925 01:50:09.206984 11946 ts_tablet_manager.cc:1950] T 829d167dc0214890b722c0197500f159 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.207736 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 723) took 3817 ms. Trace:
I20260925 01:50:09.207829 11946 rpcz_store.cc:276] 0925 01:50:05.390514 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.424630 (+ 34116us) service_pool.cc:224] Handling call
0925 01:50:09.178183 (+3753553us) ts_tablet_manager.cc:1151] Deleting tablet 829d167dc0214890b722c0197500f159
0925 01:50:09.198940 (+ 20757us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.203172 (+ 4232us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.205920 (+ 2748us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.207714 (+ 1794us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":471,"tablet-delete.queue_time_us":3749734}
I20260925 01:50:09.208295 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 722) took 3827 ms. Trace:
I20260925 01:50:09.208376 11946 rpcz_store.cc:276] 0925 01:50:05.380547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.502884 (+122337us) service_pool.cc:224] Handling call
0925 01:50:09.208132 (+3705248us) ts_tablet_manager.cc:1151] Deleting tablet 6439ba0b0468416d9798a6ac1ee7fddd
0925 01:50:09.208143 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.208278 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3705031}
I20260925 01:50:09.208477 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 829d167dc0214890b722c0197500f159 (table default.Table_5ee00c6a9b644c778e571ff1952327d1 [id=83d275d67d4340e985a5c6a6e3354c45]) successfully deleted
I20260925 01:50:09.208753 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 726) took 3696 ms. Trace:
I20260925 01:50:09.208822 11946 rpcz_store.cc:276] 0925 01:50:05.511901 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.540733 (+ 28832us) service_pool.cc:224] Handling call
0925 01:50:09.208643 (+3667910us) ts_tablet_manager.cc:1151] Deleting tablet 41c58f974b1c4334852b7e17b4da7867
0925 01:50:09.208653 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.208738 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3667718}
I20260925 01:50:09.209141 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 728) took 3689 ms. Trace:
I20260925 01:50:09.209219 11946 rpcz_store.cc:276] 0925 01:50:05.519247 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.602139 (+ 82892us) service_pool.cc:224] Handling call
0925 01:50:09.209035 (+3606896us) ts_tablet_manager.cc:1151] Deleting tablet 38603da7b4b14ce5835646c330b1f0ce
0925 01:50:09.209045 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.209124 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3606585}
I20260925 01:50:09.209550 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 727) took 3696 ms. Trace:
W20260925 01:50:09.209582 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 6439ba0b0468416d9798a6ac1ee7fddd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6439ba0b0468416d9798a6ac1ee7fddd already in progress: creating tablet
I20260925 01:50:09.209630 11946 rpcz_store.cc:276] 0925 01:50:05.512934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.607751 (+ 94817us) service_pool.cc:224] Handling call
0925 01:50:09.209453 (+3601702us) ts_tablet_manager.cc:1151] Deleting tablet b0e27b81d39240efa5136ed668822d35
0925 01:50:09.209461 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.209536 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3601484}
I20260925 01:50:09.209957 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 725) took 3701 ms. Trace:
W20260925 01:50:09.210245 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 41c58f974b1c4334852b7e17b4da7867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41c58f974b1c4334852b7e17b4da7867 already in progress: creating tablet
W20260925 01:50:09.210561 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 38603da7b4b14ce5835646c330b1f0ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38603da7b4b14ce5835646c330b1f0ce already in progress: creating tablet
W20260925 01:50:09.210893 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b0e27b81d39240efa5136ed668822d35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0e27b81d39240efa5136ed668822d35 already in progress: creating tablet
I20260925 01:50:09.210968 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592e3eebb507494bbb28a03482c11392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.213341 11953 ts_tablet_manager.cc:1929] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.213536 11953 log.cc:1199] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/4d7b3c65d8a64734b2c432790dae07e1
I20260925 01:50:09.214000 11953 ts_tablet_manager.cc:1950] T 4d7b3c65d8a64734b2c432790dae07e1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:09.216025 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 8f818ae2139047f28958cefaa26ade65 (DEFAULT_TABLE table=default.Table_e151170fc7c54353aef81e4be2335941 [id=91778a763fb74de6ae558d66ac247339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.216480 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f818ae2139047f28958cefaa26ade65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.222981 11753 tablet_bootstrap.cc:492] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.224792 11753 tablet_bootstrap.cc:654] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.210031 11946 rpcz_store.cc:276] 0925 01:50:05.508310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.629001 (+120691us) service_pool.cc:224] Handling call
0925 01:50:09.209836 (+3580835us) ts_tablet_manager.cc:1151] Deleting tablet 7ad519d103e644e1b78ce540d623cbcb
0925 01:50:09.209844 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.209942 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3580592}
W20260925 01:50:09.226424 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7ad519d103e644e1b78ce540d623cbcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ad519d103e644e1b78ce540d623cbcb already in progress: creating tablet
I20260925 01:50:09.226837 11946 tablet_replica.cc:333] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.227070 11946 raft_consensus.cc:2243] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.228521 11204 tablet_service.cc:1511] Processing CreateTablet for tablet f185061e6f1a48ab993aa7c79e5bc479 (DEFAULT_TABLE table=default.Table_e787a9a0909645f19a441b5e7c22cc16 [id=9452dcf0c6d4441fb4aa46a9cb135dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.229717 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 25d505edfadd4b4da0331ae6a5b924ab (DEFAULT_TABLE table=default.Table_f304a261ed084fdaa807544fafad7c30 [id=c65e5834054843f9a09b410fbd246adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.230683 11211 tablet_service.cc:1511] Processing CreateTablet for tablet b7457026bbf14466bb3585d514d4d898 (DEFAULT_TABLE table=default.Table_564e5d550937462b9b930df2e64cf028 [id=678bcec388a64f5ba1332013696a4937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.227794 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 8f818ae2139047f28958cefaa26ade65 (DEFAULT_TABLE table=default.Table_e151170fc7c54353aef81e4be2335941 [id=91778a763fb74de6ae558d66ac247339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.229343 11494 tablet_service.cc:1511] Processing CreateTablet for tablet f185061e6f1a48ab993aa7c79e5bc479 (DEFAULT_TABLE table=default.Table_e787a9a0909645f19a441b5e7c22cc16 [id=9452dcf0c6d4441fb4aa46a9cb135dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.229924 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 25d505edfadd4b4da0331ae6a5b924ab (DEFAULT_TABLE table=default.Table_f304a261ed084fdaa807544fafad7c30 [id=c65e5834054843f9a09b410fbd246adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.231500 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d505edfadd4b4da0331ae6a5b924ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.234287 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f185061e6f1a48ab993aa7c79e5bc479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.244622 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f818ae2139047f28958cefaa26ade65. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:09.244851 11177 consensus_peers.cc:597] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:09.245002 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f185061e6f1a48ab993aa7c79e5bc479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.245822 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7457026bbf14466bb3585d514d4d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.230756 11946 raft_consensus.cc:2272] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.247189 11946 ts_tablet_manager.cc:1916] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.250188 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d505edfadd4b4da0331ae6a5b924ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.255208 11494 tablet_service.cc:1511] Processing CreateTablet for tablet b7457026bbf14466bb3585d514d4d898 (DEFAULT_TABLE table=default.Table_564e5d550937462b9b930df2e64cf028 [id=678bcec388a64f5ba1332013696a4937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.255684 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7457026bbf14466bb3585d514d4d898. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.265872 13140 raft_consensus.cc:493] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.266000 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet 4cd34fa172904e51ade794892c580248 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:09.266008 13140 raft_consensus.cc:515] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.266670 13140 leader_election.cc:290] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.267369 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ecfc5a2a80449c9905c83b6bcb3652" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:50:09.267979 11176 leader_election.cc:343] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.267849 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 87cdf7b211464fdc94300602ef67fb3c (DEFAULT_TABLE table=default.Table_dec4d5d1dd154b1e89b802e5587f1dbe [id=0c74ab28745143dc92c5787ba5fa71f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.268509 13356 ts_tablet_manager.cc:1929] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.269565 11946 ts_tablet_manager.cc:1929] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.272953 11946 log.cc:1199] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/770ebdbd355142ba86fd9eb8eaa844f4
I20260925 01:50:09.273572 11946 ts_tablet_manager.cc:1950] T 770ebdbd355142ba86fd9eb8eaa844f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.273757 13356 log.cc:1199] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/f46004be36b543a395a783a13b1b14cf
I20260925 01:50:09.275377 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 732) took 3597 ms. Trace:
I20260925 01:50:09.268545 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cdf7b211464fdc94300602ef67fb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.273556 13140 consensus_queue.cc:1048] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:09.276475 11946 rpcz_store.cc:276] 0925 01:50:05.677668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.677768 (+ 100us) service_pool.cc:224] Handling call
0925 01:50:09.226787 (+3549019us) ts_tablet_manager.cc:1151] Deleting tablet 770ebdbd355142ba86fd9eb8eaa844f4
0925 01:50:09.226797 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.252375 (+ 25578us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.269516 (+ 17141us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.275357 (+ 5841us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3548663}
I20260925 01:50:09.274005 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 87cdf7b211464fdc94300602ef67fb3c (DEFAULT_TABLE table=default.Table_dec4d5d1dd154b1e89b802e5587f1dbe [id=0c74ab28745143dc92c5787ba5fa71f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.277547 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cdf7b211464fdc94300602ef67fb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.279069 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 543) took 8120 ms. Trace:
I20260925 01:50:09.228037 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 8f818ae2139047f28958cefaa26ade65 (DEFAULT_TABLE table=default.Table_e151170fc7c54353aef81e4be2335941 [id=91778a763fb74de6ae558d66ac247339]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.279500 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f818ae2139047f28958cefaa26ade65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.228811 11359 tablet_service.cc:1511] Processing CreateTablet for tablet f185061e6f1a48ab993aa7c79e5bc479 (DEFAULT_TABLE table=default.Table_e787a9a0909645f19a441b5e7c22cc16 [id=9452dcf0c6d4441fb4aa46a9cb135dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.282124 13356 ts_tablet_manager.cc:1950] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:09.282408 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f185061e6f1a48ab993aa7c79e5bc479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.283917 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 735) took 3585 ms. Trace:
I20260925 01:50:09.283995 11946 rpcz_store.cc:276] 0925 01:50:05.698822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.699597 (+ 775us) service_pool.cc:224] Handling call
0925 01:50:09.283785 (+3584188us) ts_tablet_manager.cc:1151] Deleting tablet f1e89d9f87104c768839104c80614f5e
0925 01:50:09.283795 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.283891 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3516735}
I20260925 01:50:09.285018 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 741) took 3380 ms. Trace:
I20260925 01:50:09.285089 11946 rpcz_store.cc:276] 0925 01:50:05.904254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.904792 (+ 538us) service_pool.cc:224] Handling call
0925 01:50:09.284900 (+3380108us) ts_tablet_manager.cc:1151] Deleting tablet d6b0a7ae71724ba385371d3b772b067c
0925 01:50:09.284922 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.285004 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3379943}
I20260925 01:50:09.229651 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 25d505edfadd4b4da0331ae6a5b924ab (DEFAULT_TABLE table=default.Table_f304a261ed084fdaa807544fafad7c30 [id=c65e5834054843f9a09b410fbd246adf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.286123 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d505edfadd4b4da0331ae6a5b924ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.286036 11946 tablet_replica.cc:333] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.286405 11946 raft_consensus.cc:2243] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.286638 13356 tablet_replica.cc:333] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:09.286702 11946 pending_rounds.cc:70] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:09.286743 11946 pending_rounds.cc:77] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072923606454272 op_type: NO_OP noop_request { }
I20260925 01:50:09.286829 13356 raft_consensus.cc:2243] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.287175 13356 raft_consensus.cc:2272] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.286823 11946 raft_consensus.cc:2889] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:09.287636 11946 raft_consensus.cc:2272] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.288146 11946 ts_tablet_manager.cc:1916] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.241315 13261 raft_consensus.cc:493] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.289485 13261 raft_consensus.cc:515] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.290210 13261 leader_election.cc:290] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:09.290450 11361 raft_consensus.cc:3060] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:09.290848 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26b1dc65fc84629a72029519919ae23" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:09.291599 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e26b1dc65fc84629a72029519919ae23" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:09.292075 11314 leader_election.cc:304] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.293919 11946 ts_tablet_manager.cc:1929] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.294008 11946 log.cc:1199] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:50:09.298553 13356 ts_tablet_manager.cc:1916] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.301067 11360 tablet_service.cc:1511] Processing CreateTablet for tablet f8ffc45058774a878d4b802400feecb7 (DEFAULT_TABLE table=default.Table_44b098622a324bd6a415bf756ce0160b [id=3084bc3a144e4f66a71dc80592cec4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.301465 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ffc45058774a878d4b802400feecb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.303027 11946 ts_tablet_manager.cc:1950] T 5b11c6526dbc4177b3a54b3c952bbd31 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.303845 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 740) took 3405 ms. Trace:
I20260925 01:50:09.304352 11946 rpcz_store.cc:276] 0925 01:50:05.897910 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.906124 (+ 8214us) service_pool.cc:224] Handling call
0925 01:50:09.285993 (+3379869us) ts_tablet_manager.cc:1151] Deleting tablet 5b11c6526dbc4177b3a54b3c952bbd31
0925 01:50:09.286002 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.291053 (+ 5051us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.293863 (+ 2810us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.303827 (+ 9964us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3379708}
I20260925 01:50:09.305150 11946 tablet_replica.cc:333] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.305559 11946 raft_consensus.cc:2243] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.256497 11342 tablet_service.cc:1511] Processing CreateTablet for tablet b7457026bbf14466bb3585d514d4d898 (DEFAULT_TABLE table=default.Table_564e5d550937462b9b930df2e64cf028 [id=678bcec388a64f5ba1332013696a4937]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.261355 13260 raft_consensus.cc:493] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.306200 13260 raft_consensus.cc:515] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.306757 11946 pending_rounds.cc:70] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:09.306949 13260 leader_election.cc:290] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:09.306949 11946 pending_rounds.cc:77] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072924169945088 op_type: NO_OP noop_request { }
I20260925 01:50:09.262933 11755 tablet_bootstrap.cc:492] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:09.307178 11755 ts_tablet_manager.cc:1403] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.392s user 0.005s sys 0.007s
I20260925 01:50:09.267270 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ecfc5a2a80449c9905c83b6bcb3652" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.307212 11946 raft_consensus.cc:2889] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:09.307371 11946 raft_consensus.cc:2272] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:09.307765 11177 leader_election.cc:343] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.307883 11177 leader_election.cc:304] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:09.307917 11946 ts_tablet_manager.cc:1916] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.307940 11755 raft_consensus.cc:359] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.308079 11755 raft_consensus.cc:385] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.308135 11755 raft_consensus.cc:740] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.308266 13210 raft_consensus.cc:2749] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.308315 11755 consensus_queue.cc:260] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.270243 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 87cdf7b211464fdc94300602ef67fb3c (DEFAULT_TABLE table=default.Table_dec4d5d1dd154b1e89b802e5587f1dbe [id=0c74ab28745143dc92c5787ba5fa71f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.308900 11755 ts_tablet_manager.cc:1434] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:09.223381 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46004be36b543a395a783a13b1b14cf" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.309160 11755 tablet_bootstrap.cc:492] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:50:09.309417 11177 leader_election.cc:343] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.309520 11177 leader_election.cc:304] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:09.309700 11177 raft_consensus.cc:2686] T f46004be36b543a395a783a13b1b14cf P b93565e796c94a3699eb1824383bbaeb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:09.311025 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7457026bbf14466bb3585d514d4d898. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:09.311180 11314 leader_election.cc:343] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 9cd2e1bf7d3e4459a84235b9c3f5383c
W20260925 01:50:09.311937 11314 leader_election.cc:343] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 9cd2e1bf7d3e4459a84235b9c3f5383c
I20260925 01:50:09.312039 11314 leader_election.cc:304] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.312273 13261 raft_consensus.cc:2749] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:09.315606 11755 tablet_bootstrap.cc:654] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.320907 11946 ts_tablet_manager.cc:1929] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.321264 11946 log.cc:1199] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/fbd4b231f89a48e59e5eb3cf3976385a
I20260925 01:50:09.321857 11946 ts_tablet_manager.cc:1950] T fbd4b231f89a48e59e5eb3cf3976385a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.323220 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 742) took 3418 ms. Trace:
I20260925 01:50:09.324283 11946 rpcz_store.cc:276] 0925 01:50:05.904365 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.913910 (+ 9545us) service_pool.cc:224] Handling call
0925 01:50:09.305107 (+3391197us) ts_tablet_manager.cc:1151] Deleting tablet fbd4b231f89a48e59e5eb3cf3976385a
0925 01:50:09.305117 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.310854 (+ 5737us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.314022 (+ 3168us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.323195 (+ 9173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3390982}
I20260925 01:50:09.325244 11755 tablet_bootstrap.cc:492] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:09.325381 11755 ts_tablet_manager.cc:1403] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260925 01:50:09.325289 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 743) took 3366 ms. Trace:
I20260925 01:50:09.325793 11946 rpcz_store.cc:276] 0925 01:50:05.958520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.958745 (+ 225us) service_pool.cc:224] Handling call
0925 01:50:09.325156 (+3366411us) ts_tablet_manager.cc:1151] Deleting tablet bfc152df745b46fb84aec1c9fa017ba5
0925 01:50:09.325167 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.325271 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3366206}
I20260925 01:50:09.326180 11755 raft_consensus.cc:359] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.326361 11755 raft_consensus.cc:385] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.326416 11755 raft_consensus.cc:740] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.326701 11755 consensus_queue.cc:260] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.327437 11755 ts_tablet_manager.cc:1434] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:09.327874 11755 tablet_bootstrap.cc:492] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:09.329964 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87cdf7b211464fdc94300602ef67fb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.330888 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 745) took 3359 ms. Trace:
I20260925 01:50:09.331146 11946 rpcz_store.cc:276] 0925 01:50:05.971906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.971966 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:09.326606 (+3354640us) ts_tablet_manager.cc:1151] Deleting tablet 22a335062caa48139e1cd4bca7bd4e2b
0925 01:50:09.330749 (+ 4143us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.330866 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3354445}
I20260925 01:50:09.333886 11946 tablet_replica.cc:333] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.333675 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8a2afd07254a16927a4db800985237 (DEFAULT_TABLE table=default.Table_31382de7dc454cf59b1075bd3d55ac9b [id=a479b9eb8f754d48b1d182e28caccd54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.334203 11946 raft_consensus.cc:2243] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.334240 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8a2afd07254a16927a4db800985237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.334448 11946 raft_consensus.cc:2272] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.335073 11946 ts_tablet_manager.cc:1916] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.337966 11755 tablet_bootstrap.cc:654] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.341182 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8a2afd07254a16927a4db800985237 (DEFAULT_TABLE table=default.Table_31382de7dc454cf59b1075bd3d55ac9b [id=a479b9eb8f754d48b1d182e28caccd54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.341820 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8a2afd07254a16927a4db800985237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.341921 11946 ts_tablet_manager.cc:1929] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.343809 11946 log.cc:1199] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/d253f8b1e4ac41388a885178f2ed0f40
I20260925 01:50:09.344336 11946 ts_tablet_manager.cc:1950] T d253f8b1e4ac41388a885178f2ed0f40 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.346274 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 746) took 3343 ms. Trace:
I20260925 01:50:09.347193 11946 rpcz_store.cc:276] 0925 01:50:06.002661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.002718 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:09.331611 (+3328893us) ts_tablet_manager.cc:1151] Deleting tablet d253f8b1e4ac41388a885178f2ed0f40
0925 01:50:09.333832 (+ 2221us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.338370 (+ 4538us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.341871 (+ 3501us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.346253 (+ 4382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3328685}
I20260925 01:50:09.348065 11946 tablet_replica.cc:333] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.348101 13356 ts_tablet_manager.cc:1929] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.348500 11946 raft_consensus.cc:2243] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.349066 11946 pending_rounds.cc:70] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:09.349437 11946 pending_rounds.cc:77] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072924147511296 op_type: NO_OP noop_request { }
I20260925 01:50:09.349690 11946 raft_consensus.cc:2889] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:09.349887 11946 raft_consensus.cc:2272] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.350584 11946 ts_tablet_manager.cc:1916] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.353592 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8a2afd07254a16927a4db800985237 (DEFAULT_TABLE table=default.Table_31382de7dc454cf59b1075bd3d55ac9b [id=a479b9eb8f754d48b1d182e28caccd54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.354044 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8a2afd07254a16927a4db800985237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.356590 11953 rpcz_store.cc:276] 0925 01:50:01.158832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.162601 (+ 3769us) service_pool.cc:224] Handling call
0925 01:50:09.066262 (+7903661us) ts_tablet_manager.cc:1151] Deleting tablet 4d7b3c65d8a64734b2c432790dae07e1
0925 01:50:09.066276 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.156504 (+ 90228us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.213282 (+ 56778us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.279048 (+ 65766us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7903558}
I20260925 01:50:09.358117 11494 tablet_service.cc:1511] Processing CreateTablet for tablet f8ffc45058774a878d4b802400feecb7 (DEFAULT_TABLE table=default.Table_44b098622a324bd6a415bf756ce0160b [id=3084bc3a144e4f66a71dc80592cec4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.358441 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ffc45058774a878d4b802400feecb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.361438 11953 tablet_replica.cc:333] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:09.361690 11953 raft_consensus.cc:2243] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.362483 11953 raft_consensus.cc:2272] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.366170 13356 log.cc:1199] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b91957f62d8044ea8f6a3464c84b9e10
I20260925 01:50:09.366875 13356 ts_tablet_manager.cc:1950] T b91957f62d8044ea8f6a3464c84b9e10 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:09.366971 13261 raft_consensus.cc:493] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.367101 13261 raft_consensus.cc:515] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.367812 13261 leader_election.cc:290] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:09.369505 11314 leader_election.cc:343] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 347a144e18ab4f6e834551044a2ac4ae
W20260925 01:50:09.369761 11314 leader_election.cc:343] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 347a144e18ab4f6e834551044a2ac4ae
I20260925 01:50:09.369851 11314 leader_election.cc:304] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.370292 13271 raft_consensus.cc:2749] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:09.370318 11953 ts_tablet_manager.cc:1916] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.373311 13368 tablet.cc:1751] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:09.373940 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 4d7b3c65d8a64734b2c432790dae07e1 (table default.Table_b00b413ef17343febe7fadd2f08ae596 [id=0cfde61c060841d8b99d75fa7557a258]) successfully deleted
I20260925 01:50:09.378744 11946 ts_tablet_manager.cc:1929] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.379136 13356 tablet_replica.cc:333] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:09.379547 13356 raft_consensus.cc:2243] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.379698 11946 log.cc:1199] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a07f37b8469a497ba3fe504cb21105d2
I20260925 01:50:09.380741 11946 ts_tablet_manager.cc:1950] T a07f37b8469a497ba3fe504cb21105d2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.380756 13356 pending_rounds.cc:70] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:09.380810 13356 pending_rounds.cc:77] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072930793369600 op_type: NO_OP noop_request { }
I20260925 01:50:09.380923 13356 raft_consensus.cc:2889] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:09.381017 13356 raft_consensus.cc:2272] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.383296 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 747) took 3298 ms. Trace:
I20260925 01:50:09.383761 11946 rpcz_store.cc:276] 0925 01:50:06.084743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.085068 (+ 325us) service_pool.cc:224] Handling call
0925 01:50:09.348012 (+3262944us) ts_tablet_manager.cc:1151] Deleting tablet a07f37b8469a497ba3fe504cb21105d2
0925 01:50:09.348025 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.371373 (+ 23348us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.378687 (+ 7314us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.383266 (+ 4579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3259921}
I20260925 01:50:09.384624 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 752) took 2737 ms. Trace:
I20260925 01:50:09.385020 11946 rpcz_store.cc:276] 0925 01:50:06.646811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.646877 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:09.384502 (+2737625us) ts_tablet_manager.cc:1151] Deleting tablet 5048a0fca2e64ffa9f19000f48a4c090
0925 01:50:09.384510 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.384606 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2737382}
I20260925 01:50:09.386178 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 754) took 2736 ms. Trace:
I20260925 01:50:09.386300 11946 rpcz_store.cc:276] 0925 01:50:06.649782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.649845 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:09.385630 (+2735785us) ts_tablet_manager.cc:1151] Deleting tablet 5ef093a4a1134407ba94207137ce3e81
0925 01:50:09.386077 (+ 447us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.386161 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2735637}
I20260925 01:50:09.386831 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 761) took 2733 ms. Trace:
I20260925 01:50:09.387208 11946 rpcz_store.cc:276] 0925 01:50:06.653764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.653815 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:09.386738 (+2732923us) ts_tablet_manager.cc:1151] Deleting tablet 064c6cbe77d0405abe16a9a53d842590
0925 01:50:09.386747 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.386817 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2732740}
I20260925 01:50:09.387955 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 763) took 2734 ms. Trace:
I20260925 01:50:09.388316 11946 rpcz_store.cc:276] 0925 01:50:06.653955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.658758 (+ 4803us) service_pool.cc:224] Handling call
0925 01:50:09.387845 (+2729087us) ts_tablet_manager.cc:1151] Deleting tablet 16dcc2d4bf24480f8e5fe67ae18764d0
0925 01:50:09.387854 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.387928 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2728940}
I20260925 01:50:09.389119 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 764) took 2735 ms. Trace:
I20260925 01:50:09.389488 11946 rpcz_store.cc:276] 0925 01:50:06.654089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.661496 (+ 7407us) service_pool.cc:224] Handling call
0925 01:50:09.389022 (+2727526us) ts_tablet_manager.cc:1151] Deleting tablet 1e1c0285c79b4e1280f3aa732e297c57
0925 01:50:09.389032 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.389102 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2727373}
I20260925 01:50:09.390350 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 765) took 2649 ms. Trace:
I20260925 01:50:09.390733 11946 rpcz_store.cc:276] 0925 01:50:06.741395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.741466 (+ 71us) service_pool.cc:224] Handling call
0925 01:50:09.390256 (+2648790us) ts_tablet_manager.cc:1151] Deleting tablet 507d06f04fb24c1abb9119a0fa5af141
0925 01:50:09.390264 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.390335 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2648621}
I20260925 01:50:09.391498 11946 tablet_replica.cc:333] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.391978 11946 raft_consensus.cc:2243] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.392465 11946 raft_consensus.cc:2272] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.393319 11946 ts_tablet_manager.cc:1916] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.395422 13356 ts_tablet_manager.cc:1916] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.396462 13261 raft_consensus.cc:493] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.396613 13261 raft_consensus.cc:515] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.397280 13261 leader_election.cc:290] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:09.397665 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet f46004be36b543a395a783a13b1b14cf (table default.Table_a0cea089195844d4a3f2e191f31d3750 [id=82de5b3161a5463693e13ea92f4ae6cf]) successfully deleted
W20260925 01:50:09.398367 11314 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 1f778b87d307483b9edb17dce7355a65
I20260925 01:50:09.399374 11754 tablet_bootstrap.cc:492] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
W20260925 01:50:09.399384 11314 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 1f778b87d307483b9edb17dce7355a65
I20260925 01:50:09.399538 11314 leader_election.cc:304] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.399825 13261 raft_consensus.cc:2749] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.399633 11754 ts_tablet_manager.cc:1403] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.300s user 0.005s sys 0.018s
I20260925 01:50:09.401191 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9d7e379c843d492d9c3c54d5d9925e95" } new_table_name: "default.Table_28b35d15250242b4b53514812418ac09" modify_external_catalogs: true
I20260925 01:50:09.401926 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 770ebdbd355142ba86fd9eb8eaa844f4 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]) successfully deleted
I20260925 01:50:09.404098 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_39d57388d36740d1abd89e157d92e8fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.404872 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39d57388d36740d1abd89e157d92e8fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:09.404393 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f1e89d9f87104c768839104c80614f5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1e89d9f87104c768839104c80614f5e already in progress: creating tablet
I20260925 01:50:09.405753 11946 ts_tablet_manager.cc:1929] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.405144 11754 raft_consensus.cc:359] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.406495 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e (DEFAULT_TABLE table=default.Table_853886350ca941199d022640a1251fd3 [id=b297045646b64274923faa096b66bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.407243 11754 raft_consensus.cc:385] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:09.407634 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d6b0a7ae71724ba385371d3b772b067c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6b0a7ae71724ba385371d3b772b067c already in progress: creating tablet
I20260925 01:50:09.408115 11754 raft_consensus.cc:740] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.408892 11946 log.cc:1199] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/1f1d2d998d834c21ab83694daae37520
I20260925 01:50:09.409569 11946 ts_tablet_manager.cc:1950] T 1f1d2d998d834c21ab83694daae37520 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.409807 13321 raft_consensus.cc:2749] T e26b1dc65fc84629a72029519919ae23 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.410887 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 773) took 2384 ms. Trace:
I20260925 01:50:09.410719 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.411899 11946 rpcz_store.cc:276] 0925 01:50:07.026621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.026689 (+ 68us) service_pool.cc:224] Handling call
0925 01:50:09.391440 (+2364751us) ts_tablet_manager.cc:1151] Deleting tablet 1f1d2d998d834c21ab83694daae37520
0925 01:50:09.391450 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.397307 (+ 5857us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.405682 (+ 8375us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.410852 (+ 5170us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2364564}
I20260925 01:50:09.412838 11946 tablet_replica.cc:333] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.413313 11946 raft_consensus.cc:2243] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.413749 11946 raft_consensus.cc:2272] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.413859 11755 tablet_bootstrap.cc:492] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:09.414392 11755 ts_tablet_manager.cc:1403] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.087s user 0.005s sys 0.003s
I20260925 01:50:09.414536 11946 ts_tablet_manager.cc:1916] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.415205 11755 raft_consensus.cc:359] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.420053 11755 raft_consensus.cc:385] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.420184 11755 raft_consensus.cc:740] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.424911 11946 ts_tablet_manager.cc:1929] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.427834 11755 consensus_queue.cc:260] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.428592 11755 ts_tablet_manager.cc:1434] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260925 01:50:09.428915 11755 tablet_bootstrap.cc:492] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:09.429108 11946 log.cc:1199] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ae948bf42ae34a7ab72112d5f1f02585
I20260925 01:50:09.429702 11946 ts_tablet_manager.cc:1950] T ae948bf42ae34a7ab72112d5f1f02585 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.429798 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5b11c6526dbc4177b3a54b3c952bbd31 (table default.Table_3dbfc023733e4f1ba765a6ad09ad8de8 [id=751698529dcb4a9c8d8806958926ecde]) successfully deleted
I20260925 01:50:09.431036 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 774) took 2404 ms. Trace:
I20260925 01:50:09.432047 11946 rpcz_store.cc:276] 0925 01:50:07.026738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.026924 (+ 186us) service_pool.cc:224] Handling call
0925 01:50:09.412787 (+2385863us) ts_tablet_manager.cc:1151] Deleting tablet ae948bf42ae34a7ab72112d5f1f02585
0925 01:50:09.412798 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.421600 (+ 8802us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.424853 (+ 3253us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.431013 (+ 6160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2385705}
I20260925 01:50:09.410903 11754 consensus_queue.cc:260] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.435328 13210 raft_consensus.cc:493] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.435462 13210 raft_consensus.cc:515] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.436231 13210 leader_election.cc:290] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.436992 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818a792969a245f5b0fe5f80128206ba" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:09.437130 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 789) took 2030 ms. Trace:
I20260925 01:50:09.437219 13356 ts_tablet_manager.cc:1929] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.437196 11516 raft_consensus.cc:2468] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:09.437309 13356 log.cc:1199] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/d253f8b1e4ac41388a885178f2ed0f40
I20260925 01:50:09.437211 11946 rpcz_store.cc:276] 0925 01:50:07.406367 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.406438 (+ 71us) service_pool.cc:224] Handling call
0925 01:50:09.436997 (+2030559us) ts_tablet_manager.cc:1151] Deleting tablet cea3ad181ffa42d694a609bf99001c75
0925 01:50:09.437008 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.437110 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030373}
I20260925 01:50:09.437667 13356 ts_tablet_manager.cc:1950] T d253f8b1e4ac41388a885178f2ed0f40 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:09.438009 11176 leader_election.cc:304] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:09.438267 11946 tablet_replica.cc:333] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.438640 13140 raft_consensus.cc:2804] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:09.438714 13140 raft_consensus.cc:493] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:09.438773 13140 raft_consensus.cc:3060] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:09.438774 11946 raft_consensus.cc:2243] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.438907 11946 raft_consensus.cc:2272] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.439467 11946 ts_tablet_manager.cc:1916] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.441542 13140 raft_consensus.cc:515] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.446302 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818a792969a245f5b0fe5f80128206ba" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:09.446504 11516 raft_consensus.cc:3060] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:09.449359 11516 raft_consensus.cc:2468] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:09.450029 11176 leader_election.cc:304] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:09.450464 13210 raft_consensus.cc:2804] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:09.450584 13210 raft_consensus.cc:697] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:09.450836 13210 consensus_queue.cc:237] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.453780 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818a792969a245f5b0fe5f80128206ba" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:09.454495 11177 leader_election.cc:343] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.455054 13140 leader_election.cc:290] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.456954 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "818a792969a245f5b0fe5f80128206ba" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.459533 11753 tablet_bootstrap.cc:492] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.459740 11753 ts_tablet_manager.cc:1403] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.237s user 0.030s sys 0.046s
I20260925 01:50:09.460652 11753 raft_consensus.cc:359] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.460999 11753 raft_consensus.cc:385] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.461094 11753 raft_consensus.cc:740] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.461356 11753 consensus_queue.cc:260] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.430081 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet fbd4b231f89a48e59e5eb3cf3976385a (table default.Table_35c4ed0e87a84f229968365f06717746 [id=b28ab41a090b4b4ba73898ff85d54d07]) successfully deleted
W20260925 01:50:09.465149 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4e1d19fcc7804baa94da9fa2b25cdfe3 consensus state has no leader
W20260925 01:50:09.463388 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bfc152df745b46fb84aec1c9fa017ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfc152df745b46fb84aec1c9fa017ba5 already in progress: creating tablet
W20260925 01:50:09.465849 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 22a335062caa48139e1cd4bca7bd4e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22a335062caa48139e1cd4bca7bd4e2b already in progress: creating tablet
I20260925 01:50:09.465745 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5f1e5d42855448c08d9ced53187ae23d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.466017 13333 consensus_queue.cc:1048] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:09.466398 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a07f37b8469a497ba3fe504cb21105d2 (table default.Table_a3c9e904392e436babfab378a07cf3a6 [id=13d7f920892e4b7d8befdde8d52affbb]) successfully deleted
W20260925 01:50:09.466627 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5048a0fca2e64ffa9f19000f48a4c090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5048a0fca2e64ffa9f19000f48a4c090 already in progress: creating tablet
W20260925 01:50:09.466868 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5ef093a4a1134407ba94207137ce3e81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ef093a4a1134407ba94207137ce3e81 already in progress: creating tablet
W20260925 01:50:09.467084 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 064c6cbe77d0405abe16a9a53d842590 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 064c6cbe77d0405abe16a9a53d842590 already in progress: creating tablet
I20260925 01:50:09.467216 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cf1146da8c94450fae9cf86b742d828e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.467823 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf1146da8c94450fae9cf86b742d828e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:09.469069 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 621a4a75ba204a99a9954cd381f712e7 consensus state has no leader
I20260925 01:50:09.469403 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7e712547f2e04932ac7d5263ba66daba" } new_table_name: "default.Table_09bfc775095a412e9b7510c489b73818" modify_external_catalogs: true
I20260925 01:50:09.471030 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6ec641e1915b414b80f52f871e36af6f" } modify_external_catalogs: true
I20260925 01:50:09.471217 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6ec641e1915b414b80f52f871e36af6f" } modify_external_catalogs: true
I20260925 01:50:09.471855 11753 ts_tablet_manager.cc:1434] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:50:09.472168 11753 tablet_bootstrap.cc:492] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.472616 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 4cd34fa172904e51ade794892c580248
I20260925 01:50:09.473176 11680 catalog_manager.cc:6934] ReplaceTablet: tablet 4cd34fa172904e51ade794892c580248 deleted and replaced by tablet 841c61dcaffd443a9c8d665657a5e9dc
I20260925 01:50:09.473579 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9c9ce5397aab47629f8271efca8c100f" } new_table_name: "default.Table_681ae5b686244ea8857d7d27e3781fd7" modify_external_catalogs: true
I20260925 01:50:09.473937 11753 tablet_bootstrap.cc:654] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:09.474315 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d37a05d2bcd4c94ba51fef8096f889d consensus state has no leader
I20260925 01:50:09.474728 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5ddb0bb553ea417ca3118e2fe3ec58a1" } modify_external_catalogs: true
I20260925 01:50:09.474877 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5ddb0bb553ea417ca3118e2fe3ec58a1" } modify_external_catalogs: true
I20260925 01:50:09.476605 11946 ts_tablet_manager.cc:1929] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.476698 11946 log.cc:1199] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/519d954b6a214d0b8e960e128cfcea10
W20260925 01:50:09.476462 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16dcc2d4bf24480f8e5fe67ae18764d0 already in progress: creating tablet
I20260925 01:50:09.477752 13333 raft_consensus.cc:493] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.477907 13333 raft_consensus.cc:515] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.478683 13333 leader_election.cc:290] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:09.478588 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1e1c0285c79b4e1280f3aa732e297c57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e1c0285c79b4e1280f3aa732e297c57 already in progress: creating tablet
I20260925 01:50:09.479439 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031687d4b26b4c7889dfbe3485c9f4c5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.479844 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031687d4b26b4c7889dfbe3485c9f4c5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:09.480032 11237 raft_consensus.cc:2468] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
W20260925 01:50:09.480574 11457 leader_election.cc:343] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.476500 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a5b2fd6126ae4a30affdca9a5fd34821" } modify_external_catalogs: true
I20260925 01:50:09.480748 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a5b2fd6126ae4a30affdca9a5fd34821" } modify_external_catalogs: true
W20260925 01:50:09.481496 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 507d06f04fb24c1abb9119a0fa5af141 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 507d06f04fb24c1abb9119a0fa5af141 already in progress: creating tablet
I20260925 01:50:09.482225 11456 leader_election.cc:304] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:09.466629 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bf8a59135b91441a9e6e1789d2f701e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.482709 11946 ts_tablet_manager.cc:1950] T 519d954b6a214d0b8e960e128cfcea10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.483016 13333 raft_consensus.cc:2804] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:09.483088 13333 raft_consensus.cc:493] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:09.483155 13333 raft_consensus.cc:3060] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:09.483227 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf8a59135b91441a9e6e1789d2f701e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.483800 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 1f1d2d998d834c21ab83694daae37520 (table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]) successfully deleted
I20260925 01:50:09.485055 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 790) took 2029 ms. Trace:
I20260925 01:50:09.485986 11946 rpcz_store.cc:276] 0925 01:50:07.455510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.455735 (+ 225us) service_pool.cc:224] Handling call
0925 01:50:09.438220 (+1982485us) ts_tablet_manager.cc:1151] Deleting tablet 519d954b6a214d0b8e960e128cfcea10
0925 01:50:09.438231 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.442782 (+ 4551us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.476548 (+ 33766us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.485035 (+ 8487us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1982299}
I20260925 01:50:09.486888 13333 raft_consensus.cc:515] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.485852 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ae948bf42ae34a7ab72112d5f1f02585 (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]) successfully deleted
I20260925 01:50:09.487380 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 791) took 2010 ms. Trace:
I20260925 01:50:09.488121 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031687d4b26b4c7889dfbe3485c9f4c5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:09.488063 11946 rpcz_store.cc:276] 0925 01:50:07.477165 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.477299 (+ 134us) service_pool.cc:224] Handling call
0925 01:50:09.487253 (+2009954us) ts_tablet_manager.cc:1151] Deleting tablet 5122b8c24d3442a1a52ff0b003d65ffb
0925 01:50:09.487265 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.487362 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2009735}
I20260925 01:50:09.488301 11237 raft_consensus.cc:3060] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:09.486215 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f1e5d42855448c08d9ced53187ae23d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:09.489293 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet cea3ad181ffa42d694a609bf99001c75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cea3ad181ffa42d694a609bf99001c75 already in progress: creating tablet
I20260925 01:50:09.490286 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd34fa172904e51ade794892c580248 with delete_type TABLET_DATA_DELETED (replaced by tablet 841c61dcaffd443a9c8d665657a5e9dc) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.490677 11946 tablet_replica.cc:333] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.490861 11946 raft_consensus.cc:2243] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.491065 11946 raft_consensus.cc:2272] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.491304 11237 raft_consensus.cc:2468] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:09.491658 11946 ts_tablet_manager.cc:1916] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.491763 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 519d954b6a214d0b8e960e128cfcea10 (table default.Table_126b13b368c348bea98d7d87748aaf1c [id=3e31f69b151b4dd69a3ac8be6e2bc48d]) successfully deleted
I20260925 01:50:09.493852 11456 leader_election.cc:304] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:09.494129 13276 raft_consensus.cc:2804] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:09.494262 13276 raft_consensus.cc:697] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
W20260925 01:50:09.493992 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5122b8c24d3442a1a52ff0b003d65ffb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5122b8c24d3442a1a52ff0b003d65ffb already in progress: creating tablet
I20260925 01:50:09.494490 13276 consensus_queue.cc:237] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.495527 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1238c41b271747fe9d9f419001ea61cd" } modify_external_catalogs: true
I20260925 01:50:09.495765 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1238c41b271747fe9d9f419001ea61cd" } modify_external_catalogs: true
I20260925 01:50:09.498049 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e (DEFAULT_TABLE table=default.Table_853886350ca941199d022640a1251fd3 [id=b297045646b64274923faa096b66bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.498456 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.498611 11753 tablet_bootstrap.cc:492] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.498767 11753 ts_tablet_manager.cc:1403] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.005s
I20260925 01:50:09.499827 13333 leader_election.cc:290] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.499800 11753 raft_consensus.cc:359] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.499959 11753 raft_consensus.cc:385] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.500007 11753 raft_consensus.cc:740] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.500213 11753 consensus_queue.cc:260] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:09.502946 11457 consensus_peers.cc:597] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:09.503805 13140 consensus_queue.cc:1048] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:09.504115 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031687d4b26b4c7889dfbe3485c9f4c5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:09.504873 11457 leader_election.cc:343] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.506526 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e (DEFAULT_TABLE table=default.Table_853886350ca941199d022640a1251fd3 [id=b297045646b64274923faa096b66bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.507117 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.510438 11211 tablet_service.cc:1511] Processing CreateTablet for tablet f8ffc45058774a878d4b802400feecb7 (DEFAULT_TABLE table=default.Table_44b098622a324bd6a415bf756ce0160b [id=3084bc3a144e4f66a71dc80592cec4fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.510970 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ffc45058774a878d4b802400feecb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.516594 11946 ts_tablet_manager.cc:1929] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:50:09.516734 11946 log.cc:1199] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/0575861dd3d6437284cc183acb87af0a
I20260925 01:50:09.517144 11946 ts_tablet_manager.cc:1950] T 0575861dd3d6437284cc183acb87af0a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.520816 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd34fa172904e51ade794892c580248 with delete_type TABLET_DATA_DELETED (replaced by tablet 841c61dcaffd443a9c8d665657a5e9dc) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.523332 11753 ts_tablet_manager.cc:1434] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.024s user 0.004s sys 0.004s
I20260925 01:50:09.524202 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cd34fa172904e51ade794892c580248 with delete_type TABLET_DATA_DELETED (replaced by tablet 841c61dcaffd443a9c8d665657a5e9dc) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.517997 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 792) took 2040 ms. Trace:
I20260925 01:50:09.524611 11946 rpcz_store.cc:276] 0925 01:50:07.477615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.477793 (+ 178us) service_pool.cc:224] Handling call
0925 01:50:09.490629 (+2012836us) ts_tablet_manager.cc:1151] Deleting tablet 0575861dd3d6437284cc183acb87af0a
0925 01:50:09.490639 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.502832 (+ 12193us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.516533 (+ 13701us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.517976 (+ 1443us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2012669}
I20260925 01:50:09.524907 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.525580 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.526222 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.525103 11753 tablet_bootstrap.cc:492] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.527151 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.527220 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_63a050ebd5684e69a4a1f06a6f07e876" } modify_external_catalogs: true
I20260925 01:50:09.527407 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_63a050ebd5684e69a4a1f06a6f07e876" } modify_external_catalogs: true
I20260925 01:50:09.527988 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c01195f07b84b359a974fab5ed52582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.528086 11753 tablet_bootstrap.cc:654] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.529137 11946 tablet_replica.cc:333] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.529467 11946 raft_consensus.cc:2243] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.530006 11946 raft_consensus.cc:2272] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.531317 11946 ts_tablet_manager.cc:1916] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:09.536047 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e52692f8a09c44b4b8c13a9a388c2094 consensus state has no leader
I20260925 01:50:09.536494 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_441daf5de69a4e4383e56a428e920f4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.537111 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_441daf5de69a4e4383e56a428e920f4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.537563 11753 tablet_bootstrap.cc:492] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.537688 11753 ts_tablet_manager.cc:1403] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20260925 01:50:09.538540 11753 raft_consensus.cc:359] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.548301 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 8b2eed649c6f447d8f9af98637061af1
I20260925 01:50:09.549468 11754 ts_tablet_manager.cc:1434] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.149s user 0.002s sys 0.002s
W20260925 01:50:09.549559 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 107956us
I20260925 01:50:09.549800 11754 tablet_bootstrap.cc:492] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:09.552712 11753 raft_consensus.cc:385] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.552798 11753 raft_consensus.cc:740] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.553658 11753 consensus_queue.cc:260] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.554221 11753 ts_tablet_manager.cc:1434] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260925 01:50:09.559413 11753 tablet_bootstrap.cc:492] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.559530 11754 tablet_bootstrap.cc:654] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.560850 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet b61b1bf5a8d446918edc6d166b7712ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.561884 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b91957f62d8044ea8f6a3464c84b9e10 (table default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]) successfully deleted
I20260925 01:50:09.562870 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2eed649c6f447d8f9af98637061af1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.563683 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2eed649c6f447d8f9af98637061af1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.564211 11753 tablet_bootstrap.cc:654] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.562342 11946 ts_tablet_manager.cc:1929] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.565215 11946 log.cc:1199] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/04f412cbebe04a629070aecf2753287c
I20260925 01:50:09.565801 11946 ts_tablet_manager.cc:1950] T 04f412cbebe04a629070aecf2753287c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.566629 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 793) took 2087 ms. Trace:
I20260925 01:50:09.566763 11946 rpcz_store.cc:276] 0925 01:50:07.479609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.482994 (+ 3385us) service_pool.cc:224] Handling call
0925 01:50:09.529092 (+2046098us) ts_tablet_manager.cc:1151] Deleting tablet 04f412cbebe04a629070aecf2753287c
0925 01:50:09.529101 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.543332 (+ 14231us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.562285 (+ 18953us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.566611 (+ 4326us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2045931}
I20260925 01:50:09.567690 11946 tablet_replica.cc:333] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.570436 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 0575861dd3d6437284cc183acb87af0a (table default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086]) successfully deleted
I20260925 01:50:09.572041 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 04f412cbebe04a629070aecf2753287c (table default.Table_74c3e602a0454e0e8b4e734dc8dea4c6 [id=34ad0afe75be4b6b97e619d27ca2da1a]) successfully deleted
I20260925 01:50:09.577561 11753 tablet_bootstrap.cc:492] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.577752 11753 ts_tablet_manager.cc:1403] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260925 01:50:09.578563 11753 raft_consensus.cc:359] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.578795 11753 raft_consensus.cc:385] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.578900 11753 raft_consensus.cc:740] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.579327 11753 consensus_queue.cc:260] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.579854 11753 ts_tablet_manager.cc:1434] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:09.584396 13373 raft_consensus.cc:493] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.584597 13373 raft_consensus.cc:515] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.585685 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2618c46630c4295949b36f3d0087941" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:09.586436 11456 leader_election.cc:343] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.586920 13373 leader_election.cc:290] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.587366 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2618c46630c4295949b36f3d0087941" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:09.589063 11177 leader_election.cc:343] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:09.590411 11457 leader_election.cc:343] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.590526 11457 leader_election.cc:304] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:09.590658 11177 consensus_peers.cc:597] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:09.593587 11755 tablet_bootstrap.cc:654] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.593842 13260 raft_consensus.cc:493] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.593977 13260 raft_consensus.cc:515] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.595408 13260 leader_election.cc:290] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:09.596396 13373 raft_consensus.cc:2749] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.596459 13276 raft_consensus.cc:493] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.596556 13276 raft_consensus.cc:515] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.597209 13276 leader_election.cc:290] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:50:09.600580 11314 leader_election.cc:343] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:50:09.600960 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:09.601737 11456 leader_election.cc:343] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:09.605285 11314 leader_election.cc:343] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:50:09.605413 11314 leader_election.cc:304] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.606017 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.606081 13260 raft_consensus.cc:2749] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:09.606526 11457 leader_election.cc:343] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.606635 11457 leader_election.cc:304] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.607142 13276 raft_consensus.cc:2749] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.607479 11754 tablet_bootstrap.cc:492] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:09.608042 11754 ts_tablet_manager.cc:1403] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.058s user 0.011s sys 0.001s
I20260925 01:50:09.612255 11946 raft_consensus.cc:2243] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.612740 11753 tablet_bootstrap.cc:492] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.615064 11753 tablet_bootstrap.cc:654] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.615523 11755 tablet_bootstrap.cc:492] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:09.615662 11755 ts_tablet_manager.cc:1403] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.187s user 0.003s sys 0.003s
I20260925 01:50:09.616704 11755 raft_consensus.cc:359] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.617092 11755 raft_consensus.cc:385] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.617218 11755 raft_consensus.cc:740] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.616295 11754 raft_consensus.cc:359] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.617540 11755 consensus_queue.cc:260] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.617594 11754 raft_consensus.cc:385] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.620791 11755 ts_tablet_manager.cc:1434] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260925 01:50:09.621033 11946 raft_consensus.cc:2272] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.622565 11755 tablet_bootstrap.cc:492] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:09.622745 11953 ts_tablet_manager.cc:1929] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.623124 11946 ts_tablet_manager.cc:1916] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.623903 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet d253f8b1e4ac41388a885178f2ed0f40 (table default.Table_af127cdb830b4a768749a38a1651365c [id=99a2cf74a0de4842bfaf635fdccd5975]) successfully deleted
I20260925 01:50:09.625398 13276 raft_consensus.cc:493] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.625574 13276 raft_consensus.cc:515] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.626418 13276 leader_election.cc:290] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.626112 11754 raft_consensus.cc:740] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.627954 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226498ea628a475d8fcab28a6598a819" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:09.628484 11456 leader_election.cc:343] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.628185 11754 consensus_queue.cc:260] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.630437 13356 tablet_replica.cc:333] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:09.634014 11953 log.cc:1199] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/19c718c83cfe49b9a745e06314e24409
I20260925 01:50:09.634322 13356 raft_consensus.cc:2243] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.634224 11754 ts_tablet_manager.cc:1434] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
I20260925 01:50:09.635002 13356 raft_consensus.cc:2272] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.627204 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226498ea628a475d8fcab28a6598a819" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.635613 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet db1339652d744cda9215d84e846d1e8e
W20260925 01:50:09.636030 11457 leader_election.cc:343] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.636155 11457 leader_election.cc:304] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.636910 13276 raft_consensus.cc:2749] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.638959 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e26b1dc65fc84629a72029519919ae23 (table default.Table_8607be532f504f14a18016d06256ba4c [id=137696aee6894961a9f4e21f322429a8]). Expected version 1 got 0
I20260925 01:50:09.641355 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_14ac769c63984e88b1fb5a08c19d5d39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.642019 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14ac769c63984e88b1fb5a08c19d5d39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.644304 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet db1339652d744cda9215d84e846d1e8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.625999 11755 tablet_bootstrap.cc:654] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.641479 11754 tablet_bootstrap.cc:492] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:09.646211 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet db1339652d744cda9215d84e846d1e8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.653154 11953 ts_tablet_manager.cc:1950] T 19c718c83cfe49b9a745e06314e24409 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:09.653839 13356 ts_tablet_manager.cc:1916] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.654088 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 544) took 8462 ms. Trace:
I20260925 01:50:09.655057 13380 tablet.cc:1751] T 6a9ccd099cba4b92909bb17c45dfce8a P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:09.661615 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 86f3f75784af42f6b14b919815ab1890
I20260925 01:50:09.664804 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:09.669175 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0dcdec389a2446e7afd96a57a8c91c51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.670132 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dcdec389a2446e7afd96a57a8c91c51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.672111 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 86f3f75784af42f6b14b919815ab1890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.661556 13276 raft_consensus.cc:493] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.677426 13276 raft_consensus.cc:515] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.678303 13276 leader_election.cc:290] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.672086 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 86f3f75784af42f6b14b919815ab1890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.679282 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d31139e1e441aa6fe204168486e28" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:09.679980 11456 leader_election.cc:343] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.682050 11953 rpcz_store.cc:276] 0925 01:50:01.191230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.191289 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:09.361374 (+8170085us) ts_tablet_manager.cc:1151] Deleting tablet 19c718c83cfe49b9a745e06314e24409
0925 01:50:09.361388 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.455245 (+ 93857us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.622685 (+167440us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.654037 (+ 31352us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8169890}
I20260925 01:50:09.682608 11953 tablet_replica.cc:333] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:09.682813 11953 raft_consensus.cc:2243] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:09.683212 11953 raft_consensus.cc:2272] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.683854 11953 ts_tablet_manager.cc:1916] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.684127 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f9584e223de240118d5403df64e4aa15" } new_table_name: "default.Table_7ae1443a67e148b8aede8cd3e2734218" modify_external_catalogs: true
I20260925 01:50:09.672514 11755 tablet_bootstrap.cc:492] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:09.686266 11755 ts_tablet_manager.cc:1403] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.003s
I20260925 01:50:09.678783 13260 raft_consensus.cc:493] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.679054 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d31139e1e441aa6fe204168486e28" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.686766 13260 raft_consensus.cc:515] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:09.687212 11457 leader_election.cc:343] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.687337 11457 leader_election.cc:304] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.687312 11755 raft_consensus.cc:359] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.687404 13260 leader_election.cc:290] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:09.687461 11755 raft_consensus.cc:385] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.687511 11755 raft_consensus.cc:740] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.687721 13276 raft_consensus.cc:2749] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.687718 11755 consensus_queue.cc:260] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.688723 11755 ts_tablet_manager.cc:1434] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260925 01:50:09.688872 11314 leader_election.cc:343] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 6ff85bac0d22416987e8e3b379154b09
W20260925 01:50:09.689080 11314 leader_election.cc:343] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 6ff85bac0d22416987e8e3b379154b09
I20260925 01:50:09.689164 11314 leader_election.cc:304] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.689206 11755 tablet_bootstrap.cc:492] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:09.689574 13321 raft_consensus.cc:2749] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:09.689677 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_13f9ff413156494095a4ccdbc2d2b0e2" } new_table_name: "default.Table_d449b99f440e450f9f5fe101809310e9" modify_external_catalogs: true
I20260925 01:50:09.694799 13380 tablet.cc:1751] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:09.704761 11946 ts_tablet_manager.cc:1929] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.709436 11754 tablet_bootstrap.cc:654] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.712019 13356 ts_tablet_manager.cc:1929] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.713919 11946 log.cc:1199] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/15376374d9f2401fb9bb83d2f0acf7b3
I20260925 01:50:09.714797 11946 ts_tablet_manager.cc:1950] T 15376374d9f2401fb9bb83d2f0acf7b3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.715148 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:09.718498 11755 tablet_bootstrap.cc:654] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.728883 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2eed649c6f447d8f9af98637061af1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.729697 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet db1339652d744cda9215d84e846d1e8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.734973 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 86f3f75784af42f6b14b919815ab1890 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.735308 11675 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet dc2141bdc86e44638178e85a0ed9505a
I20260925 01:50:09.735826 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3943c5408eb1475a9c0002764673e7d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.736155 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet c7944aa1ac8f4c5d8ea3aa2acae41257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:49 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:09.736624 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3943c5408eb1475a9c0002764673e7d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.737622 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f37b8469a497ba3fe504cb21105d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.739246 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d23c5d52faa4b6da2996fabb16bd74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.740070 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b11c6526dbc4177b3a54b3c952bbd31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.746336 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f4533c3500a3431ca6ef5f23b0cf6830
I20260925 01:50:09.746942 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet bb9ce40cb55d4f90b3c333b55bc5fe18 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:09.747316 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet f4533c3500a3431ca6ef5f23b0cf6830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:09.760397 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 794) took 2264 ms. Trace:
W20260925 01:50:09.763000 11314 consensus_peers.cc:597] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 829d167dc0214890b722c0197500f159. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:09.764180 11755 tablet_bootstrap.cc:492] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:09.764420 11755 ts_tablet_manager.cc:1403] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.000s
I20260925 01:50:09.765259 11755 raft_consensus.cc:359] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.765547 11755 raft_consensus.cc:385] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.765659 11755 raft_consensus.cc:740] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.765745 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_784ed698c2d64964b9efd4080f8fbe18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.766114 11755 consensus_queue.cc:260] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:09.766367 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_784ed698c2d64964b9efd4080f8fbe18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.766997 11755 ts_tablet_manager.cc:1434] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:09.767285 11755 tablet_bootstrap.cc:492] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:09.769328 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5f04dbdc3964422c9966d0a6449ba013"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.769888 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f04dbdc3964422c9966d0a6449ba013 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.773211 11953 ts_tablet_manager.cc:1929] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.773401 11946 rpcz_store.cc:276] 0925 01:50:07.496258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.496444 (+ 186us) service_pool.cc:224] Handling call
0925 01:50:09.567645 (+2071201us) ts_tablet_manager.cc:1151] Deleting tablet 15376374d9f2401fb9bb83d2f0acf7b3
0925 01:50:09.567653 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.687926 (+120273us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.704697 (+ 16771us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.760374 (+ 55677us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2071000}
I20260925 01:50:09.773902 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 795) took 2270 ms. Trace:
I20260925 01:50:09.774012 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 15376374d9f2401fb9bb83d2f0acf7b3 (table default.Table_c3024aeca0894967b8d02b5871425583 [id=044f915b5cf14e089a2b225ac86d295d]) successfully deleted
I20260925 01:50:09.773998 11946 rpcz_store.cc:276] 0925 01:50:07.503170 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.505520 (+ 2350us) service_pool.cc:224] Handling call
0925 01:50:09.773764 (+2268244us) ts_tablet_manager.cc:1151] Deleting tablet 4d14ab205bba4f9d92797d34ab82f13d
0925 01:50:09.773775 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.773884 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2268070}
I20260925 01:50:09.774394 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 796) took 2084 ms. Trace:
I20260925 01:50:09.774477 11946 rpcz_store.cc:276] 0925 01:50:07.690273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.690326 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:09.774289 (+2083963us) ts_tablet_manager.cc:1151] Deleting tablet cdd615a0405742fcb472d92829a8d7c7
0925 01:50:09.774298 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.774379 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2083741}
I20260925 01:50:09.774786 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 797) took 2079 ms. Trace:
W20260925 01:50:09.774585 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 4d14ab205bba4f9d92797d34ab82f13d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d14ab205bba4f9d92797d34ab82f13d already in progress: creating tablet
I20260925 01:50:09.774860 11946 rpcz_store.cc:276] 0925 01:50:07.695329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.695728 (+ 399us) service_pool.cc:224] Handling call
0925 01:50:09.774696 (+2078968us) ts_tablet_manager.cc:1151] Deleting tablet 8e28aeabdf724784b8ed27535ea0701b
0925 01:50:09.774704 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.774772 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2078776}
I20260925 01:50:09.775146 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 798) took 1973 ms. Trace:
I20260925 01:50:09.775215 11946 rpcz_store.cc:276] 0925 01:50:07.801279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.801349 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:09.775057 (+1973708us) ts_tablet_manager.cc:1151] Deleting tablet d549d73cf407467faa68cbfb68306190
0925 01:50:09.775064 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.775130 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1973505}
I20260925 01:50:09.775491 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 799) took 1490 ms. Trace:
I20260925 01:50:09.775578 11946 rpcz_store.cc:276] 0925 01:50:08.284820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.285838 (+ 1018us) service_pool.cc:224] Handling call
0925 01:50:09.775407 (+1489569us) ts_tablet_manager.cc:1151] Deleting tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f
0925 01:50:09.775415 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.775478 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1489360}
I20260925 01:50:09.775863 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 800) took 1409 ms. Trace:
I20260925 01:50:09.775940 11946 rpcz_store.cc:276] 0925 01:50:08.366100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.366760 (+ 660us) service_pool.cc:224] Handling call
0925 01:50:09.775776 (+1409016us) ts_tablet_manager.cc:1151] Deleting tablet 2e839ce4c66c40eba5553a81e865a12a
0925 01:50:09.775783 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.775849 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1408828}
I20260925 01:50:09.776235 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 802) took 1387 ms. Trace:
I20260925 01:50:09.776314 11946 rpcz_store.cc:276] 0925 01:50:08.388976 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.389530 (+ 554us) service_pool.cc:224] Handling call
0925 01:50:09.776147 (+1386617us) ts_tablet_manager.cc:1151] Deleting tablet 7cb273ff7b084ffdb33b8ca9b9e136fe
0925 01:50:09.776155 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.776222 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1386420}
I20260925 01:50:09.776755 13380 tablet.cc:1751] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:09.667315 13379 tablet.cc:1751] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:09.777470 13356 log.cc:1199] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/15376374d9f2401fb9bb83d2f0acf7b3
I20260925 01:50:09.716179 13382 tablet.cc:1751] T e1001e66d2984d9187443adcc42e5856 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:09.766822 11753 tablet_bootstrap.cc:492] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.748512 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet f4533c3500a3431ca6ef5f23b0cf6830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:09.779044 11753 ts_tablet_manager.cc:1403] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.166s user 0.009s sys 0.011s
I20260925 01:50:09.780558 11753 raft_consensus.cc:359] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.780839 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 19c718c83cfe49b9a745e06314e24409 (table default.Table_3134677312f34800bda02393eeaacbc1 [id=a1465ccb37624e9aa2abb95f1bbd1abd]) successfully deleted
W20260925 01:50:09.775044 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet cdd615a0405742fcb472d92829a8d7c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdd615a0405742fcb472d92829a8d7c7 already in progress: creating tablet
I20260925 01:50:09.782002 11753 raft_consensus.cc:385] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:09.782099 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8e28aeabdf724784b8ed27535ea0701b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e28aeabdf724784b8ed27535ea0701b already in progress: creating tablet
I20260925 01:50:09.782140 11753 raft_consensus.cc:740] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:09.782310 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d549d73cf407467faa68cbfb68306190 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d549d73cf407467faa68cbfb68306190 already in progress: creating tablet
W20260925 01:50:09.782497 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f already in progress: creating tablet
I20260925 01:50:09.782532 11753 consensus_queue.cc:260] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:09.782737 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2e839ce4c66c40eba5553a81e865a12a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e839ce4c66c40eba5553a81e865a12a already in progress: creating tablet
I20260925 01:50:09.783020 13383 tablet.cc:1751] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:09.761946 11754 tablet_bootstrap.cc:492] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:09.789170 11754 ts_tablet_manager.cc:1403] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.148s user 0.003s sys 0.003s
I20260925 01:50:09.762950 13392 tablet.cc:1751] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:09.781759 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet f4533c3500a3431ca6ef5f23b0cf6830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:09.782160 13368 tablet.cc:1751] T 4ad9d992f7ed4021a7e472dd38ad2c2e P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:09.798305 11953 log.cc:1199] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/784de8c6e6e1434a91106dd19cd9262a
I20260925 01:50:09.799204 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_de391fb6f42d400bacfbad86f1b7198e" } new_table_name: "default.Table_c3edb1c0f4574f5680329efd13e9a3cb" modify_external_catalogs: true
I20260925 01:50:09.801412 11753 ts_tablet_manager.cc:1434] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260925 01:50:09.801772 11753 tablet_bootstrap.cc:492] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:09.803051 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cb273ff7b084ffdb33b8ca9b9e136fe already in progress: creating tablet
I20260925 01:50:09.810132 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:09.812453 11755 tablet_bootstrap.cc:654] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.813093 13260 raft_consensus.cc:493] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.812752 11953 ts_tablet_manager.cc:1950] T 784de8c6e6e1434a91106dd19cd9262a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:09.813263 13260 raft_consensus.cc:515] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.813881 13260 leader_election.cc:290] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:09.815160 11314 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5d23c5d52faa4b6da2996fabb16bd74a
W20260925 01:50:09.815778 11314 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:50:09.815886 11314 leader_election.cc:304] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.816258 13260 raft_consensus.cc:2749] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:09.817015 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 545) took 8624 ms. Trace:
I20260925 01:50:09.817162 11953 rpcz_store.cc:276] 0925 01:50:01.192891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.192946 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:09.682551 (+8489605us) ts_tablet_manager.cc:1151] Deleting tablet 784de8c6e6e1434a91106dd19cd9262a
0925 01:50:09.682562 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.747855 (+ 65293us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.773137 (+ 25282us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.816996 (+ 43859us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8489405}
I20260925 01:50:09.817744 11953 tablet_replica.cc:333] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:09.818190 11953 raft_consensus.cc:2243] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.818429 11953 raft_consensus.cc:2272] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.819078 11953 ts_tablet_manager.cc:1916] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:09.820539 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98e13bbb749544afbb73e83b314c3d06 consensus state has no leader
I20260925 01:50:09.820986 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3a7f4d008b0b4253899b059ded73a06e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.821564 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a7f4d008b0b4253899b059ded73a06e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.822149 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_32ffd9c49fcc43288481ca97dcb07498"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:09.822214 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1ade0ea78b1e41e5ab63a12b77b5d46d" } new_table_name: "default.Table_b446cb66c2a44932bfc2ca81ebd81a8b" modify_external_catalogs: true
W20260925 01:50:09.822388 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 40c26580581e4e76ad9218958b3f9b78 consensus state has no leader
W20260925 01:50:09.822686 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32ffd9c49fcc43288481ca97dcb07498 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.824723 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_11479f53e6d343f4a1669c57ca73bf07" } modify_external_catalogs: true
I20260925 01:50:09.824930 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_11479f53e6d343f4a1669c57ca73bf07" } modify_external_catalogs: true
I20260925 01:50:09.825150 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 784de8c6e6e1434a91106dd19cd9262a (table default.Table_3bcedabba6c244178b5f3479e7996282 [id=5405c0f51c3b4db8a58b97b60ea65777]) successfully deleted
I20260925 01:50:09.830574 13356 ts_tablet_manager.cc:1950] T 15376374d9f2401fb9bb83d2f0acf7b3 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:50:09.837273 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4a069c2d1ee4475817dc26becc3ebb6 consensus state has no leader
I20260925 01:50:09.839653 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_44b098622a324bd6a415bf756ce0160b" } modify_external_catalogs: true
I20260925 01:50:09.839926 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_44b098622a324bd6a415bf756ce0160b" } modify_external_catalogs: true
W20260925 01:50:09.843135 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 57685.7us
I20260925 01:50:09.843148 11754 raft_consensus.cc:359] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.843319 11754 raft_consensus.cc:385] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.843371 11754 raft_consensus.cc:740] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.846550 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 804) took 1444 ms. Trace:
I20260925 01:50:09.847399 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 15376374d9f2401fb9bb83d2f0acf7b3 (table default.Table_c3024aeca0894967b8d02b5871425583 [id=044f915b5cf14e089a2b225ac86d295d]) successfully deleted
I20260925 01:50:09.848400 11946 rpcz_store.cc:276] 0925 01:50:08.402175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.402240 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:09.846363 (+1444123us) ts_tablet_manager.cc:1151] Deleting tablet 8a00b69e42e1465981d6c3eec217393f
0925 01:50:09.846375 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.846491 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1400970}
W20260925 01:50:09.849056 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8a00b69e42e1465981d6c3eec217393f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a00b69e42e1465981d6c3eec217393f already in progress: creating tablet
I20260925 01:50:09.849367 11754 consensus_queue.cc:260] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.849575 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 803) took 1447 ms. Trace:
I20260925 01:50:09.849660 11946 rpcz_store.cc:276] 0925 01:50:08.402040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.406086 (+ 4046us) service_pool.cc:224] Handling call
0925 01:50:09.849427 (+1443341us) ts_tablet_manager.cc:1151] Deleting tablet 854549ed223142429513c1d80c026793
0925 01:50:09.849437 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.849554 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1443087}
W20260925 01:50:09.850306 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 854549ed223142429513c1d80c026793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 854549ed223142429513c1d80c026793 already in progress: creating tablet
I20260925 01:50:09.850751 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 807) took 1332 ms. Trace:
I20260925 01:50:09.850878 11946 rpcz_store.cc:276] 0925 01:50:08.518516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.518707 (+ 191us) service_pool.cc:224] Handling call
0925 01:50:09.850638 (+1331931us) ts_tablet_manager.cc:1151] Deleting tablet a92e93e5478846c7ac2eee8a8e76c7aa
0925 01:50:09.850647 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.850733 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331758}
W20260925 01:50:09.851414 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a92e93e5478846c7ac2eee8a8e76c7aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a92e93e5478846c7ac2eee8a8e76c7aa already in progress: creating tablet
W20260925 01:50:09.852272 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5204f01643654d3a9a5e6909f6601bb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5204f01643654d3a9a5e6909f6601bb5 already in progress: creating tablet
I20260925 01:50:09.848328 11753 tablet_bootstrap.cc:654] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:09.854444 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5366f2487b444e12ad9d63d6825d5e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5366f2487b444e12ad9d63d6825d5e97 already in progress: creating tablet
I20260925 01:50:09.854519 11754 ts_tablet_manager.cc:1434] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.064s user 0.002s sys 0.000s
I20260925 01:50:09.855041 11754 tablet_bootstrap.cc:492] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:09.855187 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 01d50e428bfc46caa130f96ccc7e8f40 because the tablet was not found. No further retry: Not found: Tablet not found: 01d50e428bfc46caa130f96ccc7e8f40
W20260925 01:50:09.855912 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet be89c0911dfa4b9d83d6bd88755be2b2 because the tablet was not found. No further retry: Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:09.856283 11946 tablet_replica.cc:333] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:09.856540 11946 raft_consensus.cc:2243] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.856778 11946 raft_consensus.cc:2272] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.857828 11946 ts_tablet_manager.cc:1916] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.862430 13356 tablet_replica.cc:333] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:09.862670 13356 raft_consensus.cc:2243] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.862977 13356 raft_consensus.cc:2272] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.863610 13356 ts_tablet_manager.cc:1916] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.866442 13392 tablet.cc:1751] T 4ad9d992f7ed4021a7e472dd38ad2c2e P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:09.867806 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8331a7db9b06422182b4638dc448ae50" } modify_external_catalogs: true
I20260925 01:50:09.868090 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8331a7db9b06422182b4638dc448ae50" } modify_external_catalogs: true
I20260925 01:50:09.870537 11753 tablet_bootstrap.cc:492] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:09.870771 11753 ts_tablet_manager.cc:1403] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.000s
I20260925 01:50:09.871858 11753 raft_consensus.cc:359] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.872087 11753 raft_consensus.cc:385] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.872201 11753 raft_consensus.cc:740] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.872450 11753 consensus_queue.cc:260] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.877028 11753 ts_tablet_manager.cc:1434] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260925 01:50:09.877435 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ba4def6c15a410f87b3bf1f168f80d4 consensus state has no leader
I20260925 01:50:09.878031 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_55f5be5c3421480ca1141d4c051c7fa2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.878827 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55f5be5c3421480ca1141d4c051c7fa2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.892592 11754 tablet_bootstrap.cc:654] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.895453 11753 tablet_bootstrap.cc:492] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:09.897691 11753 tablet_bootstrap.cc:654] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.898758 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1c6331f1d18a4a84b27bda46f387d55e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.899376 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c6331f1d18a4a84b27bda46f387d55e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.908751 11946 ts_tablet_manager.cc:1929] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:09.912176 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet d401574e89014d2aaa5f98d0d9a2729f from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:09.914968 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 4 got 0
I20260925 01:50:09.915243 11672 catalog_manager.cc:5838] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:09.915653 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:09.915956 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:09.916229 11672 catalog_manager.cc:5838] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195). New cstate: current_term: 1 leader_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:09.916424 13271 raft_consensus.cc:493] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:09.916693 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 60411b0feafe4fef9c4fdc364163f1df (table default.Table_9c96e3747586472d861731441a16b7eb [id=0848b51bdadb45b5b1a5357208cfcd58]). Expected version 4 got 0
I20260925 01:50:09.916644 13271 raft_consensus.cc:515] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.917255 13271 leader_election.cc:290] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:09.918555 11314 leader_election.cc:343] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 0575861dd3d6437284cc183acb87af0a
W20260925 01:50:09.919229 11314 leader_election.cc:343] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 0575861dd3d6437284cc183acb87af0a
I20260925 01:50:09.919404 11314 leader_election.cc:304] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:09.919734 13271 raft_consensus.cc:2749] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:09.920207 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 846488b5e224453eb96004f7423ee614 (DEFAULT_TABLE table=default.Table_ca45acb19bb2490c9022438afee35414 [id=d29f0b4c0afc40aebee17ae81180e949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.920665 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 70c94e791a494eb580253e0c8e0fa56a (DEFAULT_TABLE table=default.Table_fd4295340ebf4ad28e0eb3568a272fcd [id=c779b15873c54817affbbb4791b1a0bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.921240 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc (DEFAULT_TABLE table=default.Table_4a4a414c1da142179c47230a40b1945d [id=3f496d6b6d3340bf82027c59d578ab5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.921595 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0d592dcd7a4a119befea22c35f5b2d (DEFAULT_TABLE table=default.Table_38b0c6e5f96842ad958e8d24379e8b22 [id=6be712c8124a4bd686efc316bfbbfc15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.922415 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846488b5e224453eb96004f7423ee614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.922655 13140 raft_consensus.cc:493] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.922801 13140 raft_consensus.cc:515] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:09.923420 13140 leader_election.cc:290] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:09.925809 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 81c2d13ee77945f6a993ba99d57b5427 (DEFAULT_TABLE table=default.Table_30cf8a0d9f664848b66efda848625415 [id=3fd1df291b154b069a76d8f72067c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.926105 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 549219ff065e4bf7b441f7bdd7098d88 (DEFAULT_TABLE table=default.Table_0723b14a66f248a394aad936376c3cbc [id=dbc695c1a32043a998e198f83549b972]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.926599 11213 tablet_service.cc:1511] Processing CreateTablet for tablet bd8e5635aa934269b69ca45467aa274b (DEFAULT_TABLE table=default.Table_d90f452532144ce98c7d4e351a71190b [id=13d8d757618d42ecb7f8a8e83c9ca648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.926180 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c2d13ee77945f6a993ba99d57b5427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.927408 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b123ac1e894239875404438ed19927" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:09.927800 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c94e791a494eb580253e0c8e0fa56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.930174 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549219ff065e4bf7b441f7bdd7098d88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:09.930464 11177 leader_election.cc:343] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.930819 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.934304 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0d592dcd7a4a119befea22c35f5b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.934947 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e5635aa934269b69ca45467aa274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.939651 11953 ts_tablet_manager.cc:1929] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:09.939955 11953 log.cc:1199] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/85d859207bbc4aefb26c726dce404c44
I20260925 01:50:09.942508 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ef8e5edec85740b59397191a9adfb275" } modify_external_catalogs: true
I20260925 01:50:09.942771 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ef8e5edec85740b59397191a9adfb275" } modify_external_catalogs: true
I20260925 01:50:09.944200 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8d023311b4a91adfebd6c5fedf1bd (DEFAULT_TABLE table=default.Table_6a9abc8df95942d3bcedfec0598b296c [id=546b02faa7c54273a34cbca17ab50226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.944643 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8d023311b4a91adfebd6c5fedf1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.950294 11953 ts_tablet_manager.cc:1950] T 85d859207bbc4aefb26c726dce404c44 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:09.950389 11222 tablet_service.cc:1511] Processing CreateTablet for tablet d08b978d9b2945ffa966e2237bddd48c (DEFAULT_TABLE table=default.Table_476bf1ac18a8424287eb6e04103c5437 [id=25b3d3a9148f46e0bf7214c7d0443fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.950788 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08b978d9b2945ffa966e2237bddd48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.950753 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 546) took 8756 ms. Trace:
I20260925 01:50:09.950927 11953 rpcz_store.cc:276] 0925 01:50:01.193887 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.193933 (+ 46us) service_pool.cc:224] Handling call
0925 01:50:09.817691 (+8623758us) ts_tablet_manager.cc:1151] Deleting tablet 85d859207bbc4aefb26c726dce404c44
0925 01:50:09.817702 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.903652 (+ 85950us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.939056 (+ 35404us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.950712 (+ 11656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8623564}
I20260925 01:50:09.951143 11208 tablet_service.cc:1511] Processing CreateTablet for tablet dc00e20861c54760ac8409c54abd1795 (DEFAULT_TABLE table=default.Table_20ebf4c7095a4388acf30cfc1ee53c59 [id=6d76134fb5494345bfc0d017ef2e6988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.951692 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc00e20861c54760ac8409c54abd1795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.951710 11953 tablet_replica.cc:333] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:09.952067 11953 raft_consensus.cc:2243] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:09.952435 11953 raft_consensus.cc:2272] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:09.953362 11953 ts_tablet_manager.cc:1916] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:09.954321 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea47f7897614207a1af33f6bb35cc83 (DEFAULT_TABLE table=default.Table_6535b827d6fb43b7bae1647a19913dce [id=9789428f19754e4da084cd8410e90ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.954684 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea47f7897614207a1af33f6bb35cc83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.958312 11220 tablet_service.cc:1511] Processing CreateTablet for tablet a8d3b4ec14d5457eb0d0d364904e755d (DEFAULT_TABLE table=default.Table_25eae0a5cb4d4de28ef70586f0093354 [id=4cb92ef0acc343f481e88e52aade8769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.958602 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d3b4ec14d5457eb0d0d364904e755d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.958799 11754 tablet_bootstrap.cc:492] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:09.958933 11754 ts_tablet_manager.cc:1403] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.104s user 0.003s sys 0.001s
I20260925 01:50:09.959738 11754 raft_consensus.cc:359] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.959887 11754 raft_consensus.cc:385] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.959935 11754 raft_consensus.cc:740] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.960124 11754 consensus_queue.cc:260] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.960649 11754 ts_tablet_manager.cc:1434] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:09.960888 11754 tablet_bootstrap.cc:492] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:09.962217 11754 tablet_bootstrap.cc:654] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.963585 11755 tablet_bootstrap.cc:492] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:09.963729 11755 ts_tablet_manager.cc:1403] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.196s user 0.004s sys 0.001s
I20260925 01:50:09.964455 11755 raft_consensus.cc:359] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.968641 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_90cf539e13ed491d84f83dec75e44460"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.969249 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90cf539e13ed491d84f83dec75e44460 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.972426 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_920a1f0630944775bfdfcd94c318a3f3" } new_table_name: "default.Table_96933f12fc314e0e9d47d0e3a60cb27c" modify_external_catalogs: true
I20260925 01:50:09.975557 11754 tablet_bootstrap.cc:492] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:09.975705 11754 ts_tablet_manager.cc:1403] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260925 01:50:09.976469 11754 raft_consensus.cc:359] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.976724 11754 raft_consensus.cc:385] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:09.976821 11754 raft_consensus.cc:740] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:09.977065 11754 consensus_queue.cc:260] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:09.977686 11754 ts_tablet_manager.cc:1434] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:09.977999 11754 tablet_bootstrap.cc:492] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:09.979701 11754 tablet_bootstrap.cc:654] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:09.980293 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet bb9ce40cb55d4f90b3c333b55bc5fe18
I20260925 01:50:09.980783 11676 catalog_manager.cc:6934] ReplaceTablet: tablet bb9ce40cb55d4f90b3c333b55bc5fe18 deleted and replaced by tablet f066d2f3f4504e08be7a8783a6fd7abd
I20260925 01:50:09.981137 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0a5bd932fcc142468b4c60bc7084337e" } modify_external_catalogs: true
I20260925 01:50:09.981307 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0a5bd932fcc142468b4c60bc7084337e" } modify_external_catalogs: true
I20260925 01:50:09.982944 13321 raft_consensus.cc:493] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:09.983078 13321 raft_consensus.cc:515] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:09.983677 13321 leader_election.cc:290] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:09.991937 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0258eac5971842878c62326952115490
I20260925 01:50:09.992866 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_49984bc62b4646cb8f8c53adc9412bdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:09.993448 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49984bc62b4646cb8f8c53adc9412bdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.994293 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3ac251aa75344cf8ac29dd30c893d84b
I20260925 01:50:09.995592 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f8ffc45058774a878d4b802400feecb7
I20260925 01:50:09.996321 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 310c2faa268f49b09223591ea56946bb (DEFAULT_TABLE table=default.Table_30f2b681c35d4fba9fa318b24ecb1033 [id=ff05d7e65dac4351a9a965090c6286e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.996728 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 310c2faa268f49b09223591ea56946bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.996762 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 532e290a0db34fbfab0328ca8f8d1e6c
I20260925 01:50:09.984927 11211 tablet_service.cc:1511] Processing CreateTablet for tablet 0adccf055e0047919e730c522e470cbd (DEFAULT_TABLE table=default.Table_d8bff0bd6b85436a97a7ead19ee47e1a [id=a3505a80e770458199c89be60a15d1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.998824 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adccf055e0047919e730c522e470cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.987254 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 62c0395b7a63486a93d46a8fb5809b35 (DEFAULT_TABLE table=default.Table_885c17a19ebe40b08339efd10d1a9f96 [id=63f30b1a260440f2bfd1618bcd2c4104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.987521 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 1a865bc53296438f9b1ff0c6b11c2c2d (DEFAULT_TABLE table=default.Table_bea72848a0204c5f93359abe4f3ff9d5 [id=c8c8b0afc7b844cabccdec5ba885ec4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.002260 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c0395b7a63486a93d46a8fb5809b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.002458 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a865bc53296438f9b1ff0c6b11c2c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.004276 13306 consensus_queue.cc:1048] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:09.988188 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 67ad5fb90dad4f869e87cfbb7717035e (DEFAULT_TABLE table=default.Table_37f09900657f43d79f9eca3fe69932f9 [id=52e166447f1840ea8f0b00cf195471f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.006503 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ad5fb90dad4f869e87cfbb7717035e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.988447 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:09.988629 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 7dfb342a744147e99917b6f32bd07b06 (DEFAULT_TABLE table=default.Table_f40821075d3c4668b7099d6fceee3c21 [id=c69c8e607b53479e96b5fe301be0a272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.010838 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dfb342a744147e99917b6f32bd07b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.010958 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_daf438c7a77a412ca5f78a435ae94073"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.011606 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daf438c7a77a412ca5f78a435ae94073 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:09.988639 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 with delete_type TABLET_DATA_DELETED (replaced by tablet f066d2f3f4504e08be7a8783a6fd7abd) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.013975 11680 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:10.014256 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet f8ffc45058774a878d4b802400feecb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.014423 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 532e290a0db34fbfab0328ca8f8d1e6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.014745 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd6540906b24919a8324979ce1e5b5a (DEFAULT_TABLE table=default.Table_34b02f12b7b94204aef2095afe4d766c [id=93510a05aa6b4a908a6911ba63cd04be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.015177 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd6540906b24919a8324979ce1e5b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.015312 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 6a9ccd099cba4b92909bb17c45dfce8a (table default.Table_a6b67f9415ae41dbaf3903dbbaec308f [id=c23a94a77b36437f843f323488d4ed42]). Expected version 1 got 0
I20260925 01:50:10.015555 11673 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:09.987527 11205 tablet_service.cc:1511] Processing CreateTablet for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 (DEFAULT_TABLE table=default.Table_d451558b9dd34a58997d77c2d847aee4 [id=8991221b069040778bcd2a794dd21f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.018333 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcbe8d08a1ff4c97a2f9a40d706f4281. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.018760 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet c4a069c2d1ee4475817dc26becc3ebb6 (table default.Table_c3edb1c0f4574f5680329efd13e9a3cb [id=bf059f47d27842bb9b375e7e38df29c4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c4a069c2d1ee4475817dc26becc3ebb6 consensus state has no leader
I20260925 01:50:09.989106 11219 tablet_service.cc:1511] Processing CreateTablet for tablet 6202860babb849568628e34a4fa28596 (DEFAULT_TABLE table=default.Table_b6b66fd099114d3fa9bf0b4cd9839b02 [id=98d49898b5f34575a18d2ee39224aedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.023595 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6202860babb849568628e34a4fa28596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.990029 11210 tablet_service.cc:1511] Processing CreateTablet for tablet fb247af96521453eaf81e8df4e58303d (DEFAULT_TABLE table=default.Table_72b9bf9e8daa4d8ba25863cf74ba0563 [id=49d78ae502964851ad8718978a4f8f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.990029 11208 tablet_service.cc:1511] Processing CreateTablet for tablet e1480131c1e74536b5f3fa54764dc4f3 (DEFAULT_TABLE table=default.Table_76ddcad4f1a84ce599a5c29562a9ae9b [id=8592d9417daa4582bdc009f815a7364d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.991443 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 75d9509bd20f410fbe8f33854546af08 (DEFAULT_TABLE table=default.Table_dcf6b955044a4f3ba2e8c3d9c23bee04 [id=693541b1cfe647fbb5a724807cbf209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.026104 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d7668004fa2647ff8f36edcc9bf4ffe1" } new_table_name: "default.Table_e4e628e3615549d0a0178c64a1a42318" modify_external_catalogs: true
I20260925 01:50:09.992631 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet 0258eac5971842878c62326952115490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.026571 11214 tablet_service.cc:1511] Processing CreateTablet for tablet dceeedf3471d45508f025e7a4c7f73f2 (DEFAULT_TABLE table=default.Table_d9ec82d6876c42f4ba2646cb90d5c35b [id=8713b7aabc1a423fa360ce93bc949629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.026970 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb247af96521453eaf81e8df4e58303d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.033279 11680 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e87128b8baef4f9d80341f6980da519d (table default.Table_7bf2059d1939417f9dc9b05d8a716c76 [id=03d3184bbc30406db8afae3e9f64fb9b]). Expected version 1 got 0
I20260925 01:50:10.033764 11207 tablet_service.cc:1511] Processing CreateTablet for tablet fe38c3b18f844897952b4c98ff0ace7d (DEFAULT_TABLE table=default.Table_8f0757127a1b42eca8ea1ed79f738dfa [id=6d71e2491a8b4d36b711948e0b75908b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.034248 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d9509bd20f410fbe8f33854546af08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.035146 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_eb347b6d475d48829c094b8bcaab1d0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.035732 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb347b6d475d48829c094b8bcaab1d0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.036994 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a374a5665122415d84f7c7176dfdc612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.037504 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a374a5665122415d84f7c7176dfdc612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.038434 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dceeedf3471d45508f025e7a4c7f73f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.041841 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 63f96f2643dc4de29f8609a657102b80 (DEFAULT_TABLE table=default.Table_ada1f063f511450c9c742f4b0fb7be82 [id=2e3097c96afe45cf9ccb5a28dff4ddc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.043651 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 818a792969a245f5b0fe5f80128206ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.044024 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef025c076394333b416b6613f9116d6 (DEFAULT_TABLE table=default.Table_68b05a96deb14f4eaddad7c1cf98a651 [id=5dc5a14f4ab54258a830c761642e174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.044378 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef025c076394333b416b6613f9116d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.045295 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97bbad6b7348caaed4d745343b811c (DEFAULT_TABLE table=default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.045943 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97bbad6b7348caaed4d745343b811c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.050719 11672 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.10.159.195:44907 (request call id 149) took 885 ms (client timeout 1000 ms). Trace:
W20260925 01:50:10.050892 11672 rpcz_store.cc:269] 0925 01:50:09.164866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.182335 (+ 17469us) service_pool.cc:224] Handling call
0925 01:50:09.187287 (+ 4952us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00007f46ca49765d 00007f46ca497753 00007f46c7014db1 00007f46cee03acd 00007f46cef8d738 00007f46c59611f6 00007f46c5960f25 00007f46c206763e 00007f46c206651e 00007f46c206c758 00007f46c206d0bf
0925 01:50:10.050669 (+863382us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:50:09.955345 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:50:09.955442 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:50:09.955448 (+ 6us) write_op.cc:435] Acquired schema lock
0925 01:50:09.955451 (+ 3us) tablet.cc:662] Decoding operations
0925 01:50:09.955554 (+ 103us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:50:09.955563 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0925 01:50:09.955567 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0925 01:50:09.955656 (+ 89us) tablet.cc:701] Row locks acquired
0925 01:50:09.955658 (+ 2us) write_op.cc:260] PREPARE: finished
0925 01:50:09.955703 (+ 45us) write_op.cc:270] Start()
0925 01:50:09.955730 (+ 27us) write_op.cc:276] Timestamp: P: 1790301009955665 usec, L: 0
0925 01:50:09.955734 (+ 4us) op_driver.cc:348] REPLICATION: starting
0925 01:50:09.955879 (+ 145us) log.cc:844] Serialized 919 byte log entry
0925 01:50:09.989146 (+ 33267us) op_driver.cc:464] REPLICATION: finished
0925 01:50:09.989456 (+ 310us) write_op.cc:301] APPLY: starting
0925 01:50:09.989473 (+ 17us) tablet.cc:1394] starting BulkCheckPresence
0925 01:50:09.989525 (+ 52us) tablet.cc:1397] finished BulkCheckPresence
0925 01:50:09.989553 (+ 28us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:50:09.989636 (+ 83us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:50:09.989675 (+ 39us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0925 01:50:09.989682 (+ 7us) write_op.cc:312] APPLY: finished
0925 01:50:09.989774 (+ 92us) log.cc:844] Serialized 29 byte log entry
0925 01:50:09.989838 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:09.989858 (+ 20us) write_op.cc:454] Released schema lock
0925 01:50:09.989865 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0925 01:50:09.989940 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:09.989944 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":9187712,"child_traces":[["op",{"apply.queue_time_us":260,"apply.run_cpu_time_us":473,"apply.run_wall_time_us":473,"num_ops":2,"prepare.queue_time_us":37888,"prepare.run_cpu_time_us":624,"prepare.run_wall_time_us":883,"replication_time_us":33379}]]}
I20260925 01:50:10.052714 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f96f2643dc4de29f8609a657102b80. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.058686 11314 consensus_peers.cc:597] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 829d167dc0214890b722c0197500f159. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:10.058921 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1510ec076a4483bc1e3c2eeb5b7b51 (DEFAULT_TABLE table=default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c [id=923936ead93f43d5bb7370a3605f8098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.059291 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1510ec076a4483bc1e3c2eeb5b7b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.061138 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea47f7897614207a1af33f6bb35cc83 (DEFAULT_TABLE table=default.Table_6535b827d6fb43b7bae1647a19913dce [id=9789428f19754e4da084cd8410e90ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.061491 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc (DEFAULT_TABLE table=default.Table_4a4a414c1da142179c47230a40b1945d [id=3f496d6b6d3340bf82027c59d578ab5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.061657 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea47f7897614207a1af33f6bb35cc83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.061830 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.062321 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 846488b5e224453eb96004f7423ee614 (DEFAULT_TABLE table=default.Table_ca45acb19bb2490c9022438afee35414 [id=d29f0b4c0afc40aebee17ae81180e949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.062657 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846488b5e224453eb96004f7423ee614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.066313 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 70c94e791a494eb580253e0c8e0fa56a (DEFAULT_TABLE table=default.Table_fd4295340ebf4ad28e0eb3568a272fcd [id=c779b15873c54817affbbb4791b1a0bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.066732 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c94e791a494eb580253e0c8e0fa56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.069267 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ac251aa75344cf8ac29dd30c893d84b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.070334 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0d592dcd7a4a119befea22c35f5b2d (DEFAULT_TABLE table=default.Table_38b0c6e5f96842ad958e8d24379e8b22 [id=6be712c8124a4bd686efc316bfbbfc15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.070672 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0d592dcd7a4a119befea22c35f5b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.071282 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 16f02aab5fb74c22ac2451b8df1f0a13 (DEFAULT_TABLE table=default.Table_9949d5ff8dc5438bbdac2523833b7a53 [id=8fa38038764b48138f1f9f35fddb185e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.071660 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f02aab5fb74c22ac2451b8df1f0a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.074426 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 81c2d13ee77945f6a993ba99d57b5427 (DEFAULT_TABLE table=default.Table_30cf8a0d9f664848b66efda848625415 [id=3fd1df291b154b069a76d8f72067c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.074975 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 549219ff065e4bf7b441f7bdd7098d88 (DEFAULT_TABLE table=default.Table_0723b14a66f248a394aad936376c3cbc [id=dbc695c1a32043a998e198f83549b972]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.075407 11360 tablet_service.cc:1511] Processing CreateTablet for tablet bd8e5635aa934269b69ca45467aa274b (DEFAULT_TABLE table=default.Table_d90f452532144ce98c7d4e351a71190b [id=13d8d757618d42ecb7f8a8e83c9ca648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.075856 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8d023311b4a91adfebd6c5fedf1bd (DEFAULT_TABLE table=default.Table_6a9abc8df95942d3bcedfec0598b296c [id=546b02faa7c54273a34cbca17ab50226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.076341 11341 tablet_service.cc:1511] Processing CreateTablet for tablet d08b978d9b2945ffa966e2237bddd48c (DEFAULT_TABLE table=default.Table_476bf1ac18a8424287eb6e04103c5437 [id=25b3d3a9148f46e0bf7214c7d0443fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.076747 11356 tablet_service.cc:1511] Processing CreateTablet for tablet a8d3b4ec14d5457eb0d0d364904e755d (DEFAULT_TABLE table=default.Table_25eae0a5cb4d4de28ef70586f0093354 [id=4cb92ef0acc343f481e88e52aade8769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.077255 11350 tablet_service.cc:1511] Processing CreateTablet for tablet dc00e20861c54760ac8409c54abd1795 (DEFAULT_TABLE table=default.Table_20ebf4c7095a4388acf30cfc1ee53c59 [id=6d76134fb5494345bfc0d017ef2e6988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.077873 11358 tablet_service.cc:1511] Processing CreateTablet for tablet daef608e7d834af78de6e35e3349cdfd (DEFAULT_TABLE table=default.Table_fc489c45aa2f4bfbbde8d88ed70b0d55 [id=09f896eacb9445348b400fab867bff4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.078368 11354 tablet_service.cc:1511] Processing CreateTablet for tablet e1480131c1e74536b5f3fa54764dc4f3 (DEFAULT_TABLE table=default.Table_76ddcad4f1a84ce599a5c29562a9ae9b [id=8592d9417daa4582bdc009f815a7364d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.078737 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 7dfb342a744147e99917b6f32bd07b06 (DEFAULT_TABLE table=default.Table_f40821075d3c4668b7099d6fceee3c21 [id=c69c8e607b53479e96b5fe301be0a272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.079207 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 0adccf055e0047919e730c522e470cbd (DEFAULT_TABLE table=default.Table_d8bff0bd6b85436a97a7ead19ee47e1a [id=a3505a80e770458199c89be60a15d1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.079936 11209 tablet_service.cc:1511] Processing CreateTablet for tablet d7ad64d213b740a8920efe216b6ffba1 (DEFAULT_TABLE table=default.Table_c54f81e7d3234f95890fbd622794df08 [id=c9122c4081c54b2bae0e342a87fc567d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.080394 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7ad64d213b740a8920efe216b6ffba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.089071 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c2d13ee77945f6a993ba99d57b5427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.089016 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]). Expected version 2 got 0
I20260925 01:50:10.089434 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:10.089783 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1480131c1e74536b5f3fa54764dc4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.089818 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:10.090233 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e5635aa934269b69ca45467aa274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.090636 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adccf055e0047919e730c522e470cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.091014 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08b978d9b2945ffa966e2237bddd48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.091378 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dfb342a744147e99917b6f32bd07b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.091789 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d3b4ec14d5457eb0d0d364904e755d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.092046 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a4219ce09e54d268c55c19f7b5cbc7d consensus state has no leader
I20260925 01:50:10.092181 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8d023311b4a91adfebd6c5fedf1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.092579 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_075eb0b9de704b3488addb686e309da4" } new_table_name: "default.Table_3e3c0d82d2f6449f835a8db116eb1f08" modify_external_catalogs: true
I20260925 01:50:10.092623 11222 tablet_service.cc:1511] Processing CreateTablet for tablet daef608e7d834af78de6e35e3349cdfd (DEFAULT_TABLE table=default.Table_fc489c45aa2f4bfbbde8d88ed70b0d55 [id=09f896eacb9445348b400fab867bff4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.092739 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549219ff065e4bf7b441f7bdd7098d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.092805 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3f7e203f023745f0b9b44085b0943c6d
I20260925 01:50:10.093039 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daef608e7d834af78de6e35e3349cdfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.093163 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daef608e7d834af78de6e35e3349cdfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.093600 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc00e20861c54760ac8409c54abd1795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.093755 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5bd60c10c41441cb81e69097767f6ef1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:10.094376 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1ee75b9473fc4bd286125af7095cfc80" } new_table_name: "default.Table_f871e66b6b4445b68db378f00ada1145" modify_external_catalogs: true
W20260925 01:50:10.094499 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5bd60c10c41441cb81e69097767f6ef1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.097143 11213 tablet_service.cc:1511] Processing CreateTablet for tablet e5b1a9b390d647218e87fb61f5da3638 (DEFAULT_TABLE table=default.Table_99409c0387c74d8ca4fcf88a9968acf4 [id=8b0fc7f33af8494ca75d15072d51c873]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.097609 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b1a9b390d647218e87fb61f5da3638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.100294 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f7e203f023745f0b9b44085b0943c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.101974 11347 tablet_service.cc:1511] Processing CreateTablet for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 (DEFAULT_TABLE table=default.Table_d451558b9dd34a58997d77c2d847aee4 [id=8991221b069040778bcd2a794dd21f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.102433 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcbe8d08a1ff4c97a2f9a40d706f4281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.103928 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 1eaf1a05d9ca4af89c5e44e51e847928 (DEFAULT_TABLE table=default.Table_3ce6bd366a584b9c854e974ae30fe203 [id=0ce4c454653247dea7654e7984754dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.104344 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eaf1a05d9ca4af89c5e44e51e847928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.105283 13306 raft_consensus.cc:493] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.105448 13306 raft_consensus.cc:515] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.106206 13306 leader_election.cc:290] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.106957 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2618c46630c4295949b36f3d0087941" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:10.107568 11177 leader_election.cc:343] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:09.920204 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc (DEFAULT_TABLE table=default.Table_4a4a414c1da142179c47230a40b1945d [id=3f496d6b6d3340bf82027c59d578ab5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.920604 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 846488b5e224453eb96004f7423ee614 (DEFAULT_TABLE table=default.Table_ca45acb19bb2490c9022438afee35414 [id=d29f0b4c0afc40aebee17ae81180e949]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.920894 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 70c94e791a494eb580253e0c8e0fa56a (DEFAULT_TABLE table=default.Table_fd4295340ebf4ad28e0eb3568a272fcd [id=c779b15873c54817affbbb4791b1a0bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.925221 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 1b0d592dcd7a4a119befea22c35f5b2d (DEFAULT_TABLE table=default.Table_38b0c6e5f96842ad958e8d24379e8b22 [id=6be712c8124a4bd686efc316bfbbfc15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.927178 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b123ac1e894239875404438ed19927" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:09.939435 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 81c2d13ee77945f6a993ba99d57b5427 (DEFAULT_TABLE table=default.Table_30cf8a0d9f664848b66efda848625415 [id=3fd1df291b154b069a76d8f72067c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.110399 11204 tablet_service.cc:1511] Processing CreateTablet for tablet b4f92a9f912e4cbea81f2cca37b84967 (DEFAULT_TABLE table=default.Table_7cec5add800b426a95a58ae9947ca146 [id=d6ccbc19e838402498a4303e76999fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.941978 11496 tablet_service.cc:1511] Processing CreateTablet for tablet bd8e5635aa934269b69ca45467aa274b (DEFAULT_TABLE table=default.Table_d90f452532144ce98c7d4e351a71190b [id=13d8d757618d42ecb7f8a8e83c9ca648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.110473 11946 log.cc:1199] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b91957f62d8044ea8f6a3464c84b9e10
I20260925 01:50:10.110493 11519 raft_consensus.cc:2468] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:10.110777 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f92a9f912e4cbea81f2cca37b84967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:09.942279 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 3ce8d023311b4a91adfebd6c5fedf1bd (DEFAULT_TABLE table=default.Table_6a9abc8df95942d3bcedfec0598b296c [id=546b02faa7c54273a34cbca17ab50226]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.942359 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 549219ff065e4bf7b441f7bdd7098d88 (DEFAULT_TABLE table=default.Table_0723b14a66f248a394aad936376c3cbc [id=dbc695c1a32043a998e198f83549b972]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.110984 11946 ts_tablet_manager.cc:1950] T b91957f62d8044ea8f6a3464c84b9e10 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:09.942453 11489 tablet_service.cc:1511] Processing CreateTablet for tablet d08b978d9b2945ffa966e2237bddd48c (DEFAULT_TABLE table=default.Table_476bf1ac18a8424287eb6e04103c5437 [id=25b3d3a9148f46e0bf7214c7d0443fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.978809 11486 tablet_service.cc:1511] Processing CreateTablet for tablet a8d3b4ec14d5457eb0d0d364904e755d (DEFAULT_TABLE table=default.Table_25eae0a5cb4d4de28ef70586f0093354 [id=4cb92ef0acc343f481e88e52aade8769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.979184 11503 tablet_service.cc:1511] Processing CreateTablet for tablet dc00e20861c54760ac8409c54abd1795 (DEFAULT_TABLE table=default.Table_20ebf4c7095a4388acf30cfc1ee53c59 [id=6d76134fb5494345bfc0d017ef2e6988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.979494 11499 tablet_service.cc:1511] Processing CreateTablet for tablet daef608e7d834af78de6e35e3349cdfd (DEFAULT_TABLE table=default.Table_fc489c45aa2f4bfbbde8d88ed70b0d55 [id=09f896eacb9445348b400fab867bff4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.979795 11485 tablet_service.cc:1511] Processing CreateTablet for tablet e1480131c1e74536b5f3fa54764dc4f3 (DEFAULT_TABLE table=default.Table_76ddcad4f1a84ce599a5c29562a9ae9b [id=8592d9417daa4582bdc009f815a7364d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.980106 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 7dfb342a744147e99917b6f32bd07b06 (DEFAULT_TABLE table=default.Table_f40821075d3c4668b7099d6fceee3c21 [id=c69c8e607b53479e96b5fe301be0a272]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.980437 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 0adccf055e0047919e730c522e470cbd (DEFAULT_TABLE table=default.Table_d8bff0bd6b85436a97a7ead19ee47e1a [id=a3505a80e770458199c89be60a15d1d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.980782 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 6202860babb849568628e34a4fa28596 (DEFAULT_TABLE table=default.Table_b6b66fd099114d3fa9bf0b4cd9839b02 [id=98d49898b5f34575a18d2ee39224aedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.981369 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 1a865bc53296438f9b1ff0c6b11c2c2d (DEFAULT_TABLE table=default.Table_bea72848a0204c5f93359abe4f3ff9d5 [id=c8c8b0afc7b844cabccdec5ba885ec4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.981738 11484 tablet_service.cc:1511] Processing CreateTablet for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 (DEFAULT_TABLE table=default.Table_d451558b9dd34a58997d77c2d847aee4 [id=8991221b069040778bcd2a794dd21f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:09.981900 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 62c0395b7a63486a93d46a8fb5809b35 (DEFAULT_TABLE table=default.Table_885c17a19ebe40b08339efd10d1a9f96 [id=63f30b1a260440f2bfd1618bcd2c4104]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:09.985986 11457 consensus_peers.cc:597] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:10.111646 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 125732us
I20260925 01:50:10.112280 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48bd9071170d4f6f9ac4039020de5c00" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:10.106621 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2618c46630c4295949b36f3d0087941" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:10.113198 11522 raft_consensus.cc:2468] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:10.107180 13276 consensus_queue.cc:1048] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:09.942279 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea47f7897614207a1af33f6bb35cc83 (DEFAULT_TABLE table=default.Table_6535b827d6fb43b7bae1647a19913dce [id=9789428f19754e4da084cd8410e90ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.114280 11176 leader_election.cc:304] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:10.114528 13210 raft_consensus.cc:2804] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:10.114595 13210 raft_consensus.cc:493] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:10.114653 13210 raft_consensus.cc:3060] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.114977 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 974467b4e375470094d56c16218cef9c (DEFAULT_TABLE table=default.Table_a69c32a8461b431d9573c99f2cbf16e2 [id=cc50d6b58dde476d90d95aa4266e8f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.115322 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 974467b4e375470094d56c16218cef9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.115494 13276 consensus_queue.cc:1048] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:10.117527 13210 raft_consensus.cc:515] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:10.118417 11176 leader_election.cc:304] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:10.118667 13209 raft_consensus.cc:2804] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:10.118731 13209 raft_consensus.cc:493] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:10.118804 13209 raft_consensus.cc:3060] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.119522 11314 leader_election.cc:304] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:10.120070 11314 consensus_peers.cc:597] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 770ebdbd355142ba86fd9eb8eaa844f4. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:10.120087 13271 raft_consensus.cc:2749] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.121359 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 62c0395b7a63486a93d46a8fb5809b35 (DEFAULT_TABLE table=default.Table_885c17a19ebe40b08339efd10d1a9f96 [id=63f30b1a260440f2bfd1618bcd2c4104]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.121690 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c0395b7a63486a93d46a8fb5809b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.121681 13209 raft_consensus.cc:515] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.122545 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.125068 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 6202860babb849568628e34a4fa28596 (DEFAULT_TABLE table=default.Table_b6b66fd099114d3fa9bf0b4cd9839b02 [id=98d49898b5f34575a18d2ee39224aedc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.125211 13209 leader_election.cc:290] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.125452 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6202860babb849568628e34a4fa28596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.125471 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2618c46630c4295949b36f3d0087941" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:10.125965 11177 leader_election.cc:343] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.126267 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 846488b5e224453eb96004f7423ee614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.130110 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 8c32ab4d6bde4830b7ed53b3aeca3878 (DEFAULT_TABLE table=default.Table_346e965d39234aaa8ed222800eb0fc34 [id=0fe3d596affa4e16af2dcd256121de6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.130275 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c94e791a494eb580253e0c8e0fa56a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.130451 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c32ab4d6bde4830b7ed53b3aeca3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.130810 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1480131c1e74536b5f3fa54764dc4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.130883 13210 leader_election.cc:290] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.131492 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b123ac1e894239875404438ed19927" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:10.131989 11177 leader_election.cc:343] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.134140 11219 tablet_service.cc:1511] Processing CreateTablet for tablet f12d5e9be5c340abbda31d0a8316da23 (DEFAULT_TABLE table=default.Table_1b208d4f9adf4fb68e03f8b99db77356 [id=b5a703cfbcc8469582085173f0ebf848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.134272 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b0d592dcd7a4a119befea22c35f5b2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.134548 11219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12d5e9be5c340abbda31d0a8316da23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.135829 11355 tablet_service.cc:1511] Processing CreateTablet for tablet fb247af96521453eaf81e8df4e58303d (DEFAULT_TABLE table=default.Table_72b9bf9e8daa4d8ba25863cf74ba0563 [id=49d78ae502964851ad8718978a4f8f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.136171 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb247af96521453eaf81e8df4e58303d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.138197 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 0258eac5971842878c62326952115490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.138404 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet f8ffc45058774a878d4b802400feecb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.138546 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 532e290a0db34fbfab0328ca8f8d1e6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.138864 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 310c2faa268f49b09223591ea56946bb (DEFAULT_TABLE table=default.Table_30f2b681c35d4fba9fa318b24ecb1033 [id=ff05d7e65dac4351a9a965090c6286e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.139120 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 85d859207bbc4aefb26c726dce404c44 (table default.Table_b294b68c22864c009d79e9fb833ba9f1 [id=547a29a570064420aa9eaaec9543cdb3]) successfully deleted
I20260925 01:50:10.139207 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 310c2faa268f49b09223591ea56946bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.139266 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b123ac1e894239875404438ed19927" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:10.139430 11513 raft_consensus.cc:3060] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.140470 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 67ad5fb90dad4f869e87cfbb7717035e (DEFAULT_TABLE table=default.Table_37f09900657f43d79f9eca3fe69932f9 [id=52e166447f1840ea8f0b00cf195471f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.140785 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ad5fb90dad4f869e87cfbb7717035e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.141038 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe38c3b18f844897952b4c98ff0ace7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.142244 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2618c46630c4295949b36f3d0087941" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:10.142311 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 75d9509bd20f410fbe8f33854546af08 (DEFAULT_TABLE table=default.Table_dcf6b955044a4f3ba2e8c3d9c23bee04 [id=693541b1cfe647fbb5a724807cbf209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.142398 11522 raft_consensus.cc:3060] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.142625 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d9509bd20f410fbe8f33854546af08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.142678 11513 raft_consensus.cc:2468] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:10.145553 11522 raft_consensus.cc:2468] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:10.146678 13210 raft_consensus.cc:493] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.146169 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 with delete_type TABLET_DATA_DELETED (replaced by tablet f066d2f3f4504e08be7a8783a6fd7abd) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.146850 13210 raft_consensus.cc:515] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.147051 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81c2d13ee77945f6a993ba99d57b5427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.147284 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd6540906b24919a8324979ce1e5b5a (DEFAULT_TABLE table=default.Table_34b02f12b7b94204aef2095afe4d766c [id=93510a05aa6b4a908a6911ba63cd04be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.147612 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd6540906b24919a8324979ce1e5b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.148087 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d31139e1e441aa6fe204168486e28" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:10.148609 11177 leader_election.cc:343] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.148782 13210 leader_election.cc:290] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.149515 11176 leader_election.cc:304] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:10.149595 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_97757461ab5b4c0886d1e0ea85ddfaa9" } new_table_name: "default.Table_ba88e1dc63f041d3b76e16919a4d6f95" modify_external_catalogs: true
I20260925 01:50:10.149876 11176 leader_election.cc:304] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:10.150276 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e5635aa934269b69ca45467aa274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.151261 13209 raft_consensus.cc:2804] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:10.151432 13140 raft_consensus.cc:2804] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:10.151507 13140 raft_consensus.cc:697] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:10.151528 11343 tablet_service.cc:1511] Processing CreateTablet for tablet dceeedf3471d45508f025e7a4c7f73f2 (DEFAULT_TABLE table=default.Table_d9ec82d6876c42f4ba2646cb90d5c35b [id=8713b7aabc1a423fa360ce93bc949629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.151854 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dceeedf3471d45508f025e7a4c7f73f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.151729 13140 consensus_queue.cc:237] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.151993 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ce8d023311b4a91adfebd6c5fedf1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.152791 13209 raft_consensus.cc:697] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:10.153018 13209 consensus_queue.cc:237] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:10.153679 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d31139e1e441aa6fe204168486e28" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:10.153843 11522 raft_consensus.cc:2468] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:10.146190 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ac251aa75344cf8ac29dd30c893d84b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.154331 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549219ff065e4bf7b441f7bdd7098d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.154454 11353 tablet_service.cc:1511] Processing CreateTablet for tablet fe38c3b18f844897952b4c98ff0ace7d (DEFAULT_TABLE table=default.Table_8f0757127a1b42eca8ea1ed79f738dfa [id=6d71e2491a8b4d36b711948e0b75908b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.154749 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe38c3b18f844897952b4c98ff0ace7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.157246 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08b978d9b2945ffa966e2237bddd48c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.157433 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8d3b4ec14d5457eb0d0d364904e755d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.161301 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 67ad5fb90dad4f869e87cfbb7717035e (DEFAULT_TABLE table=default.Table_37f09900657f43d79f9eca3fe69932f9 [id=52e166447f1840ea8f0b00cf195471f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.161494 13373 raft_consensus.cc:493] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.161659 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ad5fb90dad4f869e87cfbb7717035e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.161610 13373 raft_consensus.cc:515] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.162165 13373 leader_election.cc:290] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.163165 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 with delete_type TABLET_DATA_DELETED (replaced by tablet f066d2f3f4504e08be7a8783a6fd7abd) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.163471 11486 tablet_service.cc:1511] Processing CreateTablet for tablet fb247af96521453eaf81e8df4e58303d (DEFAULT_TABLE table=default.Table_72b9bf9e8daa4d8ba25863cf74ba0563 [id=49d78ae502964851ad8718978a4f8f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.163772 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb247af96521453eaf81e8df4e58303d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.169394 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 1a865bc53296438f9b1ff0c6b11c2c2d (DEFAULT_TABLE table=default.Table_bea72848a0204c5f93359abe4f3ff9d5 [id=c8c8b0afc7b844cabccdec5ba885ec4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.169783 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a865bc53296438f9b1ff0c6b11c2c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.172240 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ffb404d93a4436ba9e624b45650fe1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:10.172310 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef025c076394333b416b6613f9116d6 (DEFAULT_TABLE table=default.Table_68b05a96deb14f4eaddad7c1cf98a651 [id=5dc5a14f4ab54258a830c761642e174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.172638 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef025c076394333b416b6613f9116d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.173110 11456 leader_election.cc:343] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.173363 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 0258eac5971842878c62326952115490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.173779 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 75d9509bd20f410fbe8f33854546af08 (DEFAULT_TABLE table=default.Table_dcf6b955044a4f3ba2e8c3d9c23bee04 [id=693541b1cfe647fbb5a724807cbf209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.174171 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d9509bd20f410fbe8f33854546af08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.175571 11176 leader_election.cc:304] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:10.175969 13306 raft_consensus.cc:2804] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:10.176043 13306 raft_consensus.cc:493] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:10.176098 13306 raft_consensus.cc:3060] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.179131 13306 raft_consensus.cc:515] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.180184 13306 leader_election.cc:290] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.186793 11488 tablet_service.cc:1511] Processing CreateTablet for tablet dceeedf3471d45508f025e7a4c7f73f2 (DEFAULT_TABLE table=default.Table_d9ec82d6876c42f4ba2646cb90d5c35b [id=8713b7aabc1a423fa360ce93bc949629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.187166 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dceeedf3471d45508f025e7a4c7f73f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.174719 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ac251aa75344cf8ac29dd30c893d84b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.187526 11496 tablet_service.cc:1511] Processing CreateTablet for tablet fe38c3b18f844897952b4c98ff0ace7d (DEFAULT_TABLE table=default.Table_8f0757127a1b42eca8ea1ed79f738dfa [id=6d71e2491a8b4d36b711948e0b75908b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.187903 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe38c3b18f844897952b4c98ff0ace7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.191495 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 63f96f2643dc4de29f8609a657102b80 (DEFAULT_TABLE table=default.Table_ada1f063f511450c9c742f4b0fb7be82 [id=2e3097c96afe45cf9ccb5a28dff4ddc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.191847 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f96f2643dc4de29f8609a657102b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.193629 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef025c076394333b416b6613f9116d6 (DEFAULT_TABLE table=default.Table_68b05a96deb14f4eaddad7c1cf98a651 [id=5dc5a14f4ab54258a830c761642e174e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.193941 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef025c076394333b416b6613f9116d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.180182 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d31139e1e441aa6fe204168486e28" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:10.194165 11522 raft_consensus.cc:3060] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.196995 11522 raft_consensus.cc:2468] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:10.180383 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet f8ffc45058774a878d4b802400feecb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.197711 11176 leader_election.cc:304] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:10.198001 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97bbad6b7348caaed4d745343b811c (DEFAULT_TABLE table=default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.198453 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97bbad6b7348caaed4d745343b811c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.200397 13209 raft_consensus.cc:2804] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:10.200708 13209 raft_consensus.cc:697] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
W20260925 01:50:10.180868 11457 consensus_peers.cc:597] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:10.183142 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 310c2faa268f49b09223591ea56946bb (DEFAULT_TABLE table=default.Table_30f2b681c35d4fba9fa318b24ecb1033 [id=ff05d7e65dac4351a9a965090c6286e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.202494 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 310c2faa268f49b09223591ea56946bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.211615 11177 consensus_peers.cc:597] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:10.184422 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 532e290a0db34fbfab0328ca8f8d1e6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.215333 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1510ec076a4483bc1e3c2eeb5b7b51 (DEFAULT_TABLE table=default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c [id=923936ead93f43d5bb7370a3605f8098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.215880 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1510ec076a4483bc1e3c2eeb5b7b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.184767 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd6540906b24919a8324979ce1e5b5a (DEFAULT_TABLE table=default.Table_34b02f12b7b94204aef2095afe4d766c [id=93510a05aa6b4a908a6911ba63cd04be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.217718 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd6540906b24919a8324979ce1e5b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.202358 13209 consensus_queue.cc:237] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.222597 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet b306496f992f45a9b64b05b73712cb5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.222826 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.223029 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.223204 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.223363 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 818a792969a245f5b0fe5f80128206ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.223516 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.223946 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet 406d31139e1e441aa6fe204168486e28 with delete_type TABLET_DATA_DELETED (replaced by tablet 4480d3b5671a4f2aaf98941cc8d58433) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.224131 11486 tablet_service.cc:1558] Processing DeleteTablet for tablet b61b1bf5a8d446918edc6d166b7712ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.224889 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 16f02aab5fb74c22ac2451b8df1f0a13 (DEFAULT_TABLE table=default.Table_9949d5ff8dc5438bbdac2523833b7a53 [id=8fa38038764b48138f1f9f35fddb185e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.226285 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f02aab5fb74c22ac2451b8df1f0a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.174944 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ffb404d93a4436ba9e624b45650fe1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:10.169394 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 63f96f2643dc4de29f8609a657102b80 (DEFAULT_TABLE table=default.Table_ada1f063f511450c9c742f4b0fb7be82 [id=2e3097c96afe45cf9ccb5a28dff4ddc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.231333 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f96f2643dc4de29f8609a657102b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.233796 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 8c32ab4d6bde4830b7ed53b3aeca3878 (DEFAULT_TABLE table=default.Table_346e965d39234aaa8ed222800eb0fc34 [id=0fe3d596affa4e16af2dcd256121de6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.234215 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c32ab4d6bde4830b7ed53b3aeca3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.240693 13271 raft_consensus.cc:493] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.240849 13271 raft_consensus.cc:515] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:10.241513 13271 leader_election.cc:290] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:10.241837 11486 tablet_service.cc:1511] Processing CreateTablet for tablet d7ad64d213b740a8920efe216b6ffba1 (DEFAULT_TABLE table=default.Table_c54f81e7d3234f95890fbd622794df08 [id=c9122c4081c54b2bae0e342a87fc567d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.242295 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7ad64d213b740a8920efe216b6ffba1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.243085 11457 leader_election.cc:343] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.243212 11457 leader_election.cc:304] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.243427 13373 raft_consensus.cc:2749] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.177735 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1510ec076a4483bc1e3c2eeb5b7b51 (DEFAULT_TABLE table=default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c [id=923936ead93f43d5bb7370a3605f8098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.180390 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "406d31139e1e441aa6fe204168486e28" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:10.185277 13321 raft_consensus.cc:493] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.244624 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1510ec076a4483bc1e3c2eeb5b7b51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.244652 13321 raft_consensus.cc:515] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.245285 13321 leader_election.cc:290] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:10.217824 11345 tablet_service.cc:1511] Processing CreateTablet for tablet d7ad64d213b740a8920efe216b6ffba1 (DEFAULT_TABLE table=default.Table_c54f81e7d3234f95890fbd622794df08 [id=c9122c4081c54b2bae0e342a87fc567d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.220384 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 974467b4e375470094d56c16218cef9c (DEFAULT_TABLE table=default.Table_a69c32a8461b431d9573c99f2cbf16e2 [id=cc50d6b58dde476d90d95aa4266e8f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.224650 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 16f02aab5fb74c22ac2451b8df1f0a13 (DEFAULT_TABLE table=default.Table_9949d5ff8dc5438bbdac2523833b7a53 [id=8fa38038764b48138f1f9f35fddb185e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.212049 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 8c32ab4d6bde4830b7ed53b3aeca3878 (DEFAULT_TABLE table=default.Table_346e965d39234aaa8ed222800eb0fc34 [id=0fe3d596affa4e16af2dcd256121de6a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.225513 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f7e203f023745f0b9b44085b0943c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.245642 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7ad64d213b740a8920efe216b6ffba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.245950 11343 tablet_service.cc:1511] Processing CreateTablet for tablet e5b1a9b390d647218e87fb61f5da3638 (DEFAULT_TABLE table=default.Table_99409c0387c74d8ca4fcf88a9968acf4 [id=8b0fc7f33af8494ca75d15072d51c873]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.225795 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 1f97bbad6b7348caaed4d745343b811c (DEFAULT_TABLE table=default.Table_3adbf2cf7ef74941a8667f2eb134df79 [id=1a5a59e2daad4fb78689dd25363b7086]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:10.247192 11314 leader_election.cc:343] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a07f37b8469a497ba3fe504cb21105d2
W20260925 01:50:10.247489 11314 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:10.249910 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 974467b4e375470094d56c16218cef9c (DEFAULT_TABLE table=default.Table_a69c32a8461b431d9573c99f2cbf16e2 [id=cc50d6b58dde476d90d95aa4266e8f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.250397 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f02aab5fb74c22ac2451b8df1f0a13. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.250715 11177 leader_election.cc:343] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.253808 11345 tablet_service.cc:1511] Processing CreateTablet for tablet b4f92a9f912e4cbea81f2cca37b84967 (DEFAULT_TABLE table=default.Table_7cec5add800b426a95a58ae9947ca146 [id=d6ccbc19e838402498a4303e76999fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.254292 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c32ab4d6bde4830b7ed53b3aeca3878. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.254240 11314 leader_election.cc:343] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a07f37b8469a497ba3fe504cb21105d2
I20260925 01:50:10.254410 11314 leader_election.cc:304] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.254608 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f92a9f912e4cbea81f2cca37b84967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.254698 13321 raft_consensus.cc:2749] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.255132 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b1a9b390d647218e87fb61f5da3638. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.255158 11314 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:10.255237 11314 leader_election.cc:304] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.255435 13321 raft_consensus.cc:2749] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:10.256059 11349 tablet_service.cc:1511] Processing CreateTablet for tablet f12d5e9be5c340abbda31d0a8316da23 (DEFAULT_TABLE table=default.Table_1b208d4f9adf4fb68e03f8b99db77356 [id=b5a703cfbcc8469582085173f0ebf848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.256407 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12d5e9be5c340abbda31d0a8316da23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.258662 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f97bbad6b7348caaed4d745343b811c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.263887 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 974467b4e375470094d56c16218cef9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.265735 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ea77bdd6680491da6f9aa8e218bdace consensus state has no leader
I20260925 01:50:10.266736 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c3701457633346d4b7d3c3bf2fceb1f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:10.267866 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_051053b5f32b4ceeac66666a2b2bbfdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.268465 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_051053b5f32b4ceeac66666a2b2bbfdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.269745 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:10.270651 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:10.270968 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]). Expected version 2 got 0
W20260925 01:50:10.276058 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3701457633346d4b7d3c3bf2fceb1f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.277244 11488 tablet_service.cc:1511] Processing CreateTablet for tablet e5b1a9b390d647218e87fb61f5da3638 (DEFAULT_TABLE table=default.Table_99409c0387c74d8ca4fcf88a9968acf4 [id=8b0fc7f33af8494ca75d15072d51c873]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.277671 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b1a9b390d647218e87fb61f5da3638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.288357 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_10c224c69f074f37af2bc1b4960dedd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.289074 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10c224c69f074f37af2bc1b4960dedd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.297307 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 1eaf1a05d9ca4af89c5e44e51e847928 (DEFAULT_TABLE table=default.Table_3ce6bd366a584b9c854e974ae30fe203 [id=0ce4c454653247dea7654e7984754dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.298162 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 55405ccc8a7848f6addd4bf20e8379f5 (DEFAULT_TABLE table=default.Table_51b55c1a28a74a73a883a31c2d1e62d1 [id=9fc569bbd1af45718f84f926d1e001da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.298594 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55405ccc8a7848f6addd4bf20e8379f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.299315 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f7e203f023745f0b9b44085b0943c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.299877 11953 ts_tablet_manager.cc:1929] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:10.301856 11680 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_681ae5b686244ea8857d7d27e3781fd7 [id=590734454eea4965a095ef821bc27366] alter complete (version 2)
W20260925 01:50:10.303555 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61c1181b38a247e79bd7a6355950881e consensus state has no leader
W20260925 01:50:10.304047 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6091ed7d816a46958a6de343fe682292 consensus state has no leader
I20260925 01:50:10.304939 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7368edcc9df84c73b799d90f8e2f54b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.305567 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7368edcc9df84c73b799d90f8e2f54b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.306967 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6a9abc8df95942d3bcedfec0598b296c" } modify_external_catalogs: true
I20260925 01:50:10.307188 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6a9abc8df95942d3bcedfec0598b296c" } modify_external_catalogs: true
I20260925 01:50:10.308617 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0e530a05e7374eef90dd27c3d716072c" } modify_external_catalogs: true
I20260925 01:50:10.308789 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0e530a05e7374eef90dd27c3d716072c" } modify_external_catalogs: true
I20260925 01:50:10.310195 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_96933f12fc314e0e9d47d0e3a60cb27c" } modify_external_catalogs: true
I20260925 01:50:10.310395 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_96933f12fc314e0e9d47d0e3a60cb27c" } modify_external_catalogs: true
I20260925 01:50:10.335662 11492 tablet_service.cc:1511] Processing CreateTablet for tablet f12d5e9be5c340abbda31d0a8316da23 (DEFAULT_TABLE table=default.Table_1b208d4f9adf4fb68e03f8b99db77356 [id=b5a703cfbcc8469582085173f0ebf848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.300079 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 828) took 1145 ms. Trace:
I20260925 01:50:10.329069 11753 tablet_bootstrap.cc:492] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:10.336164 11946 rpcz_store.cc:276] 0925 01:50:09.154897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.155312 (+ 415us) service_pool.cc:224] Handling call
0925 01:50:09.856223 (+700911us) ts_tablet_manager.cc:1151] Deleting tablet b91957f62d8044ea8f6a3464c84b9e10
0925 01:50:09.856233 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:09.867203 (+ 10970us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:09.908692 (+ 41489us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.300057 (+391365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3456,"tablet-delete.queue_time_us":700753}
I20260925 01:50:10.336649 11753 ts_tablet_manager.cc:1403] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.441s user 0.004s sys 0.001s
I20260925 01:50:10.337435 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b91957f62d8044ea8f6a3464c84b9e10 (table default.Table_465f8ad05c214b8d82f91435312f0d53 [id=29a90e81d716408ca1c9f60ae76242be]) successfully deleted
I20260925 01:50:10.337947 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 829) took 1176 ms. Trace:
I20260925 01:50:10.338145 11946 rpcz_store.cc:276] 0925 01:50:09.161970 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.167170 (+ 5200us) service_pool.cc:224] Handling call
0925 01:50:10.337805 (+1170635us) ts_tablet_manager.cc:1151] Deleting tablet 52c716eb26d04a33b4c3b3c56a7fbac6
0925 01:50:10.337815 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.337926 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168751}
W20260925 01:50:10.338789 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c716eb26d04a33b4c3b3c56a7fbac6 already in progress: creating tablet
I20260925 01:50:10.339223 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 831) took 1156 ms. Trace:
I20260925 01:50:10.347787 11946 rpcz_store.cc:276] 0925 01:50:09.182590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.182775 (+ 185us) service_pool.cc:224] Handling call
0925 01:50:10.339114 (+1156339us) ts_tablet_manager.cc:1151] Deleting tablet e4d3293730684400a84f1ca62bb6a95d
0925 01:50:10.339124 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.339205 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1156130}
W20260925 01:50:10.349306 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e4d3293730684400a84f1ca62bb6a95d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4d3293730684400a84f1ca62bb6a95d already in progress: creating tablet
I20260925 01:50:10.349911 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 1eaf1a05d9ca4af89c5e44e51e847928 (DEFAULT_TABLE table=default.Table_3ce6bd366a584b9c854e974ae30fe203 [id=0ce4c454653247dea7654e7984754dd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.352085 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_a6b67f9415ae41dbaf3903dbbaec308f [id=c23a94a77b36437f843f323488d4ed42] alter complete (version 1)
I20260925 01:50:10.329293 11501 tablet_service.cc:1511] Processing CreateTablet for tablet b4f92a9f912e4cbea81f2cca37b84967 (DEFAULT_TABLE table=default.Table_7cec5add800b426a95a58ae9947ca146 [id=d6ccbc19e838402498a4303e76999fed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.338601 11753 raft_consensus.cc:359] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.352810 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 974467b4e375470094d56c16218cef9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.363044 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea47f7897614207a1af33f6bb35cc83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.366253 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daef608e7d834af78de6e35e3349cdfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.369270 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 55405ccc8a7848f6addd4bf20e8379f5 (DEFAULT_TABLE table=default.Table_51b55c1a28a74a73a883a31c2d1e62d1 [id=9fc569bbd1af45718f84f926d1e001da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.369642 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55405ccc8a7848f6addd4bf20e8379f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.370316 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a865bc53296438f9b1ff0c6b11c2c2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.374398 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dfb342a744147e99917b6f32bd07b06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.378317 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1480131c1e74536b5f3fa54764dc4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.382635 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c0395b7a63486a93d46a8fb5809b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.384966 13356 ts_tablet_manager.cc:1929] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:10.385082 13356 log.cc:1199] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/fce91b00d3a14e6398abacad61ff5b0f
I20260925 01:50:10.385373 13356 ts_tablet_manager.cc:1950] T fce91b00d3a14e6398abacad61ff5b0f P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:10.386313 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc00e20861c54760ac8409c54abd1795. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.389210 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 246aafd66334407895ce235e4b2ca7f4 consensus state has no leader
I20260925 01:50:10.389763 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcbe8d08a1ff4c97a2f9a40d706f4281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.393090 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_58ce32fc2217428ab10cab615b1c968e" } modify_external_catalogs: true
I20260925 01:50:10.393371 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_58ce32fc2217428ab10cab615b1c968e" } modify_external_catalogs: true
I20260925 01:50:10.394701 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6202860babb849568628e34a4fa28596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.398703 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0adccf055e0047919e730c522e470cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.402372 11673 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9] alter complete (version 4)
I20260925 01:50:10.410041 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6821b0e5714046c69acfc48f4d0bc8d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.410778 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6821b0e5714046c69acfc48f4d0bc8d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.413425 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_680b07a036384b658c5ceba2509b47bd" } new_table_name: "default.Table_24c0459b555f4b568e866d7d89977bfd" modify_external_catalogs: true
I20260925 01:50:10.406711 11754 tablet_bootstrap.cc:492] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:10.417655 11754 ts_tablet_manager.cc:1403] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.440s user 0.003s sys 0.003s
I20260925 01:50:10.418576 11754 raft_consensus.cc:359] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:10.418851 11754 raft_consensus.cc:385] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.418973 11754 raft_consensus.cc:740] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.419376 11754 consensus_queue.cc:260] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:10.420188 11754 ts_tablet_manager.cc:1434] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:10.424786 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d451558b9dd34a58997d77c2d847aee4" } modify_external_catalogs: true
I20260925 01:50:10.425045 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d451558b9dd34a58997d77c2d847aee4" } modify_external_catalogs: true
I20260925 01:50:10.430176 13276 raft_consensus.cc:493] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.430311 13276 raft_consensus.cc:515] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.430871 13276 leader_election.cc:290] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.315009 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 55405ccc8a7848f6addd4bf20e8379f5 (DEFAULT_TABLE table=default.Table_51b55c1a28a74a73a883a31c2d1e62d1 [id=9fc569bbd1af45718f84f926d1e001da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.444927 11953 log.cc:1199] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/9cd2e1bf7d3e4459a84235b9c3f5383c
I20260925 01:50:10.322228 13321 raft_consensus.cc:493] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.323222 13271 raft_consensus.cc:493] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.445266 13271 raft_consensus.cc:515] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:10.445355 11953 ts_tablet_manager.cc:1950] T 9cd2e1bf7d3e4459a84235b9c3f5383c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:10.353425 11375 raft_consensus.cc:3060] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.446276 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 547) took 9251 ms. Trace:
I20260925 01:50:10.446355 11953 rpcz_store.cc:276] 0925 01:50:01.194825 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.194922 (+ 97us) service_pool.cc:224] Handling call
0925 01:50:09.951589 (+8756667us) ts_tablet_manager.cc:1151] Deleting tablet 9cd2e1bf7d3e4459a84235b9c3f5383c
0925 01:50:09.951601 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.294249 (+342648us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.299789 (+ 5540us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.446254 (+146465us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8756374}
I20260925 01:50:10.446997 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 9cd2e1bf7d3e4459a84235b9c3f5383c (table default.Table_962d7117724d4e5aa1b45a6fab966667 [id=768d79ef588e46be97ceffa64db19940]) successfully deleted
I20260925 01:50:10.447788 11953 tablet_replica.cc:333] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:10.447992 11953 raft_consensus.cc:2243] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.445226 13321 raft_consensus.cc:515] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.448150 11953 raft_consensus.cc:2272] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.448694 11953 ts_tablet_manager.cc:1916] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.448760 13321 leader_election.cc:290] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:10.449250 13271 leader_election.cc:290] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:10.450073 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d9319bb3e508473686691911e58a49cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.450774 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9319bb3e508473686691911e58a49cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.362406 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eaf1a05d9ca4af89c5e44e51e847928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.453989 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55405ccc8a7848f6addd4bf20e8379f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.429039 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 864) took 1272 ms. Trace:
I20260925 01:50:10.458135 13356 rpcz_store.cc:276] 0925 01:50:09.156921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.157440 (+ 519us) service_pool.cc:224] Handling call
0925 01:50:09.862380 (+704940us) ts_tablet_manager.cc:1151] Deleting tablet fce91b00d3a14e6398abacad61ff5b0f
0925 01:50:09.862390 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.365151 (+502761us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.384899 (+ 19748us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.429014 (+ 44115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":704813}
I20260925 01:50:10.458742 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet fce91b00d3a14e6398abacad61ff5b0f (table default.Table_f1000553782a4118a246bbda71eaf618 [id=283f50719ac648e297b59efd4f00941d]) successfully deleted
I20260925 01:50:10.459195 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 858) took 1302 ms. Trace:
I20260925 01:50:10.459460 13356 rpcz_store.cc:276] 0925 01:50:09.156274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.159722 (+ 3448us) service_pool.cc:224] Handling call
0925 01:50:10.459035 (+1299313us) ts_tablet_manager.cc:1151] Deleting tablet 5366f2487b444e12ad9d63d6825d5e97
0925 01:50:10.459050 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.459166 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1299149}
W20260925 01:50:10.460034 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5366f2487b444e12ad9d63d6825d5e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5366f2487b444e12ad9d63d6825d5e97 already in progress: creating tablet
I20260925 01:50:10.460620 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 865) took 1298 ms. Trace:
I20260925 01:50:10.460706 13356 rpcz_store.cc:276] 0925 01:50:09.162248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.162304 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:10.460432 (+1298128us) ts_tablet_manager.cc:1151] Deleting tablet 52c716eb26d04a33b4c3b3c56a7fbac6
0925 01:50:10.460501 (+ 69us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.460603 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1297958}
W20260925 01:50:10.461149 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c716eb26d04a33b4c3b3c56a7fbac6 already in progress: creating tablet
I20260925 01:50:10.461525 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 866) took 1278 ms. Trace:
I20260925 01:50:10.461607 13356 rpcz_store.cc:276] 0925 01:50:09.183168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.183263 (+ 95us) service_pool.cc:224] Handling call
0925 01:50:10.461415 (+1278152us) ts_tablet_manager.cc:1151] Deleting tablet e4d3293730684400a84f1ca62bb6a95d
0925 01:50:10.461426 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.461508 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1277906}
W20260925 01:50:10.462069 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e4d3293730684400a84f1ca62bb6a95d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4d3293730684400a84f1ca62bb6a95d already in progress: creating tablet
I20260925 01:50:10.462435 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 867) took 1277 ms. Trace:
I20260925 01:50:10.462517 13356 rpcz_store.cc:276] 0925 01:50:09.185347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.185430 (+ 83us) service_pool.cc:224] Handling call
0925 01:50:10.462328 (+1276898us) ts_tablet_manager.cc:1151] Deleting tablet 7809737ca3d24bfe8829f17d5e3215f5
0925 01:50:10.462338 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.462417 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276698}
W20260925 01:50:10.465505 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 7809737ca3d24bfe8829f17d5e3215f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7809737ca3d24bfe8829f17d5e3215f5 already in progress: creating tablet
I20260925 01:50:10.465960 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 868) took 1279 ms. Trace:
I20260925 01:50:10.466121 13356 rpcz_store.cc:276] 0925 01:50:09.186960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.187046 (+ 86us) service_pool.cc:224] Handling call
0925 01:50:10.465819 (+1278773us) ts_tablet_manager.cc:1151] Deleting tablet 007ee8e3087c4a70b9c5d8436a31659f
0925 01:50:10.465829 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.465941 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1278590}
I20260925 01:50:10.466488 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3ce8d023311b4a91adfebd6c5fedf1bd
W20260925 01:50:10.466673 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 007ee8e3087c4a70b9c5d8436a31659f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007ee8e3087c4a70b9c5d8436a31659f already in progress: creating tablet
I20260925 01:50:10.467813 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ce8d023311b4a91adfebd6c5fedf1bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:10.468734 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 4cd34fa172904e51ade794892c580248 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd34fa172904e51ade794892c580248 already in progress: creating tablet
I20260925 01:50:10.469089 13356 tablet_replica.cc:333] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:10.469362 13356 raft_consensus.cc:2243] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.469588 13356 raft_consensus.cc:2272] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.471060 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fe3627bfb342448591ccaf3d7ab23c4a
I20260925 01:50:10.471939 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9a4219ce09e54d268c55c19f7b5cbc7d
I20260925 01:50:10.474460 13356 ts_tablet_manager.cc:1916] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.474436 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_0a21405c13e44a9b98038ff6cd0205d0" } new_table_name: "default.Table_f47b3f5f81e34fc1a7ea9e9a3f1f6d56" modify_external_catalogs: true
I20260925 01:50:10.469806 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ce8d023311b4a91adfebd6c5fedf1bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.471988 11754 tablet_bootstrap.cc:492] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:10.472107 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet fe3627bfb342448591ccaf3d7ab23c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.472683 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4219ce09e54d268c55c19f7b5cbc7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.476466 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_922ca81707ad4d368e920fae60995f2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:10.476544 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b7548999462a4a90b7843382fc8adc0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.477216 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7548999462a4a90b7843382fc8adc0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:10.477250 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_922ca81707ad4d368e920fae60995f2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.478811 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet fe3627bfb342448591ccaf3d7ab23c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.481896 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4219ce09e54d268c55c19f7b5cbc7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.485694 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d398851fb194c61a0a3b2c60c7a5e8b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:10.487573 11754 tablet_bootstrap.cc:654] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.503243 11754 tablet_bootstrap.cc:492] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:10.362669 11753 raft_consensus.cc:385] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.506350 11753 raft_consensus.cc:740] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.506757 11753 consensus_queue.cc:260] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.507244 11754 ts_tablet_manager.cc:1403] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s
I20260925 01:50:10.507532 11753 ts_tablet_manager.cc:1434] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.171s user 0.002s sys 0.000s
I20260925 01:50:10.510882 11754 raft_consensus.cc:359] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.512308 13271 raft_consensus.cc:493] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.512454 13271 raft_consensus.cc:515] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.513023 13271 leader_election.cc:290] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:10.514508 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87128b8baef4f9d80341f6980da519d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:10.514266 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e87128b8baef4f9d80341f6980da519d" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:10.515964 11754 raft_consensus.cc:385] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.516217 11754 raft_consensus.cc:740] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.516726 11754 consensus_queue.cc:260] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.520766 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_9c96e3747586472d861731441a16b7eb [id=0848b51bdadb45b5b1a5357208cfcd58] alter complete (version 4)
I20260925 01:50:10.520819 11754 ts_tablet_manager.cc:1434] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260925 01:50:10.523483 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet f2618c46630c4295949b36f3d0087941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.523712 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 406d31139e1e441aa6fe204168486e28 with delete_type TABLET_DATA_DELETED (replaced by tablet 4480d3b5671a4f2aaf98941cc8d58433) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.523805 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12d5e9be5c340abbda31d0a8316da23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.523875 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b123ac1e894239875404438ed19927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.524169 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 226498ea628a475d8fcab28a6598a819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.524555 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:10.350371 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 832) took 1165 ms. Trace:
I20260925 01:50:10.528767 11946 rpcz_store.cc:276] 0925 01:50:09.184700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.184755 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:10.350236 (+1165481us) ts_tablet_manager.cc:1151] Deleting tablet 7809737ca3d24bfe8829f17d5e3215f5
0925 01:50:10.350248 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.350352 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1165300}
W20260925 01:50:10.529443 11314 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c7944aa1ac8f4c5d8ea3aa2acae41257
W20260925 01:50:10.530138 11457 leader_election.cc:343] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.532687 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_fd97f72498c3402e89e99df9815178db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.533949 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd97f72498c3402e89e99df9815178db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.537665 11675 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:10.538215 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2c93bb7a34f94deaa65f8b588c604b81
I20260925 01:50:10.538647 11753 tablet_bootstrap.cc:492] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:10.539068 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c93bb7a34f94deaa65f8b588c604b81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.541368 11753 tablet_bootstrap.cc:654] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.542438 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c93bb7a34f94deaa65f8b588c604b81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.544693 11953 ts_tablet_manager.cc:1929] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:10.544847 11953 log.cc:1199] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/347a144e18ab4f6e834551044a2ac4ae
I20260925 01:50:10.545897 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:10.546586 11953 ts_tablet_manager.cc:1950] T 347a144e18ab4f6e834551044a2ac4ae P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:10.547156 13356 ts_tablet_manager.cc:1929] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:10.547550 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eaf1a05d9ca4af89c5e44e51e847928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.549806 13356 log.cc:1199] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/31ecfc5a2a80449c9905c83b6bcb3652
I20260925 01:50:10.550406 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 548) took 9353 ms. Trace:
I20260925 01:50:10.550977 13356 ts_tablet_manager.cc:1950] T 31ecfc5a2a80449c9905c83b6bcb3652 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:10.551435 11953 rpcz_store.cc:276] 0925 01:50:01.196621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.196665 (+ 44us) service_pool.cc:224] Handling call
0925 01:50:10.447735 (+9251070us) ts_tablet_manager.cc:1151] Deleting tablet 347a144e18ab4f6e834551044a2ac4ae
0925 01:50:10.447745 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.491233 (+ 43488us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.544622 (+ 53389us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.550387 (+ 5765us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9250931}
I20260925 01:50:10.552565 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 878) took 1027 ms. Trace:
I20260925 01:50:10.553329 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 347a144e18ab4f6e834551044a2ac4ae (table default.Table_04f98162b64e4576960f91d0a60432cb [id=ceda87d047234cf5885f9bd05d6abd7e]) successfully deleted
I20260925 01:50:10.554307 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 833) took 1368 ms. Trace:
I20260925 01:50:10.554493 11946 rpcz_store.cc:276] 0925 01:50:09.186197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.186259 (+ 62us) service_pool.cc:224] Handling call
0925 01:50:10.529263 (+1343004us) ts_tablet_manager.cc:1151] Deleting tablet 007ee8e3087c4a70b9c5d8436a31659f
0925 01:50:10.554102 (+ 24839us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.554271 (+ 169us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1342852}
I20260925 01:50:10.555302 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 842) took 1031 ms. Trace:
I20260925 01:50:10.555464 11946 rpcz_store.cc:276] 0925 01:50:09.524092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.524149 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:10.555157 (+1031008us) ts_tablet_manager.cc:1151] Deleting tablet 4cd34fa172904e51ade794892c580248
0925 01:50:10.555171 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.555282 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1030747}
I20260925 01:50:10.549435 11755 raft_consensus.cc:385] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.557729 11755 raft_consensus.cc:740] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.557864 11946 tablet_replica.cc:333] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:10.558584 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f92a9f912e4cbea81f2cca37b84967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.558694 11755 consensus_queue.cc:260] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.559273 11755 ts_tablet_manager.cc:1434] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.595s user 0.021s sys 0.000s
I20260925 01:50:10.560169 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet b97f703869d4471cb940ef654203ec2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.560318 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_199a67f3de15419596bd30573b668ac3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:10.561293 13356 rpcz_store.cc:276] 0925 01:50:09.524793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.524853 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:10.469037 (+944184us) ts_tablet_manager.cc:1151] Deleting tablet 31ecfc5a2a80449c9905c83b6bcb3652
0925 01:50:10.469048 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.508413 (+ 39365us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.547076 (+ 38663us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.552540 (+ 5464us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":943979}
I20260925 01:50:10.563514 13356 tablet_replica.cc:333] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
W20260925 01:50:10.563789 11755 ts_tablet_manager.cc:1467] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Tablet startup took 599ms
I20260925 01:50:10.564231 13356 raft_consensus.cc:2243] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:10.564456 11755 ts_tablet_manager.cc:1469] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Trace:
0925 01:49:49.529268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:49:49.529346 (+ 78us) service_pool.cc:224] Handling call
0925 01:49:49.529894 (+ 548us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0925 01:49:49.529927 (+ 33us) ts_tablet_manager.cc:682] Creating new metadata...
0925 01:49:49.716800 (+186873us) tablet_metadata.cc:665] Metadata flushed
0925 01:49:49.788012 (+ 71212us) tablet_replica.cc:206] Creating consensus instance
0925 01:49:49.788163 (+ 151us) inbound_call.cc:177] Queueing success response
0925 01:50:09.767182 (+19979019us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0925 01:50:09.963825 (+196643us) ts_tablet_manager.cc:1435] Starting tablet replica
0925 01:50:09.963970 (+ 145us) tablet_replica.cc:261] Starting instrumentation
0925 01:50:09.964101 (+ 131us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"tablet-open.queue_time_us":19979063}
I20260925 01:50:10.565384 13356 raft_consensus.cc:2272] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.563180 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 31ecfc5a2a80449c9905c83b6bcb3652 (table default.Table_3b5c5e5eccf6419294fcf649547572ac [id=17f681ed73a4408db51a13e3764c7ef7]) successfully deleted
W20260925 01:50:10.579293 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_199a67f3de15419596bd30573b668ac3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.565351 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_10c224c69f074f37af2bc1b4960dedd4" } new_table_name: "default.Table_7b590678fd634ad89ee5d6acec384f3b" modify_external_catalogs: true
I20260925 01:50:10.580367 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet dcbe8d08a1ff4c97a2f9a40d706f4281
W20260925 01:50:10.575881 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00345732f7314624831b4cfc59e981f4 consensus state has no leader
I20260925 01:50:10.585520 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_359930648bba4aa1b2c8e3b294aac1e0" } new_table_name: "default.Table_2f3b719cb1fb4ea38cc4619423a15171" modify_external_catalogs: true
W20260925 01:50:10.594944 13126 log.cc:927] Time spent T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Append to log took a long time: real 0.085s user 0.004s sys 0.000s
I20260925 01:50:10.605964 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c4ac9dcad4044cb582e5536c7213a978"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:10.607738 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_920b4b17a516441f8cb76a72f44453b8" } new_table_name: "default.Table_8f0cbfe28cef4f4ba36024de41a494b6" modify_external_catalogs: true
W20260925 01:50:10.608563 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4ac9dcad4044cb582e5536c7213a978 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.616587 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_db441414252c4a9f92baf9e3854a4498"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.620834 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db441414252c4a9f92baf9e3854a4498 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:10.622991 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80cd9735bf634871b7157443d0cfac37 consensus state has no leader
I20260925 01:50:10.623248 11946 raft_consensus.cc:2243] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.623546 11946 raft_consensus.cc:2272] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.627513 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b7b07e2438fa4ef5932c4cabe9d786c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.628327 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7b07e2438fa4ef5932c4cabe9d786c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.629662 11946 ts_tablet_manager.cc:1916] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.632395 13276 raft_consensus.cc:493] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.632629 13276 raft_consensus.cc:515] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.633512 13276 leader_election.cc:290] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.566811 11754 tablet_bootstrap.cc:492] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:10.637375 13356 ts_tablet_manager.cc:1916] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.583684 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:10.621088 13209 raft_consensus.cc:493] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.637847 13209 raft_consensus.cc:515] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.638589 13209 leader_election.cc:290] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.639802 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226498ea628a475d8fcab28a6598a819" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:10.639979 11516 raft_consensus.cc:2468] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:10.640431 11176 leader_election.cc:304] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:10.558140 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 551) took 9354 ms. Trace:
I20260925 01:50:10.640753 11953 rpcz_store.cc:276] 0925 01:50:01.203882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.204046 (+ 164us) service_pool.cc:224] Handling call
0925 01:50:10.557983 (+9353937us) ts_tablet_manager.cc:1151] Deleting tablet 716ad6cdf9864fc3b09d88753d45f45f
0925 01:50:10.557995 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.558121 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9353777}
I20260925 01:50:10.640991 11755 tablet_bootstrap.cc:492] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:10.641193 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 552) took 9437 ms. Trace:
I20260925 01:50:10.641261 11953 rpcz_store.cc:276] 0925 01:50:01.203997 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.204235 (+ 238us) service_pool.cc:224] Handling call
0925 01:50:10.641063 (+9436828us) ts_tablet_manager.cc:1151] Deleting tablet 252415635b5e4b3286948e91d421d6f1
0925 01:50:10.641072 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.641178 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9436706}
I20260925 01:50:10.641574 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 550) took 9437 ms. Trace:
I20260925 01:50:10.641636 11953 rpcz_store.cc:276] 0925 01:50:01.203801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.204380 (+ 579us) service_pool.cc:224] Handling call
0925 01:50:10.641478 (+9437098us) ts_tablet_manager.cc:1151] Deleting tablet 8036963ed28c4e0aae2c4a0bd8e9c99b
0925 01:50:10.641486 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.641557 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9436981}
I20260925 01:50:10.641913 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 549) took 9438 ms. Trace:
I20260925 01:50:10.642536 11755 tablet_bootstrap.cc:654] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.644973 13140 raft_consensus.cc:2804] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:10.645058 13140 raft_consensus.cc:493] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:10.645128 13140 raft_consensus.cc:3060] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.647915 13140 raft_consensus.cc:515] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:10.648783 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 716ad6cdf9864fc3b09d88753d45f45f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 716ad6cdf9864fc3b09d88753d45f45f already in progress: creating tablet
W20260925 01:50:10.649047 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 252415635b5e4b3286948e91d421d6f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 252415635b5e4b3286948e91d421d6f1 already in progress: creating tablet
W20260925 01:50:10.649253 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8036963ed28c4e0aae2c4a0bd8e9c99b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8036963ed28c4e0aae2c4a0bd8e9c99b already in progress: creating tablet
I20260925 01:50:10.651342 11379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226498ea628a475d8fcab28a6598a819" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:10.651970 11177 leader_election.cc:343] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.649955 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226498ea628a475d8fcab28a6598a819" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:10.652396 11516 raft_consensus.cc:3060] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:10.652931 13140 leader_election.cc:290] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.655246 13209 consensus_queue.cc:1048] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:10.659646 11516 raft_consensus.cc:2468] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:10.660444 11176 leader_election.cc:304] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:10.641973 11953 rpcz_store.cc:276] 0925 01:50:01.203670 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.204521 (+ 851us) service_pool.cc:224] Handling call
0925 01:50:10.641820 (+9437299us) ts_tablet_manager.cc:1151] Deleting tablet 1ea85f72e10443229f5f927bcaf31cb3
0925 01:50:10.641829 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.641901 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9437184}
I20260925 01:50:10.661239 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 553) took 9446 ms. Trace:
I20260925 01:50:10.661326 11953 rpcz_store.cc:276] 0925 01:50:01.214924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.214990 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:10.661092 (+9446102us) ts_tablet_manager.cc:1151] Deleting tablet 406d31139e1e441aa6fe204168486e28
0925 01:50:10.661103 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.661216 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9445866}
I20260925 01:50:10.661633 11953 tablet_replica.cc:333] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:10.661829 11953 raft_consensus.cc:2243] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.662034 11953 raft_consensus.cc:2272] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.662634 11953 ts_tablet_manager.cc:1916] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:10.665535 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1ea85f72e10443229f5f927bcaf31cb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ea85f72e10443229f5f927bcaf31cb3 already in progress: creating tablet
W20260925 01:50:10.665820 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 406d31139e1e441aa6fe204168486e28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 406d31139e1e441aa6fe204168486e28 already in progress: creating tablet
I20260925 01:50:10.666894 13209 raft_consensus.cc:2804] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:10.667064 13209 raft_consensus.cc:697] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:10.667347 13209 consensus_queue.cc:237] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.670130 11379 raft_consensus.cc:3060] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:10.673400 11177 consensus_peers.cc:597] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:10.673960 13306 raft_consensus.cc:493] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.674116 13306 raft_consensus.cc:515] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.674875 13306 leader_election.cc:290] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:10.675850 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f703869d4471cb940ef654203ec2b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:10.678027 13413 raft_consensus.cc:493] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.678189 13413 raft_consensus.cc:515] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:10.679878 11177 leader_election.cc:343] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.681416 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:10.566380 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet d3150980bb72435886486156aa98d342 with delete_type TABLET_DATA_DELETED (replaced by tablet 49692d2824a34f48a4dcefad8c89618b) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.573987 13271 raft_consensus.cc:493] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.682176 13271 raft_consensus.cc:515] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.682901 13271 leader_election.cc:290] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:10.577512 11314 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: c7944aa1ac8f4c5d8ea3aa2acae41257
I20260925 01:50:10.583882 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:10.639341 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "226498ea628a475d8fcab28a6598a819" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:10.684366 11314 leader_election.cc:304] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:10.684842 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 107340us
I20260925 01:50:10.685118 13321 raft_consensus.cc:2749] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.685770 11314 leader_election.cc:304] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:10.687727 11314 leader_election.cc:343] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a8c46e780d4a4987ad52619e4c3b46c9
W20260925 01:50:10.688401 11177 leader_election.cc:343] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.692886 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet 681356bc659f4ca990cd2ffc0c10b533 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:10.693678 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1308e456be4643dd8d055b56b014a0e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:10.694397 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1308e456be4643dd8d055b56b014a0e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.695935 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46004be36b543a395a783a13b1b14cf" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:10.696156 11953 ts_tablet_manager.cc:1929] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:10.696271 11953 log.cc:1199] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/4d9558462332400d92f7d61858bdeca2
I20260925 01:50:10.696646 11953 ts_tablet_manager.cc:1950] T 4d9558462332400d92f7d61858bdeca2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:10.696978 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 554) took 9478 ms. Trace:
I20260925 01:50:10.697055 11953 rpcz_store.cc:276] 0925 01:50:01.218252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.218333 (+ 81us) service_pool.cc:224] Handling call
0925 01:50:10.661587 (+9443254us) ts_tablet_manager.cc:1151] Deleting tablet 4d9558462332400d92f7d61858bdeca2
0925 01:50:10.661597 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.679793 (+ 18196us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.696091 (+ 16298us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.696963 (+ 872us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9443055}
I20260925 01:50:10.697602 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 4d9558462332400d92f7d61858bdeca2 (table default.Table_6bae170b0f624aaaad76789bdbf72e0d [id=a0a49bae7a7d45bd85e1f50591b3fd27]) successfully deleted
W20260925 01:50:10.697808 11314 leader_election.cc:343] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a8c46e780d4a4987ad52619e4c3b46c9
I20260925 01:50:10.697906 11314 leader_election.cc:304] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:10.698045 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fdc26312580742a8a01b897e551a3a3d has no consensus state
I20260925 01:50:10.698314 13271 raft_consensus.cc:2749] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.698457 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4b66e20f55e04eaf8ea162d732c1e929" } modify_external_catalogs: true
I20260925 01:50:10.698626 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4b66e20f55e04eaf8ea162d732c1e929" } modify_external_catalogs: true
I20260925 01:50:10.699674 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_167e60d2ec454ce38356ee349c14867b" } modify_external_catalogs: true
I20260925 01:50:10.699869 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_167e60d2ec454ce38356ee349c14867b" } modify_external_catalogs: true
I20260925 01:50:10.701613 13413 leader_election.cc:290] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:10.702373 11314 leader_election.cc:343] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 257e6f224f99427eb68fd61fa1aadae0
I20260925 01:50:10.702481 13271 raft_consensus.cc:493] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:10.702617 13271 raft_consensus.cc:515] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.703212 13271 leader_election.cc:290] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:10.703964 11314 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: d3150980bb72435886486156aa98d342
W20260925 01:50:10.715159 11457 leader_election.cc:343] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.716647 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ecfc5a2a80449c9905c83b6bcb3652" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:10.719244 11754 tablet_bootstrap.cc:654] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:10.725137 11457 leader_election.cc:343] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:10.729375 11314 leader_election.cc:343] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 257e6f224f99427eb68fd61fa1aadae0
I20260925 01:50:10.729787 11314 leader_election.cc:304] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.730317 13271 raft_consensus.cc:2749] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:10.730484 11314 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: d3150980bb72435886486156aa98d342
I20260925 01:50:10.730674 11314 leader_election.cc:304] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.730968 13271 raft_consensus.cc:2749] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.734820 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 555) took 9493 ms. Trace:
I20260925 01:50:10.734922 11953 rpcz_store.cc:276] 0925 01:50:01.241040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.241098 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:10.734679 (+9493581us) ts_tablet_manager.cc:1151] Deleting tablet 128be07ff230461ca7f998de7a02468f
0925 01:50:10.734693 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.734798 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9493380}
W20260925 01:50:10.735499 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 128be07ff230461ca7f998de7a02468f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 128be07ff230461ca7f998de7a02468f already in progress: creating tablet
W20260925 01:50:10.735831 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 376258us
I20260925 01:50:10.737138 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d398851fb194c61a0a3b2c60c7a5e8b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:10.739307 11754 tablet_bootstrap.cc:492] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:10.739464 11754 ts_tablet_manager.cc:1403] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.173s user 0.006s sys 0.002s
I20260925 01:50:10.740155 11754 raft_consensus.cc:359] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.740329 11754 raft_consensus.cc:385] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.740375 11754 raft_consensus.cc:740] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.740592 11754 consensus_queue.cc:260] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.741830 11754 ts_tablet_manager.cc:1434] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:10.741914 11755 tablet_bootstrap.cc:492] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:10.742038 11755 ts_tablet_manager.cc:1403] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.101s user 0.003s sys 0.003s
I20260925 01:50:10.742136 11754 tablet_bootstrap.cc:492] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:10.742697 11755 raft_consensus.cc:359] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:10.742884 11755 raft_consensus.cc:385] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.742957 11755 raft_consensus.cc:740] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.743161 11755 consensus_queue.cc:260] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:10.743793 11754 tablet_bootstrap.cc:654] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.743793 11755 ts_tablet_manager.cc:1434] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:10.744079 11755 tablet_bootstrap.cc:492] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:10.745586 11755 tablet_bootstrap.cc:654] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.746542 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f703869d4471cb940ef654203ec2b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:10.746863 11953 tablet_replica.cc:333] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:10.747080 11953 raft_consensus.cc:2243] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.747241 11953 raft_consensus.cc:2272] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.747812 11953 ts_tablet_manager.cc:1916] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:10.747967 11457 consensus_peers.cc:597] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:10.748065 11176 leader_election.cc:343] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.748250 11176 leader_election.cc:304] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:10.749207 13209 raft_consensus.cc:2749] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:10.752700 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 7809737ca3d24bfe8829f17d5e3215f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7809737ca3d24bfe8829f17d5e3215f5 already in progress: creating tablet
W20260925 01:50:10.758631 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 007ee8e3087c4a70b9c5d8436a31659f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007ee8e3087c4a70b9c5d8436a31659f already in progress: creating tablet
W20260925 01:50:10.759107 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 4cd34fa172904e51ade794892c580248 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd34fa172904e51ade794892c580248 already in progress: creating tablet
I20260925 01:50:10.759485 13356 ts_tablet_manager.cc:1929] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:50:10.759598 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 8b2eed649c6f447d8f9af98637061af1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2eed649c6f447d8f9af98637061af1 already in progress: creating tablet
I20260925 01:50:10.759677 13356 log.cc:1199] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/031687d4b26b4c7889dfbe3485c9f4c5
W20260925 01:50:10.760032 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet db1339652d744cda9215d84e846d1e8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db1339652d744cda9215d84e846d1e8e already in progress: creating tablet
I20260925 01:50:10.760360 13356 ts_tablet_manager.cc:1950] T 031687d4b26b4c7889dfbe3485c9f4c5 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:50:10.760560 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 86f3f75784af42f6b14b919815ab1890 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f3f75784af42f6b14b919815ab1890 already in progress: creating tablet
W20260925 01:50:10.760982 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f4533c3500a3431ca6ef5f23b0cf6830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4533c3500a3431ca6ef5f23b0cf6830 already in progress: creating tablet
W20260925 01:50:10.761955 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb9ce40cb55d4f90b3c333b55bc5fe18 already in progress: creating tablet
I20260925 01:50:10.761911 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 879) took 1236 ms. Trace:
I20260925 01:50:10.762092 13356 rpcz_store.cc:276] 0925 01:50:09.525485 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.525537 (+ 52us) service_pool.cc:224] Handling call
0925 01:50:10.563440 (+1037903us) ts_tablet_manager.cc:1151] Deleting tablet 031687d4b26b4c7889dfbe3485c9f4c5
0925 01:50:10.563466 (+ 26us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.676137 (+112671us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.759416 (+ 83279us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.761855 (+ 2439us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037739}
W20260925 01:50:10.762415 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 0258eac5971842878c62326952115490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0258eac5971842878c62326952115490 already in progress: creating tablet
I20260925 01:50:10.762789 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 031687d4b26b4c7889dfbe3485c9f4c5 (table default.Table_77d531160dc245eaaac97f131d587441 [id=32c8539cc67d46e2acfad4a1ad9ba69c]) successfully deleted
W20260925 01:50:10.763307 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3ac251aa75344cf8ac29dd30c893d84b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ac251aa75344cf8ac29dd30c893d84b already in progress: creating tablet
W20260925 01:50:10.763743 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f8ffc45058774a878d4b802400feecb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8ffc45058774a878d4b802400feecb7 already in progress: creating tablet
W20260925 01:50:10.764129 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 532e290a0db34fbfab0328ca8f8d1e6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532e290a0db34fbfab0328ca8f8d1e6c already in progress: creating tablet
W20260925 01:50:10.764547 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b306496f992f45a9b64b05b73712cb5b because the tablet was not found. No further retry: Not found: Tablet not found: b306496f992f45a9b64b05b73712cb5b
W20260925 01:50:10.764911 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 04f412cbebe04a629070aecf2753287c because the tablet was not found. No further retry: Not found: Tablet not found: 04f412cbebe04a629070aecf2753287c
W20260925 01:50:10.765292 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 15376374d9f2401fb9bb83d2f0acf7b3 because the tablet was not found. No further retry: Not found: Tablet not found: 15376374d9f2401fb9bb83d2f0acf7b3
I20260925 01:50:10.766105 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 880) took 1236 ms. Trace:
W20260925 01:50:10.778473 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0a50af9614341d49c4c690e2ec785b0 consensus state has no leader
W20260925 01:50:10.779366 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3ea82e4cc98406baafd95867fddc689 consensus state has no leader
I20260925 01:50:10.779557 11675 master_service.cc:960] ReplaceTablet: received request to replace tablet 61c1181b38a247e79bd7a6355950881e from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:10.782686 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ce8d023311b4a91adfebd6c5fedf1bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.783053 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a4219ce09e54d268c55c19f7b5cbc7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.783016 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d9ec82d6876c42f4ba2646cb90d5c35b" } modify_external_catalogs: true
I20260925 01:50:10.783245 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d9ec82d6876c42f4ba2646cb90d5c35b" } modify_external_catalogs: true
I20260925 01:50:10.783414 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 226498ea628a475d8fcab28a6598a819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.783646 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b123ac1e894239875404438ed19927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.784015 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.784175 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_75a4b6a0e201453282a955e6b54ae4c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:10.784546 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet f2618c46630c4295949b36f3d0087941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:10.784837 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75a4b6a0e201453282a955e6b54ae4c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:10.784971 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.786947 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c93bb7a34f94deaa65f8b588c604b81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.787324 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f4f4ecc9e22d4728b850f0f8bd4170bd" } modify_external_catalogs: true
I20260925 01:50:10.787523 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f4f4ecc9e22d4728b850f0f8bd4170bd" } modify_external_catalogs: true
I20260925 01:50:10.787599 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet fe3627bfb342448591ccaf3d7ab23c4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.788144 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_27561da3e76c4d8286ab6090d93c7684" } new_table_name: "default.Table_65647f9f867a4696989ec9d5b568578c" modify_external_catalogs: true
I20260925 01:50:10.788420 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet f46004be36b543a395a783a13b1b14cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.788790 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:10.789862 13356 rpcz_store.cc:276] 0925 01:50:09.526140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.526187 (+ 47us) service_pool.cc:224] Handling call
0925 01:50:10.762715 (+1236528us) ts_tablet_manager.cc:1151] Deleting tablet 04f412cbebe04a629070aecf2753287c
0925 01:50:10.762728 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.762864 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1236351}
I20260925 01:50:10.794294 13356 tablet_replica.cc:333] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:10.794517 13356 raft_consensus.cc:2243] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:50:10.794824 11665 catalog_manager.cc:5030] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 04f412cbebe04a629070aecf2753287c because the tablet was not found. No further retry: Not found: Tablet not found: 04f412cbebe04a629070aecf2753287c
I20260925 01:50:10.795135 13356 raft_consensus.cc:2272] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:10.795477 11456 leader_election.cc:343] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:10.795662 11456 leader_election.cc:304] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.796588 13411 raft_consensus.cc:2749] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.799569 11755 tablet_bootstrap.cc:492] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:10.799779 11755 ts_tablet_manager.cc:1403] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.001s
I20260925 01:50:10.800524 11755 raft_consensus.cc:359] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:10.800772 11755 raft_consensus.cc:385] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.800861 11755 raft_consensus.cc:740] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.801153 11755 consensus_queue.cc:260] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:10.801805 11755 ts_tablet_manager.cc:1434] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260925 01:50:10.802282 13422 log.cc:927] Time spent T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260925 01:50:10.802302 11755 tablet_bootstrap.cc:492] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:10.805245 11755 tablet_bootstrap.cc:654] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.810385 13356 ts_tablet_manager.cc:1916] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:10.802995 11456 leader_election.cc:343] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: f46004be36b543a395a783a13b1b14cf
I20260925 01:50:10.820729 11456 leader_election.cc:304] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.822551 13411 raft_consensus.cc:2749] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:10.823022 11456 leader_election.cc:343] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 31ecfc5a2a80449c9905c83b6bcb3652
I20260925 01:50:10.823292 11456 leader_election.cc:304] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:10.803802 11753 tablet_bootstrap.cc:492] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:10.823670 11753 ts_tablet_manager.cc:1403] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.285s user 0.000s sys 0.010s
I20260925 01:50:10.824288 13411 raft_consensus.cc:2749] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.828142 11946 ts_tablet_manager.cc:1929] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:10.828372 11946 log.cc:1199] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/31353cc95e014e5bb24e5e5cefab1503
I20260925 01:50:10.828927 11946 ts_tablet_manager.cc:1950] T 31353cc95e014e5bb24e5e5cefab1503 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:10.829957 11953 ts_tablet_manager.cc:1929] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:50:10.830127 11946 tablet_replica.cc:333] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:10.830715 13321 raft_consensus.cc:2749] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:10.842322 11946 raft_consensus.cc:2243] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.842667 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 97f0a0e188ef4e339bcab1a512dd205e (DEFAULT_TABLE table=default.Table_49984bc62b4646cb8f8c53adc9412bdf [id=ef27defbbd774f09bf5c7a04a253bdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.843108 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f0a0e188ef4e339bcab1a512dd205e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.843201 11946 raft_consensus.cc:2272] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.828277 11753 raft_consensus.cc:359] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.843406 11753 raft_consensus.cc:385] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.843473 11753 raft_consensus.cc:740] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.843695 11753 consensus_queue.cc:260] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.853536 11679 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e87128b8baef4f9d80341f6980da519d (table default.Table_7bf2059d1939417f9dc9b05d8a716c76 [id=03d3184bbc30406db8afae3e9f64fb9b]). Expected version 1 got 0
I20260925 01:50:10.854892 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 97f0a0e188ef4e339bcab1a512dd205e (DEFAULT_TABLE table=default.Table_49984bc62b4646cb8f8c53adc9412bdf [id=ef27defbbd774f09bf5c7a04a253bdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.855365 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f0a0e188ef4e339bcab1a512dd205e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.855867 11753 ts_tablet_manager.cc:1434] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.032s user 0.000s sys 0.001s
I20260925 01:50:10.856172 11753 tablet_bootstrap.cc:492] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:10.857898 11753 tablet_bootstrap.cc:654] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.858855 11946 ts_tablet_manager.cc:1916] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.859380 11351 tablet_service.cc:1511] Processing CreateTablet for tablet be38d1779e5e4593b797464631ac5cb9 (DEFAULT_TABLE table=default.Table_3943c5408eb1475a9c0002764673e7d5 [id=e9704dc1abeb4f37bffb3b0400c3e2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.859686 11222 tablet_service.cc:1511] Processing CreateTablet for tablet b6c4f3e2f5644cdc91787771f955f628 (DEFAULT_TABLE table=default.Table_784ed698c2d64964b9efd4080f8fbe18 [id=f38780a9518a43648519a8f2e3a08f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.859782 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be38d1779e5e4593b797464631ac5cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.860046 11222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c4f3e2f5644cdc91787771f955f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.862313 11357 tablet_service.cc:1511] Processing CreateTablet for tablet cf01b7f0ae6044988f543e1c4a50849d (DEFAULT_TABLE table=default.Table_14ac769c63984e88b1fb5a08c19d5d39 [id=c0ff3cc1e8c54c159bdcff1b1b44be29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.862758 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf01b7f0ae6044988f543e1c4a50849d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.863078 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 05ef4ec2a4384aaa91a6bbda83539ea1 (DEFAULT_TABLE table=default.Table_eb347b6d475d48829c094b8bcaab1d0a [id=3f1651e8395b4ccd9628d3b1c8f3c955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.863410 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ef4ec2a4384aaa91a6bbda83539ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.864380 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 1856ea28c95e49e58e14e92e09a0dc68 (DEFAULT_TABLE table=default.Table_39d57388d36740d1abd89e157d92e8fe [id=765ce14052114e9fa680496846db20f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.864725 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1856ea28c95e49e58e14e92e09a0dc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.866317 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5effdb61bc4efa8f2abfab43ff462a (DEFAULT_TABLE table=default.Table_32ffd9c49fcc43288481ca97dcb07498 [id=a8c32a42fe1641619d4f9a45062bf488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.866371 11206 tablet_service.cc:1511] Processing CreateTablet for tablet be38d1779e5e4593b797464631ac5cb9 (DEFAULT_TABLE table=default.Table_3943c5408eb1475a9c0002764673e7d5 [id=e9704dc1abeb4f37bffb3b0400c3e2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.866637 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5effdb61bc4efa8f2abfab43ff462a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.866907 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 313ef1a795454be38e6ab617c3b21bf5 (DEFAULT_TABLE table=default.Table_f064ea2300ec4c6e809d8b54a18da7c0 [id=4e2919d356144220b57af0d6eb90aa13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.867211 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313ef1a795454be38e6ab617c3b21bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.870357 11205 tablet_service.cc:1511] Processing CreateTablet for tablet cf01b7f0ae6044988f543e1c4a50849d (DEFAULT_TABLE table=default.Table_14ac769c63984e88b1fb5a08c19d5d39 [id=c0ff3cc1e8c54c159bdcff1b1b44be29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.870697 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf01b7f0ae6044988f543e1c4a50849d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.871861 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_20ebf4c7095a4388acf30cfc1ee53c59" } modify_external_catalogs: true
I20260925 01:50:10.872202 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_20ebf4c7095a4388acf30cfc1ee53c59" } modify_external_catalogs: true
I20260925 01:50:10.874315 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 9c10a3505f844d8b87a54016d34a1936 (DEFAULT_TABLE table=default.Table_5f1e5d42855448c08d9ced53187ae23d [id=f40564efe0ba4415bf19a8c6ccfe8a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.874624 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c10a3505f844d8b87a54016d34a1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.878304 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 313ef1a795454be38e6ab617c3b21bf5 (DEFAULT_TABLE table=default.Table_f064ea2300ec4c6e809d8b54a18da7c0 [id=4e2919d356144220b57af0d6eb90aa13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.878636 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313ef1a795454be38e6ab617c3b21bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.883713 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 9c10a3505f844d8b87a54016d34a1936 (DEFAULT_TABLE table=default.Table_5f1e5d42855448c08d9ced53187ae23d [id=f40564efe0ba4415bf19a8c6ccfe8a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.884142 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c10a3505f844d8b87a54016d34a1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.884589 11946 ts_tablet_manager.cc:1929] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:10.884707 11946 log.cc:1199] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/818a792969a245f5b0fe5f80128206ba
I20260925 01:50:10.885046 11946 ts_tablet_manager.cc:1950] T 818a792969a245f5b0fe5f80128206ba P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:10.830840 13424 tablet.cc:1751] T e87128b8baef4f9d80341f6980da519d P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:10.870365 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 89436557ea8a46158b4c36d69f15bf18 (DEFAULT_TABLE table=default.Table_90cf539e13ed491d84f83dec75e44460 [id=e79c03e66bd04b8e91e4efe8f736126c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.886658 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89436557ea8a46158b4c36d69f15bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.890211 11953 log.cc:1199] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/7496a9eaa1714e9fa83d8c88bf1070fd
I20260925 01:50:10.890618 11953 ts_tablet_manager.cc:1950] T 7496a9eaa1714e9fa83d8c88bf1070fd P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:10.890934 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 558) took 9553 ms. Trace:
I20260925 01:50:10.890988 11946 tablet_replica.cc:333] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:10.891021 11953 rpcz_store.cc:276] 0925 01:50:01.337408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.337470 (+ 62us) service_pool.cc:224] Handling call
0925 01:50:10.746371 (+9408901us) ts_tablet_manager.cc:1151] Deleting tablet 7496a9eaa1714e9fa83d8c88bf1070fd
0925 01:50:10.746381 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.757561 (+ 11180us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.829895 (+ 72334us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:10.890918 (+ 61023us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9408703}
I20260925 01:50:10.891392 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 585) took 9153 ms. Trace:
I20260925 01:50:10.891456 11953 rpcz_store.cc:276] 0925 01:50:01.738270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.738449 (+ 179us) service_pool.cc:224] Handling call
0925 01:50:10.891281 (+9152832us) ts_tablet_manager.cc:1151] Deleting tablet bc99f3613c354d68bfde33e04dc1e9ab
0925 01:50:10.891290 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.891379 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9152475}
I20260925 01:50:10.892200 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be38d1779e5e4593b797464631ac5cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.893282 11488 tablet_service.cc:1511] Processing CreateTablet for tablet be38d1779e5e4593b797464631ac5cb9 (DEFAULT_TABLE table=default.Table_3943c5408eb1475a9c0002764673e7d5 [id=e9704dc1abeb4f37bffb3b0400c3e2ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.893620 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5effdb61bc4efa8f2abfab43ff462a (DEFAULT_TABLE table=default.Table_32ffd9c49fcc43288481ca97dcb07498 [id=a8c32a42fe1641619d4f9a45062bf488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.893746 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be38d1779e5e4593b797464631ac5cb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.893935 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5effdb61bc4efa8f2abfab43ff462a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.898324 11496 tablet_service.cc:1511] Processing CreateTablet for tablet b6c4f3e2f5644cdc91787771f955f628 (DEFAULT_TABLE table=default.Table_784ed698c2d64964b9efd4080f8fbe18 [id=f38780a9518a43648519a8f2e3a08f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.898686 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c4f3e2f5644cdc91787771f955f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.906595 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 31353cc95e014e5bb24e5e5cefab1503 (table default.Table_04ba88f4ea89466a9be2799b103547fd [id=7d196ee9e42a41968e3013907ed4911a]) successfully deleted
I20260925 01:50:10.907049 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 818a792969a245f5b0fe5f80128206ba (table default.Table_b2202b3e9b174d9a9bff1f005144d412 [id=3a0322c7d2bf4cc89a0e09ac46a62440]) successfully deleted
I20260925 01:50:10.908318 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 7496a9eaa1714e9fa83d8c88bf1070fd (table default.Table_f181f1f48a334b48aeda73e37c8c7a61 [id=861f838981bc470e9d593a7733c4526f]) successfully deleted
W20260925 01:50:10.908717 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bc99f3613c354d68bfde33e04dc1e9ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc99f3613c354d68bfde33e04dc1e9ab already in progress: creating tablet
I20260925 01:50:10.909485 11353 tablet_service.cc:1511] Processing CreateTablet for tablet b6c4f3e2f5644cdc91787771f955f628 (DEFAULT_TABLE table=default.Table_784ed698c2d64964b9efd4080f8fbe18 [id=f38780a9518a43648519a8f2e3a08f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.909935 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c4f3e2f5644cdc91787771f955f628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.910604 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 79f0d3698e414cc0b8de1c3f4c45a9a2 (DEFAULT_TABLE table=default.Table_0dcdec389a2446e7afd96a57a8c91c51 [id=e00d2438a6574bc2978a2c998a359201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.910959 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f0d3698e414cc0b8de1c3f4c45a9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.913959 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 05ef4ec2a4384aaa91a6bbda83539ea1 (DEFAULT_TABLE table=default.Table_eb347b6d475d48829c094b8bcaab1d0a [id=3f1651e8395b4ccd9628d3b1c8f3c955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.914110 11953 tablet_replica.cc:333] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:10.914337 11953 raft_consensus.cc:2243] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.914376 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ef4ec2a4384aaa91a6bbda83539ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.914597 11953 raft_consensus.cc:2272] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.915143 11953 ts_tablet_manager.cc:1916] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.918392 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5effdb61bc4efa8f2abfab43ff462a (DEFAULT_TABLE table=default.Table_32ffd9c49fcc43288481ca97dcb07498 [id=a8c32a42fe1641619d4f9a45062bf488]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.918778 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5effdb61bc4efa8f2abfab43ff462a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.919119 11753 tablet_bootstrap.cc:492] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:10.919286 11753 ts_tablet_manager.cc:1403] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.063s user 0.000s sys 0.005s
I20260925 01:50:10.920344 11753 raft_consensus.cc:359] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.920569 11753 raft_consensus.cc:385] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.920763 11753 raft_consensus.cc:740] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
W20260925 01:50:10.920857 11456 consensus_peers.cc:597] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 031687d4b26b4c7889dfbe3485c9f4c5. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:10.920964 11753 consensus_queue.cc:260] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.921566 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 89436557ea8a46158b4c36d69f15bf18 (DEFAULT_TABLE table=default.Table_90cf539e13ed491d84f83dec75e44460 [id=e79c03e66bd04b8e91e4efe8f736126c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.921933 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89436557ea8a46158b4c36d69f15bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.922322 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 89436557ea8a46158b4c36d69f15bf18 (DEFAULT_TABLE table=default.Table_90cf539e13ed491d84f83dec75e44460 [id=e79c03e66bd04b8e91e4efe8f736126c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.922653 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89436557ea8a46158b4c36d69f15bf18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.925383 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 1856ea28c95e49e58e14e92e09a0dc68 (DEFAULT_TABLE table=default.Table_39d57388d36740d1abd89e157d92e8fe [id=765ce14052114e9fa680496846db20f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.925724 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1856ea28c95e49e58e14e92e09a0dc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.926301 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 05ef4ec2a4384aaa91a6bbda83539ea1 (DEFAULT_TABLE table=default.Table_eb347b6d475d48829c094b8bcaab1d0a [id=3f1651e8395b4ccd9628d3b1c8f3c955]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.926352 11946 raft_consensus.cc:2243] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:10.926649 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05ef4ec2a4384aaa91a6bbda83539ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.930385 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 1856ea28c95e49e58e14e92e09a0dc68 (DEFAULT_TABLE table=default.Table_39d57388d36740d1abd89e157d92e8fe [id=765ce14052114e9fa680496846db20f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.930752 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1856ea28c95e49e58e14e92e09a0dc68. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.934352 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 114249us
I20260925 01:50:10.935853 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 97f0a0e188ef4e339bcab1a512dd205e (DEFAULT_TABLE table=default.Table_49984bc62b4646cb8f8c53adc9412bdf [id=ef27defbbd774f09bf5c7a04a253bdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.936357 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f0a0e188ef4e339bcab1a512dd205e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.939036 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 313ef1a795454be38e6ab617c3b21bf5 (DEFAULT_TABLE table=default.Table_f064ea2300ec4c6e809d8b54a18da7c0 [id=4e2919d356144220b57af0d6eb90aa13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.939388 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313ef1a795454be38e6ab617c3b21bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.940064 11753 ts_tablet_manager.cc:1434] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.021s user 0.000s sys 0.003s
I20260925 01:50:10.940440 11753 tablet_bootstrap.cc:492] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:10.942734 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 9c10a3505f844d8b87a54016d34a1936 (DEFAULT_TABLE table=default.Table_5f1e5d42855448c08d9ced53187ae23d [id=f40564efe0ba4415bf19a8c6ccfe8a84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.942981 11753 tablet_bootstrap.cc:654] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.943078 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c10a3505f844d8b87a54016d34a1936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.943111 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 79f0d3698e414cc0b8de1c3f4c45a9a2 (DEFAULT_TABLE table=default.Table_0dcdec389a2446e7afd96a57a8c91c51 [id=e00d2438a6574bc2978a2c998a359201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.943789 11946 pending_rounds.cc:70] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Trying to abort 1 pending ops.
I20260925 01:50:10.943850 11946 pending_rounds.cc:77] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072934892175360 op_type: NO_OP noop_request { }
I20260925 01:50:10.943956 11946 raft_consensus.cc:2889] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:10.944042 11946 raft_consensus.cc:2272] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.944691 11946 ts_tablet_manager.cc:1916] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.945351 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 5cf1fcb3bd7748ecb271dc4362b03f43 (DEFAULT_TABLE table=default.Table_bf8a59135b91441a9e6e1789d2f701e1 [id=a6e75d99f2f04b8ba3f56bc86af573ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.945731 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cf1fcb3bd7748ecb271dc4362b03f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:10.953281 11494 tablet_service.cc:1511] Processing CreateTablet for tablet cf01b7f0ae6044988f543e1c4a50849d (DEFAULT_TABLE table=default.Table_14ac769c63984e88b1fb5a08c19d5d39 [id=c0ff3cc1e8c54c159bdcff1b1b44be29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.953692 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf01b7f0ae6044988f543e1c4a50849d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:10.960484 11177 consensus_peers.cc:597] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:10.979439 11946 ts_tablet_manager.cc:1929] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:10.979595 11946 log.cc:1199] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/031687d4b26b4c7889dfbe3485c9f4c5
I20260925 01:50:10.980702 11753 tablet_bootstrap.cc:492] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:10.982350 11753 ts_tablet_manager.cc:1403] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.005s
I20260925 01:50:10.982507 11946 ts_tablet_manager.cc:1950] T 031687d4b26b4c7889dfbe3485c9f4c5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:10.983422 11753 raft_consensus.cc:359] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.983778 11753 raft_consensus.cc:385] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:10.983899 11753 raft_consensus.cc:740] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:10.984238 11753 consensus_queue.cc:260] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:10.984839 11753 ts_tablet_manager.cc:1434] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:10.985042 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 79f0d3698e414cc0b8de1c3f4c45a9a2 (DEFAULT_TABLE table=default.Table_0dcdec389a2446e7afd96a57a8c91c51 [id=e00d2438a6574bc2978a2c998a359201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.987831 11753 tablet_bootstrap.cc:492] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:10.988022 11946 tablet_replica.cc:333] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:10.988374 11946 raft_consensus.cc:2243] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:10.988572 11946 raft_consensus.cc:2272] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:10.989369 11946 ts_tablet_manager.cc:1916] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:10.990049 11753 tablet_bootstrap.cc:654] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:10.996431 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 5cf1fcb3bd7748ecb271dc4362b03f43 (DEFAULT_TABLE table=default.Table_bf8a59135b91441a9e6e1789d2f701e1 [id=a6e75d99f2f04b8ba3f56bc86af573ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:10.996819 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cf1fcb3bd7748ecb271dc4362b03f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.000535 11350 tablet_service.cc:1511] Processing CreateTablet for tablet f066d2f3f4504e08be7a8783a6fd7abd (DEFAULT_TABLE table=default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24 [id=439f4724e13d458990e43b8a126c19c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.000962 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f066d2f3f4504e08be7a8783a6fd7abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.004374 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 2147c104b494441988b7e3b39a1c457b (DEFAULT_TABLE table=default.Table_5f04dbdc3964422c9966d0a6449ba013 [id=b342885b488d4096b6a1d0da2951b84f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.004863 11358 tablet_service.cc:1511] Processing CreateTablet for tablet df3c8c794bc04779be0cc46ae32c672b (DEFAULT_TABLE table=default.Table_daf438c7a77a412ca5f78a435ae94073 [id=3bce789731dc414dafc637003771503f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.005264 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f0d3698e414cc0b8de1c3f4c45a9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.005846 11753 tablet_bootstrap.cc:492] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.005975 11753 ts_tablet_manager.cc:1403] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.002s
I20260925 01:50:11.006875 11753 raft_consensus.cc:359] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.007037 11753 raft_consensus.cc:385] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.007081 11753 raft_consensus.cc:740] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.010447 13411 raft_consensus.cc:493] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.010560 13411 raft_consensus.cc:515] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.011124 13411 leader_election.cc:290] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.011631 11753 consensus_queue.cc:260] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.012375 11753 ts_tablet_manager.cc:1434] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:50:11.012748 11753 tablet_bootstrap.cc:492] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.015805 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 2147c104b494441988b7e3b39a1c457b (DEFAULT_TABLE table=default.Table_5f04dbdc3964422c9966d0a6449ba013 [id=b342885b488d4096b6a1d0da2951b84f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.016057 11220 tablet_service.cc:1511] Processing CreateTablet for tablet df3c8c794bc04779be0cc46ae32c672b (DEFAULT_TABLE table=default.Table_daf438c7a77a412ca5f78a435ae94073 [id=3bce789731dc414dafc637003771503f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.016204 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2147c104b494441988b7e3b39a1c457b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.016376 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3c8c794bc04779be0cc46ae32c672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.017585 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:11.018441 11953 ts_tablet_manager.cc:1929] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:11.018560 11953 log.cc:1199] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/45a794ad0d87475a88efc02f5ae080f4
I20260925 01:50:11.019307 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2147c104b494441988b7e3b39a1c457b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.019565 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3c8c794bc04779be0cc46ae32c672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.024498 11753 tablet_bootstrap.cc:654] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.032872 11208 tablet_service.cc:1511] Processing CreateTablet for tablet f066d2f3f4504e08be7a8783a6fd7abd (DEFAULT_TABLE table=default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24 [id=439f4724e13d458990e43b8a126c19c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.033350 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f066d2f3f4504e08be7a8783a6fd7abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.024820 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 5cf1fcb3bd7748ecb271dc4362b03f43 (DEFAULT_TABLE table=default.Table_bf8a59135b91441a9e6e1789d2f701e1 [id=a6e75d99f2f04b8ba3f56bc86af573ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.034538 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cf1fcb3bd7748ecb271dc4362b03f43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:11.025411 11456 leader_election.cc:343] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: fce91b00d3a14e6398abacad61ff5b0f
W20260925 01:50:11.035707 11666 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet fdc26312580742a8a01b897e551a3a3d (table default.Table_7b590678fd634ad89ee5d6acec384f3b [id=9d54b28f524e4b83a5309b69bc4e0b96], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fdc26312580742a8a01b897e551a3a3d has no consensus state
I20260925 01:50:11.025465 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 2147c104b494441988b7e3b39a1c457b (DEFAULT_TABLE table=default.Table_5f04dbdc3964422c9966d0a6449ba013 [id=b342885b488d4096b6a1d0da2951b84f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.036648 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 031687d4b26b4c7889dfbe3485c9f4c5 (table default.Table_77d531160dc245eaaac97f131d587441 [id=32c8539cc67d46e2acfad4a1ad9ba69c]) successfully deleted
I20260925 01:50:11.046486 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2147c104b494441988b7e3b39a1c457b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.046928 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f0d3698e414cc0b8de1c3f4c45a9a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.048692 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 4 got 0
I20260925 01:50:11.053455 11673 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:11.055119 11379 raft_consensus.cc:3060] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.058542 11953 ts_tablet_manager.cc:1950] T 45a794ad0d87475a88efc02f5ae080f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:11.058657 11496 tablet_service.cc:1511] Processing CreateTablet for tablet f066d2f3f4504e08be7a8783a6fd7abd (DEFAULT_TABLE table=default.Table_ffe4a46fafe34a96a6fb8a544a7d3f24 [id=439f4724e13d458990e43b8a126c19c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.058956 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 587) took 9161 ms. Trace:
I20260925 01:50:11.059073 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f066d2f3f4504e08be7a8783a6fd7abd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.059034 11953 rpcz_store.cc:276] 0925 01:50:01.897772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.897860 (+ 88us) service_pool.cc:224] Handling call
0925 01:50:10.891790 (+8993930us) ts_tablet_manager.cc:1151] Deleting tablet 45a794ad0d87475a88efc02f5ae080f4
0925 01:50:10.892138 (+ 348us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.002381 (+110243us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.018390 (+ 16009us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.058936 (+ 40546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280,"tablet-delete.queue_time_us":8907950}
I20260925 01:50:11.059345 11953 tablet_replica.cc:333] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:11.059552 11953 raft_consensus.cc:2243] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:11.059906 11953 raft_consensus.cc:2272] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:11.063344 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 45a794ad0d87475a88efc02f5ae080f4 (table default.Table_bc79315e26e64754b7ae9ce08ba0a88d [id=b96d7b3ebf9544a0867e0ab08c072648]) successfully deleted
I20260925 01:50:11.067086 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3806a06d304f0c89e0d33bea01bcf1 (DEFAULT_TABLE table=default.Table_441daf5de69a4e4383e56a428e920f4d [id=d5ed9530925e4f438327ddc543c2d7f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.067569 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3806a06d304f0c89e0d33bea01bcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.070695 11953 ts_tablet_manager.cc:1916] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:11.077565 11753 tablet_bootstrap.cc:492] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.077807 11753 ts_tablet_manager.cc:1403] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.004s
I20260925 01:50:11.078661 11753 raft_consensus.cc:359] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.078922 11753 raft_consensus.cc:385] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.079005 11753 raft_consensus.cc:740] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.079245 11753 consensus_queue.cc:260] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.079813 11753 ts_tablet_manager.cc:1434] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:11.080154 11753 tablet_bootstrap.cc:492] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.086197 13420 raft_consensus.cc:493] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.086409 13420 raft_consensus.cc:515] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:11.086864 11753 tablet_bootstrap.cc:654] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.087218 13420 leader_election.cc:290] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.088018 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:11.088732 11177 leader_election.cc:343] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.092236 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:11.092473 11516 raft_consensus.cc:2468] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:11.092983 11176 leader_election.cc:304] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:11.093442 13420 raft_consensus.cc:2804] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:11.093559 13420 raft_consensus.cc:493] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:11.093657 13420 raft_consensus.cc:3060] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.095319 11753 tablet_bootstrap.cc:492] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.095968 11753 ts_tablet_manager.cc:1403] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260925 01:50:11.096709 13420 raft_consensus.cc:515] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:11.097512 11946 ts_tablet_manager.cc:1929] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:11.097951 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:11.098605 11177 leader_election.cc:343] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.098803 13420 leader_election.cc:290] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.099972 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:11.100225 11516 raft_consensus.cc:3060] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.103010 11516 raft_consensus.cc:2468] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:11.099967 11946 log.cc:1199] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/406d31139e1e441aa6fe204168486e28
I20260925 01:50:11.098167 11753 raft_consensus.cc:359] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.103601 11753 raft_consensus.cc:385] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.103706 11753 raft_consensus.cc:740] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.103809 11946 ts_tablet_manager.cc:1950] T 406d31139e1e441aa6fe204168486e28 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:11.104090 11753 consensus_queue.cc:260] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.105800 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 892) took 1055 ms. Trace:
I20260925 01:50:11.106359 11176 leader_election.cc:304] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:11.106935 13420 raft_consensus.cc:2804] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:11.107227 13420 raft_consensus.cc:697] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:11.107497 11946 rpcz_store.cc:276] 0925 01:50:10.050724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.223895 (+173171us) service_pool.cc:224] Handling call
0925 01:50:10.987978 (+764083us) ts_tablet_manager.cc:1151] Deleting tablet 406d31139e1e441aa6fe204168486e28
0925 01:50:10.987986 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.009099 (+ 21113us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.097453 (+ 88354us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.105784 (+ 8331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":763898}
I20260925 01:50:11.107606 13420 consensus_queue.cc:237] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:11.107957 11946 tablet_replica.cc:333] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:11.108207 11946 raft_consensus.cc:2243] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:11.108583 11946 raft_consensus.cc:2272] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:11.110653 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3806a06d304f0c89e0d33bea01bcf1 (DEFAULT_TABLE table=default.Table_441daf5de69a4e4383e56a428e920f4d [id=d5ed9530925e4f438327ddc543c2d7f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.111088 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3806a06d304f0c89e0d33bea01bcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.111362 11358 tablet_service.cc:1511] Processing CreateTablet for tablet c7c8c031185c4f61ad77d7e59e4b3d37 (DEFAULT_TABLE table=default.Table_20874b6d35274058ba18b6a7b09c2162 [id=026f469968a448c0bcef500d0b2387b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.111804 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c8c031185c4f61ad77d7e59e4b3d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.111856 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 406d31139e1e441aa6fe204168486e28 (table default.Table_5f4b4ce122da40e4b0960e58bf811412 [id=ffb823f8ca1948faaf21d345a1643605]) successfully deleted
I20260925 01:50:11.111892 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.112243 11207 tablet_service.cc:1511] Processing CreateTablet for tablet c7c8c031185c4f61ad77d7e59e4b3d37 (DEFAULT_TABLE table=default.Table_20874b6d35274058ba18b6a7b09c2162 [id=026f469968a448c0bcef500d0b2387b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.112368 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c01195f07b84b359a974fab5ed52582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.112658 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet fce91b00d3a14e6398abacad61ff5b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.112708 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c8c031185c4f61ad77d7e59e4b3d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.118410 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 8f3806a06d304f0c89e0d33bea01bcf1 (DEFAULT_TABLE table=default.Table_441daf5de69a4e4383e56a428e920f4d [id=d5ed9530925e4f438327ddc543c2d7f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.118909 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f3806a06d304f0c89e0d33bea01bcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.119503 11501 tablet_service.cc:1511] Processing CreateTablet for tablet df3c8c794bc04779be0cc46ae32c672b (DEFAULT_TABLE table=default.Table_daf438c7a77a412ca5f78a435ae94073 [id=3bce789731dc414dafc637003771503f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.119930 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3c8c794bc04779be0cc46ae32c672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.132369 13424 tablet.cc:1751] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:11.106024 11753 ts_tablet_manager.cc:1434] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:50:11.134290 11753 tablet_bootstrap.cc:492] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.135730 11946 ts_tablet_manager.cc:1916] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:11.149796 11494 tablet_service.cc:1511] Processing CreateTablet for tablet c7c8c031185c4f61ad77d7e59e4b3d37 (DEFAULT_TABLE table=default.Table_20874b6d35274058ba18b6a7b09c2162 [id=026f469968a448c0bcef500d0b2387b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.150035 11205 tablet_service.cc:1511] Processing CreateTablet for tablet e00723f0948c4d08adf91023493270a7 (DEFAULT_TABLE table=default.Table_3a7f4d008b0b4253899b059ded73a06e [id=ec350526606548c29e8f06a756f8ea9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.150429 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c8c031185c4f61ad77d7e59e4b3d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.150612 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e00723f0948c4d08adf91023493270a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.158737 11953 ts_tablet_manager.cc:1929] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:11.158921 11953 log.cc:1199] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ba378e9d37c64a8ebd56894b2101ed8f
I20260925 01:50:11.159312 11953 ts_tablet_manager.cc:1950] T ba378e9d37c64a8ebd56894b2101ed8f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:11.159663 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 586) took 9320 ms. Trace:
I20260925 01:50:11.160043 13412 raft_consensus.cc:493] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.160167 13412 raft_consensus.cc:515] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.161013 13412 leader_election.cc:290] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.161463 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f703869d4471cb940ef654203ec2b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:11.161653 11238 raft_consensus.cc:2468] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:11.165347 11456 leader_election.cc:304] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:11.165612 13412 raft_consensus.cc:2804] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:11.165715 13412 raft_consensus.cc:493] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:11.165793 13412 raft_consensus.cc:3060] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.168936 13412 raft_consensus.cc:515] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.169946 13412 leader_election.cc:290] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.171363 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f703869d4471cb940ef654203ec2b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:11.171531 11238 raft_consensus.cc:3060] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.159781 11953 rpcz_store.cc:276] 0925 01:50:01.839358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:01.847841 (+ 8483us) service_pool.cc:224] Handling call
0925 01:50:11.059301 (+9211460us) ts_tablet_manager.cc:1151] Deleting tablet ba378e9d37c64a8ebd56894b2101ed8f
0925 01:50:11.059309 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.073973 (+ 14664us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.158673 (+ 84700us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.159647 (+ 974us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20,"tablet-delete.queue_time_us":9075484}
I20260925 01:50:11.174374 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 602) took 9060 ms. Trace:
I20260925 01:50:11.174484 11953 rpcz_store.cc:276] 0925 01:50:02.113572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.114521 (+ 949us) service_pool.cc:224] Handling call
0925 01:50:11.174249 (+9059728us) ts_tablet_manager.cc:1151] Deleting tablet ab8d5af739854f939ab585d943e7b7ca
0925 01:50:11.174258 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.174356 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9059462}
I20260925 01:50:11.174638 11238 raft_consensus.cc:2468] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:11.175076 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 601) took 9061 ms. Trace:
I20260925 01:50:11.175159 11953 rpcz_store.cc:276] 0925 01:50:02.113444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.120664 (+ 7220us) service_pool.cc:224] Handling call
0925 01:50:11.174903 (+9054239us) ts_tablet_manager.cc:1151] Deleting tablet 3541e17b47bc47f5b69add361877a2bf
0925 01:50:11.174912 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.175058 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9053210}
I20260925 01:50:11.175500 11456 leader_election.cc:304] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:11.175655 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 600) took 9062 ms. Trace:
I20260925 01:50:11.175724 11953 rpcz_store.cc:276] 0925 01:50:02.113306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.139972 (+ 26666us) service_pool.cc:224] Handling call
0925 01:50:11.175502 (+9035530us) ts_tablet_manager.cc:1151] Deleting tablet c2fa459a53a54f47be961067736d2d16
0925 01:50:11.175511 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.175640 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9035273}
I20260925 01:50:11.175959 13412 raft_consensus.cc:2804] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:11.176124 13412 raft_consensus.cc:697] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Becoming Leader. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Running, Role: LEADER
I20260925 01:50:11.176388 13412 consensus_queue.cc:237] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.178869 11753 tablet_bootstrap.cc:654] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.179524 11953 tablet_replica.cc:333] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:11.180012 11953 raft_consensus.cc:2243] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:11.180557 11953 raft_consensus.cc:2272] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:11.181685 11953 ts_tablet_manager.cc:1916] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:11.191660 13306 consensus_queue.cc:1048] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:11.196921 11753 tablet_bootstrap.cc:492] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.197221 11753 ts_tablet_manager.cc:1403] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.003s
I20260925 01:50:11.198225 11753 raft_consensus.cc:359] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.198416 11753 raft_consensus.cc:385] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.198482 11753 raft_consensus.cc:740] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.198822 11753 consensus_queue.cc:260] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.199545 11753 ts_tablet_manager.cc:1434] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:50:11.199930 11753 tablet_bootstrap.cc:492] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.201759 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 681356bc659f4ca990cd2ffc0c10b533
I20260925 01:50:11.201833 11753 tablet_bootstrap.cc:654] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.202340 11674 catalog_manager.cc:6934] ReplaceTablet: tablet 681356bc659f4ca990cd2ffc0c10b533 deleted and replaced by tablet 43b8e5a02efe40118ae75200a48ba0c1
I20260925 01:50:11.206018 11674 catalog_manager.cc:5838] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } }
I20260925 01:50:11.207721 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 03232387650b450c97c41701b306ac77
I20260925 01:50:11.208038 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ba378e9d37c64a8ebd56894b2101ed8f (table default.Table_b21f64a8504443f7890c7eb3a6105499 [id=54187dc7496e4b15a88c29718ca70f12]) successfully deleted
I20260925 01:50:11.210121 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet dceeedf3471d45508f025e7a4c7f73f2
I20260925 01:50:11.210409 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet dc00e20861c54760ac8409c54abd1795
I20260925 01:50:11.210572 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 681356bc659f4ca990cd2ffc0c10b533 with delete_type TABLET_DATA_DELETED (replaced by tablet 43b8e5a02efe40118ae75200a48ba0c1) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:11.211287 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60b99f56bd6b49f7998f51c49df4f58e consensus state has no leader
I20260925 01:50:11.211903 11754 tablet_bootstrap.cc:492] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:11.212144 11754 ts_tablet_manager.cc:1403] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.470s user 0.023s sys 0.000s
I20260925 01:50:11.213039 11754 raft_consensus.cc:359] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.213338 11754 raft_consensus.cc:385] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.213514 11754 raft_consensus.cc:740] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.214044 11754 consensus_queue.cc:260] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.215904 11755 tablet_bootstrap.cc:492] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:11.220539 11755 ts_tablet_manager.cc:1403] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.418s user 0.004s sys 0.001s
I20260925 01:50:11.224035 11755 raft_consensus.cc:359] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:11.225910 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 61c1181b38a247e79bd7a6355950881e
I20260925 01:50:11.226470 11675 catalog_manager.cc:6934] ReplaceTablet: tablet 61c1181b38a247e79bd7a6355950881e deleted and replaced by tablet d968b35807db4db3a13c7625202d7e0f
I20260925 01:50:11.226931 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f00ae318500247e78454967ad6f6b04c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:11.227569 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f00ae318500247e78454967ad6f6b04c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:11.229132 11674 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:11.231560 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.231676 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 03232387650b450c97c41701b306ac77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.231894 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 81024a75b31e45e098d108bae4cc17c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.232095 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet b97f703869d4471cb940ef654203ec2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.232446 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c1181b38a247e79bd7a6355950881e with delete_type TABLET_DATA_DELETED (replaced by tablet d968b35807db4db3a13c7625202d7e0f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.232838 11497 tablet_service.cc:1511] Processing CreateTablet for tablet e00723f0948c4d08adf91023493270a7 (DEFAULT_TABLE table=default.Table_3a7f4d008b0b4253899b059ded73a06e [id=ec350526606548c29e8f06a756f8ea9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.233170 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e5bc61637d944b60ba9e703e9894174c
I20260925 01:50:11.233395 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e00723f0948c4d08adf91023493270a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.234185 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 681356bc659f4ca990cd2ffc0c10b533 with delete_type TABLET_DATA_DELETED (replaced by tablet 43b8e5a02efe40118ae75200a48ba0c1) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.234407 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet dc00e20861c54760ac8409c54abd1795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.234692 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c1181b38a247e79bd7a6355950881e with delete_type TABLET_DATA_DELETED (replaced by tablet d968b35807db4db3a13c7625202d7e0f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.235100 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet dceeedf3471d45508f025e7a4c7f73f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.235383 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet 03232387650b450c97c41701b306ac77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.236227 11676 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e1001e66d2984d9187443adcc42e5856 (table default.Table_480c7744a1b04253963bcf3fd3d1ba10 [id=0d47af1c08a54db49e9535d5bafc23e9]). Expected version 4 got 0
I20260925 01:50:11.238186 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 681356bc659f4ca990cd2ffc0c10b533 with delete_type TABLET_DATA_DELETED (replaced by tablet 43b8e5a02efe40118ae75200a48ba0c1) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.239171 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1b4f58554cb84a08a3fdf14cb279ca56
I20260925 01:50:11.239887 11753 tablet_bootstrap.cc:492] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.239878 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f47b3f5f81e34fc1a7ea9e9a3f1f6d56" } new_table_name: "default.Table_63fed474bfa9411dacb25f0b59128617" modify_external_catalogs: true
I20260925 01:50:11.240101 11753 ts_tablet_manager.cc:1403] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.006s
I20260925 01:50:11.240888 11753 raft_consensus.cc:359] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.241137 11753 raft_consensus.cc:385] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.241237 11753 raft_consensus.cc:740] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.241554 11753 consensus_queue.cc:260] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.242226 11753 ts_tablet_manager.cc:1434] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:11.243252 11753 tablet_bootstrap.cc:492] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.244766 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_17699cc3f8c945cfbc4a01267da6341c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:11.245321 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17699cc3f8c945cfbc4a01267da6341c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:11.248839 11177 consensus_peers.cc:597] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:11.249759 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5623ddf2e68941919d8ba2a5c6e50b5f" } new_table_name: "default.Table_3e88ad2e6c4a4822a1376e195e8e11ac" modify_external_catalogs: true
I20260925 01:50:11.253472 13412 raft_consensus.cc:493] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.253607 13412 raft_consensus.cc:515] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.254278 13412 leader_election.cc:290] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.254417 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fbec59b2447b4db3bcb49c05c2d6921d" } new_table_name: "default.Table_d7e5665eb73c46709984c096c866fe14" modify_external_catalogs: true
I20260925 01:50:11.255203 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcf8f6d0e24472a3190059df032698" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:11.255857 11456 leader_election.cc:343] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.256220 11753 tablet_bootstrap.cc:654] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:11.256579 11177 consensus_peers.cc:597] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:11.260491 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet f30fbaa9db5144debf9cc5124c9bf9bd from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:11.263614 13420 consensus_queue.cc:1048] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:11.264212 11753 tablet_bootstrap.cc:492] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.264361 11753 ts_tablet_manager.cc:1403] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.007s
I20260925 01:50:11.265136 11753 raft_consensus.cc:359] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.265302 11753 raft_consensus.cc:385] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.265354 11753 raft_consensus.cc:740] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.265539 11753 consensus_queue.cc:260] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.266199 11753 ts_tablet_manager.cc:1434] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:11.266477 11753 tablet_bootstrap.cc:492] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.268208 11753 tablet_bootstrap.cc:654] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.275313 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet dceeedf3471d45508f025e7a4c7f73f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.276461 11755 raft_consensus.cc:385] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.277192 11755 raft_consensus.cc:740] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.277619 11755 consensus_queue.cc:260] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:11.281641 13356 ts_tablet_manager.cc:1929] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:11.283700 11753 tablet_bootstrap.cc:492] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.283856 11753 ts_tablet_manager.cc:1403] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.007s
I20260925 01:50:11.284781 11753 raft_consensus.cc:359] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.285013 11753 raft_consensus.cc:385] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.285084 11753 raft_consensus.cc:740] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.285302 11753 consensus_queue.cc:260] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.285758 11753 ts_tablet_manager.cc:1434] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:11.286010 11753 tablet_bootstrap.cc:492] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.288599 11753 tablet_bootstrap.cc:654] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.300828 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet e5bc61637d944b60ba9e703e9894174c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.305030 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet dc00e20861c54760ac8409c54abd1795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.305863 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 841c61dcaffd443a9c8d665657a5e9dc (DEFAULT_TABLE table=default.Table_6f3f81eb3bad47feb571e26253057f54 [id=c48051c32ab14318a8cd7e719ba60076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.306452 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841c61dcaffd443a9c8d665657a5e9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.309342 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 705636cefa5e468c8384184dc04d9d81 (DEFAULT_TABLE table=default.Table_a374a5665122415d84f7c7176dfdc612 [id=8a75ee34c49b46ceb7d3c5785e720654]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.309696 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 6747afab39f44d80b38320b86c9d512b (DEFAULT_TABLE table=default.Table_55f5be5c3421480ca1141d4c051c7fa2 [id=8a158eefeec341f39b909762a9377968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.309834 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705636cefa5e468c8384184dc04d9d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.310051 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6747afab39f44d80b38320b86c9d512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.313977 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3f06c30890b148468b29c92d1e399bbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:11.314687 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f06c30890b148468b29c92d1e399bbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:11.318399 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dab99fe1964147d8a4b38b82f7a6217f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:11.327528 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4f58554cb84a08a3fdf14cb279ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.329310 11755 ts_tablet_manager.cc:1434] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.106s user 0.001s sys 0.000s
W20260925 01:50:11.330224 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 53134.7us
I20260925 01:50:11.330713 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_78e368302b404cfbba593121c96fafe1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:11.331383 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78e368302b404cfbba593121c96fafe1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:11.332043 11487 tablet_service.cc:1511] Processing CreateTablet for tablet a39d277b58664b5d9b06c22545da03c8 (DEFAULT_TABLE table=default.Table_fb943909bd9f467ea5a0d11972b7ae55 [id=15af5ff18871486a98210060ef2d99d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.332510 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39d277b58664b5d9b06c22545da03c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.335820 11946 ts_tablet_manager.cc:1929] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:11.336004 11946 log.cc:1199] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b61b1bf5a8d446918edc6d166b7712ef
I20260925 01:50:11.336796 11946 ts_tablet_manager.cc:1950] T b61b1bf5a8d446918edc6d166b7712ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:11.336329 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 720af96ca54c4266ab5fb277140b2809 (DEFAULT_TABLE table=default.Table_cf1146da8c94450fae9cf86b742d828e [id=ce61ea8b222f48c89cf772e644e989d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.338532 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720af96ca54c4266ab5fb277140b2809. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:11.338737 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ab8d5af739854f939ab585d943e7b7ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab8d5af739854f939ab585d943e7b7ca already in progress: creating tablet
W20260925 01:50:11.338937 11666 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 130458us
W20260925 01:50:11.345283 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 3541e17b47bc47f5b69add361877a2bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3541e17b47bc47f5b69add361877a2bf already in progress: creating tablet
I20260925 01:50:11.215585 11754 ts_tablet_manager.cc:1434] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
W20260925 01:50:11.345582 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet c2fa459a53a54f47be961067736d2d16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2fa459a53a54f47be961067736d2d16 already in progress: creating tablet
I20260925 01:50:11.348140 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 61c1181b38a247e79bd7a6355950881e with delete_type TABLET_DATA_DELETED (replaced by tablet d968b35807db4db3a13c7625202d7e0f) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.348340 11754 tablet_bootstrap.cc:492] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:11.348384 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet dceeedf3471d45508f025e7a4c7f73f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.348536 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet e5bc61637d944b60ba9e703e9894174c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.348908 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 841c61dcaffd443a9c8d665657a5e9dc (DEFAULT_TABLE table=default.Table_6f3f81eb3bad47feb571e26253057f54 [id=c48051c32ab14318a8cd7e719ba60076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.349299 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 720af96ca54c4266ab5fb277140b2809 (DEFAULT_TABLE table=default.Table_cf1146da8c94450fae9cf86b742d828e [id=ce61ea8b222f48c89cf772e644e989d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.349627 11342 tablet_service.cc:1511] Processing CreateTablet for tablet a39d277b58664b5d9b06c22545da03c8 (DEFAULT_TABLE table=default.Table_fb943909bd9f467ea5a0d11972b7ae55 [id=15af5ff18871486a98210060ef2d99d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.349912 11754 tablet_bootstrap.cc:654] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.349988 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 705636cefa5e468c8384184dc04d9d81 (DEFAULT_TABLE table=default.Table_a374a5665122415d84f7c7176dfdc612 [id=8a75ee34c49b46ceb7d3c5785e720654]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.351181 13356 log.cc:1199] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/31353cc95e014e5bb24e5e5cefab1503
I20260925 01:50:11.351249 11345 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4f58554cb84a08a3fdf14cb279ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.351788 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 6747afab39f44d80b38320b86c9d512b (DEFAULT_TABLE table=default.Table_55f5be5c3421480ca1141d4c051c7fa2 [id=8a158eefeec341f39b909762a9377968]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.353152 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet dc00e20861c54760ac8409c54abd1795 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.353753 11350 tablet_service.cc:1511] Processing CreateTablet for tablet e00723f0948c4d08adf91023493270a7 (DEFAULT_TABLE table=default.Table_3a7f4d008b0b4253899b059ded73a06e [id=ec350526606548c29e8f06a756f8ea9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.354251 13356 ts_tablet_manager.cc:1950] T 31353cc95e014e5bb24e5e5cefab1503 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:11.354622 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 881) took 1827 ms. Trace:
I20260925 01:50:11.354764 13356 rpcz_store.cc:276] 0925 01:50:09.527073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.527118 (+ 45us) service_pool.cc:224] Handling call
0925 01:50:10.794236 (+1267118us) ts_tablet_manager.cc:1151] Deleting tablet 31353cc95e014e5bb24e5e5cefab1503
0925 01:50:10.794248 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:10.813868 (+ 19620us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.281561 (+467693us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.354602 (+ 73041us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1266968}
I20260925 01:50:11.306872 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 841c61dcaffd443a9c8d665657a5e9dc (DEFAULT_TABLE table=default.Table_6f3f81eb3bad47feb571e26253057f54 [id=c48051c32ab14318a8cd7e719ba60076]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.355459 13356 tablet_replica.cc:333] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:11.355785 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841c61dcaffd443a9c8d665657a5e9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.355800 13356 raft_consensus.cc:2243] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:11.356063 13356 raft_consensus.cc:2272] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:11.307261 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 705636cefa5e468c8384184dc04d9d81 (DEFAULT_TABLE table=default.Table_a374a5665122415d84f7c7176dfdc612 [id=8a75ee34c49b46ceb7d3c5785e720654]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.358387 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705636cefa5e468c8384184dc04d9d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.308808 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 720af96ca54c4266ab5fb277140b2809 (DEFAULT_TABLE table=default.Table_cf1146da8c94450fae9cf86b742d828e [id=ce61ea8b222f48c89cf772e644e989d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.362344 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720af96ca54c4266ab5fb277140b2809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.320111 11206 tablet_service.cc:1511] Processing CreateTablet for tablet 6747afab39f44d80b38320b86c9d512b (DEFAULT_TABLE table=default.Table_55f5be5c3421480ca1141d4c051c7fa2 [id=8a158eefeec341f39b909762a9377968]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:11.322932 11176 consensus_peers.cc:597] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 406d31139e1e441aa6fe204168486e28. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:11.368844 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 45952.5us
I20260925 01:50:11.369025 11206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6747afab39f44d80b38320b86c9d512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.374492 13260 raft_consensus.cc:493] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.374643 13260 raft_consensus.cc:515] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.375309 13260 leader_election.cc:290] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:11.378580 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_aea9aebcc6dd4d169ecab0e4c3dce453"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:11.379218 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aea9aebcc6dd4d169ecab0e4c3dce453 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:11.380134 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a93acc6987404ffaaf580d0ad2519df8 consensus state has no leader
I20260925 01:50:11.385077 11204 tablet_service.cc:1511] Processing CreateTablet for tablet d7e36c33fbec44aea469067833014815 (DEFAULT_TABLE table=default.Table_6d210730598c4d58b3e79667f69388b1 [id=4a5ff672f37e4f5090db1328419edbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.385528 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e36c33fbec44aea469067833014815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.391320 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 03232387650b450c97c41701b306ac77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.395264 11671 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_6529ebbfdfc342a0b8dd088869ca0556 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 1 got 0
I20260925 01:50:11.397445 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 31353cc95e014e5bb24e5e5cefab1503 (table default.Table_04ba88f4ea89466a9be2799b103547fd [id=7d196ee9e42a41968e3013907ed4911a]) successfully deleted
I20260925 01:50:11.391927 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a251f96400af424cb8fe83c65616f9b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:11.399603 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a251f96400af424cb8fe83c65616f9b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:11.396694 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ab6c45a997374d28a59c1a32bc0a3b19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:11.404197 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_451dfd6e05704c959db39bdf1cccc265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:11.406359 13356 ts_tablet_manager.cc:1916] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:11.404781 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab6c45a997374d28a59c1a32bc0a3b19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:11.415804 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_451dfd6e05704c959db39bdf1cccc265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:11.418434 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.420264 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f6390a24da7e46038a7947594b1aacd8" } new_table_name: "default.Table_4ad3881ff5874f4594e9c336a16513e4" modify_external_catalogs: true
W20260925 01:50:11.421422 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80cd9735bf634871b7157443d0cfac37 consensus state has no leader
W20260925 01:50:11.422662 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dab99fe1964147d8a4b38b82f7a6217f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:11.425722 11953 ts_tablet_manager.cc:1929] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:11.425863 11953 log.cc:1199] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a8c46e780d4a4987ad52619e4c3b46c9
I20260925 01:50:11.433363 11677 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet cc4a51356880486a928181ee701f74d0 (table default.Table_f6390a24da7e46038a7947594b1aacd8 [id=ad62203df2f049f2988e6c7ad5b5188d]). Expected version 1 got 0
I20260925 01:50:11.443445 11208 tablet_service.cc:1511] Processing CreateTablet for tablet a39d277b58664b5d9b06c22545da03c8 (DEFAULT_TABLE table=default.Table_fb943909bd9f467ea5a0d11972b7ae55 [id=15af5ff18871486a98210060ef2d99d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.448288 11953 ts_tablet_manager.cc:1950] T a8c46e780d4a4987ad52619e4c3b46c9 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:11.448994 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39d277b58664b5d9b06c22545da03c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.327879 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b4f58554cb84a08a3fdf14cb279ca56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.328299 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet e5bc61637d944b60ba9e703e9894174c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:10 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.350793 13412 raft_consensus.cc:493] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.470327 13412 raft_consensus.cc:515] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.471051 13412 leader_election.cc:290] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.401125 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 9771b89303094974902c4ad1f1c8608e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.471901 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c01195f07b84b359a974fab5ed52582" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:11.472456 11456 leader_election.cc:343] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:11.413197 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afcf8f6d0e24472a3190059df032698 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.419461 11753 tablet_bootstrap.cc:492] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.473044 11753 ts_tablet_manager.cc:1403] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.187s user 0.022s sys 0.026s
I20260925 01:50:11.473778 11753 raft_consensus.cc:359] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.473922 11753 raft_consensus.cc:385] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.473963 11753 raft_consensus.cc:740] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.474190 11753 consensus_queue.cc:260] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.474653 11753 ts_tablet_manager.cc:1434] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:11.474603 11364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f703869d4471cb940ef654203ec2b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:11.436622 13411 raft_consensus.cc:493] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.474781 13411 raft_consensus.cc:515] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.475483 13411 leader_election.cc:290] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.476308 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce91b00d3a14e6398abacad61ff5b0f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.477296 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841c61dcaffd443a9c8d665657a5e9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.477519 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4a51356880486a928181ee701f74d0" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:11.478765 11753 tablet_bootstrap.cc:492] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:11.479765 11456 leader_election.cc:343] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.480480 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39d277b58664b5d9b06c22545da03c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.481326 11753 tablet_bootstrap.cc:654] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.482798 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705636cefa5e468c8384184dc04d9d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.484517 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6747afab39f44d80b38320b86c9d512b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.485782 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 607) took 9290 ms. Trace:
I20260925 01:50:11.486339 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e00723f0948c4d08adf91023493270a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.485857 11953 rpcz_store.cc:276] 0925 01:50:02.194874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.194945 (+ 71us) service_pool.cc:224] Handling call
0925 01:50:11.176488 (+8981543us) ts_tablet_manager.cc:1151] Deleting tablet a8c46e780d4a4987ad52619e4c3b46c9
0925 01:50:11.176525 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.326464 (+149939us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.425642 (+ 99178us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.485765 (+ 60123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8981184}
I20260925 01:50:11.486706 11953 tablet_replica.cc:333] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:11.486934 11953 raft_consensus.cc:2243] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:11.487108 11953 raft_consensus.cc:2272] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:11.487630 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a8c46e780d4a4987ad52619e4c3b46c9 (table default.Table_e973513b7c3d4c1dadf184056a92dad5 [id=a60aa9bcded3478f908ca2bdaafd1e41]) successfully deleted
I20260925 01:50:11.491055 13412 raft_consensus.cc:493] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.491189 13412 raft_consensus.cc:515] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.491770 13412 leader_election.cc:290] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.492417 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9771b89303094974902c4ad1f1c8608e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:11.492992 11456 leader_election.cc:343] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.493877 11755 tablet_bootstrap.cc:492] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:11.495426 11753 tablet_bootstrap.cc:492] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.495631 11753 ts_tablet_manager.cc:1403] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20260925 01:50:11.496649 11753 raft_consensus.cc:359] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:11.496905 11753 raft_consensus.cc:385] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.497009 11753 raft_consensus.cc:740] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.500465 11753 consensus_queue.cc:260] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:11.503340 11753 ts_tablet_manager.cc:1434] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 01:50:11.503630 11753 tablet_bootstrap.cc:492] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.505746 11753 tablet_bootstrap.cc:654] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.522876 11753 tablet_bootstrap.cc:492] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.523038 11753 ts_tablet_manager.cc:1403] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.003s
I20260925 01:50:11.523818 11753 raft_consensus.cc:359] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.523999 11753 raft_consensus.cc:385] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.524065 11753 raft_consensus.cc:740] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.524284 11753 consensus_queue.cc:260] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.524823 11753 ts_tablet_manager.cc:1434] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:11.525113 11753 tablet_bootstrap.cc:492] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.526744 11753 tablet_bootstrap.cc:654] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.535413 13306 raft_consensus.cc:493] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.535604 13306 raft_consensus.cc:515] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.536480 13306 leader_election.cc:290] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.537998 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 802ba2d39ddb47b3b42dfd9678e2d47f (DEFAULT_TABLE table=default.Table_29deefa840a94103b15dd6b08f23d076 [id=20e1b53a3e544d8397773fb109202ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.539119 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d398851fb194c61a0a3b2c60c7a5e8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:11.539306 11516 raft_consensus.cc:2468] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:11.539894 11176 leader_election.cc:304] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:11.540709 13306 raft_consensus.cc:2804] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:11.540784 13306 raft_consensus.cc:493] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:11.540844 13306 raft_consensus.cc:3060] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.542605 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 802ba2d39ddb47b3b42dfd9678e2d47f (DEFAULT_TABLE table=default.Table_29deefa840a94103b15dd6b08f23d076 [id=20e1b53a3e544d8397773fb109202ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.542979 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802ba2d39ddb47b3b42dfd9678e2d47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.494194 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcf8f6d0e24472a3190059df032698" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.544148 13306 raft_consensus.cc:515] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.545954 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d398851fb194c61a0a3b2c60c7a5e8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:11.546147 11516 raft_consensus.cc:3060] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.549082 11516 raft_consensus.cc:2468] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:11.549520 11350 tablet_service.cc:1511] Processing CreateTablet for tablet a9dd3e150ee941ea9e281240e40e3b0d (DEFAULT_TABLE table=default.Table_1c6331f1d18a4a84b27bda46f387d55e [id=2375d9e49a9442b9acbec6bd359e2915]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.549628 11176 leader_election.cc:304] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:11.549913 13420 raft_consensus.cc:2804] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:11.550069 13420 raft_consensus.cc:697] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:11.550359 13420 consensus_queue.cc:237] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.553332 11501 tablet_service.cc:1511] Processing CreateTablet for tablet d7e36c33fbec44aea469067833014815 (DEFAULT_TABLE table=default.Table_6d210730598c4d58b3e79667f69388b1 [id=4a5ff672f37e4f5090db1328419edbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.554255 13412 raft_consensus.cc:493] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.554384 13412 raft_consensus.cc:515] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.555008 13412 leader_election.cc:290] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.555783 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81024a75b31e45e098d108bae4cc17c9" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:11.556021 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 6b77f5d0a914468ba2bbd00923b05db0 (DEFAULT_TABLE table=default.Table_5bd60c10c41441cb81e69097767f6ef1 [id=af1b6fcd9efe45ba80a1f50ffb4bf1a9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:11.556445 11456 leader_election.cc:343] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.558228 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d398851fb194c61a0a3b2c60c7a5e8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:11.558446 13306 leader_election.cc:290] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.560273 11497 tablet_service.cc:1511] Processing CreateTablet for tablet a9dd3e150ee941ea9e281240e40e3b0d (DEFAULT_TABLE table=default.Table_1c6331f1d18a4a84b27bda46f387d55e [id=2375d9e49a9442b9acbec6bd359e2915]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:11.495468 11314 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:11.497493 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97f703869d4471cb940ef654203ec2b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.499696 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 802ba2d39ddb47b3b42dfd9678e2d47f (DEFAULT_TABLE table=default.Table_29deefa840a94103b15dd6b08f23d076 [id=20e1b53a3e544d8397773fb109202ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.503818 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 720af96ca54c4266ab5fb277140b2809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.566231 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802ba2d39ddb47b3b42dfd9678e2d47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.510433 11358 tablet_service.cc:1511] Processing CreateTablet for tablet d7e36c33fbec44aea469067833014815 (DEFAULT_TABLE table=default.Table_6d210730598c4d58b3e79667f69388b1 [id=4a5ff672f37e4f5090db1328419edbed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.578337 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e36c33fbec44aea469067833014815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.558525 11212 tablet_service.cc:1511] Processing CreateTablet for tablet a9dd3e150ee941ea9e281240e40e3b0d (DEFAULT_TABLE table=default.Table_1c6331f1d18a4a84b27bda46f387d55e [id=2375d9e49a9442b9acbec6bd359e2915]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:11.558863 11177 leader_election.cc:343] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.583756 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dd3e150ee941ea9e281240e40e3b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.585143 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b77f5d0a914468ba2bbd00923b05db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.533568 11953 ts_tablet_manager.cc:1916] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:11.592926 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dd3e150ee941ea9e281240e40e3b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.536218 11340 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 252) took 1050 ms. Trace:
I20260925 01:50:11.540498 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d398851fb194c61a0a3b2c60c7a5e8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.597023 11340 rpcz_store.cc:276] 0925 01:50:10.485765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.486083 (+ 318us) service_pool.cc:224] Handling call
0925 01:50:10.701176 (+215093us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x616000133954. stack: 00007f1c68e305c6 00007f1c68e30380 00007f1c67e3834d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f1c74ef3b50 00007f1c78deb1ff 00007f1c731b2bd6 00007f1c731b2905 00007f1c6ff7a63e 00007f1c6ff7951e 00007f1c6ff7f758 00007f1c6ff800bf 00007f1c6ff7fee8 0000000000aaef9c
0925 01:50:11.536190 (+835014us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157535488}
W20260925 01:50:11.597681 11177 leader_election.cc:343] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:11.561968 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 66498.6us
I20260925 01:50:11.600224 11755 tablet_bootstrap.cc:654] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.620707 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 6b77f5d0a914468ba2bbd00923b05db0 (DEFAULT_TABLE table=default.Table_5bd60c10c41441cb81e69097767f6ef1 [id=af1b6fcd9efe45ba80a1f50ffb4bf1a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.621379 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b77f5d0a914468ba2bbd00923b05db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.625434 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 6b77f5d0a914468ba2bbd00923b05db0 (DEFAULT_TABLE table=default.Table_5bd60c10c41441cb81e69097767f6ef1 [id=af1b6fcd9efe45ba80a1f50ffb4bf1a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:11.627601 13356 ts_tablet_manager.cc:1929] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:11.627794 13356 log.cc:1199] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/0c01195f07b84b359a974fab5ed52582
I20260925 01:50:11.628296 13356 ts_tablet_manager.cc:1950] T 0c01195f07b84b359a974fab5ed52582 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
W20260925 01:50:11.613080 11314 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:11.623870 11365 raft_consensus.cc:3060] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.642247 11314 leader_election.cc:304] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.642561 13260 raft_consensus.cc:493] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.637004 13271 raft_consensus.cc:493] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.642721 13260 raft_consensus.cc:515] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.642818 13271 raft_consensus.cc:515] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:11.643440 13260 leader_election.cc:290] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:11.643539 13271 leader_election.cc:290] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:11.643728 13260 raft_consensus.cc:2749] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:11.645304 11457 leader_election.cc:343] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.646159 13260 raft_consensus.cc:493] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:11.646313 13260 raft_consensus.cc:515] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.647485 13260 leader_election.cc:290] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:11.647526 11457 leader_election.cc:343] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.647611 13260 raft_consensus.cc:493] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:11.647652 11457 leader_election.cc:304] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.647717 13260 raft_consensus.cc:515] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:11.648006 13411 raft_consensus.cc:2749] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:11.648226 13260 leader_election.cc:290] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:50:11.648824 11457 leader_election.cc:343] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.648941 11457 leader_election.cc:304] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.649317 13411 raft_consensus.cc:2749] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:11.649855 11457 leader_election.cc:343] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.663735 11753 tablet_bootstrap.cc:492] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.665580 11753 ts_tablet_manager.cc:1403] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.141s user 0.022s sys 0.030s
I20260925 01:50:11.666731 11753 raft_consensus.cc:359] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.666819 13411 raft_consensus.cc:493] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.673143 13411 raft_consensus.cc:515] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.673821 13411 leader_election.cc:290] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.674407 11753 raft_consensus.cc:385] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.674676 11753 raft_consensus.cc:740] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.675169 11753 consensus_queue.cc:260] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.676198 11753 ts_tablet_manager.cc:1434] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260925 01:50:11.687457 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c01195f07b84b359a974fab5ed52582" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.688133 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4a51356880486a928181ee701f74d0" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.688755 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9771b89303094974902c4ad1f1c8608e" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.689631 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81024a75b31e45e098d108bae4cc17c9" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.691105 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c8c3bba9614539bfe3018461ad21f8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:11.706550 13412 raft_consensus.cc:493] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.706719 13412 raft_consensus.cc:515] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.707391 13412 leader_election.cc:290] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:11.708500 11457 leader_election.cc:343] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.708621 11457 leader_election.cc:304] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.709167 13412 raft_consensus.cc:2749] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:11.719111 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802ba2d39ddb47b3b42dfd9678e2d47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.722644 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e36c33fbec44aea469067833014815. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.722895 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9dd3e150ee941ea9e281240e40e3b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.729065 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b77f5d0a914468ba2bbd00923b05db0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:11.734795 11753 tablet_bootstrap.cc:492] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.738497 11753 tablet_bootstrap.cc:654] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.746531 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 893) took 1695 ms. Trace:
I20260925 01:50:11.747367 11946 rpcz_store.cc:276] 0925 01:50:10.050840 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.224099 (+173259us) service_pool.cc:224] Handling call
0925 01:50:11.107899 (+883800us) ts_tablet_manager.cc:1151] Deleting tablet b61b1bf5a8d446918edc6d166b7712ef
0925 01:50:11.107912 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.228250 (+120338us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.335760 (+107510us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.737504 (+401744us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":883633}
I20260925 01:50:11.754762 11753 tablet_bootstrap.cc:492] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.754944 11753 ts_tablet_manager.cc:1403] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20260925 01:50:11.756156 11753 raft_consensus.cc:359] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.756352 11753 raft_consensus.cc:385] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.756413 11753 raft_consensus.cc:740] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.756675 11753 consensus_queue.cc:260] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.757305 11753 ts_tablet_manager.cc:1434] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:11.764613 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b61b1bf5a8d446918edc6d166b7712ef (table default.Table_91355e6a2a11467f8375581add0caae9 [id=350f9fe5f3ae4c419ac210a46eb8d38e]) successfully deleted
I20260925 01:50:11.770887 11753 tablet_bootstrap.cc:492] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.772912 11753 tablet_bootstrap.cc:654] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.779819 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:11.667229 13140 consensus_queue.cc:1048] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:11.783192 11753 tablet_bootstrap.cc:492] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.674160 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c8c3bba9614539bfe3018461ad21f8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:11.783351 11753 ts_tablet_manager.cc:1403] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.005s
I20260925 01:50:11.708122 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3ba459a81845699435c2e44f5c9f19" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:11.784089 11456 leader_election.cc:343] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:11.784317 11456 leader_election.cc:343] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.784332 11753 raft_consensus.cc:359] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.784659 11753 raft_consensus.cc:385] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.784716 11753 raft_consensus.cc:740] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.784982 11753 consensus_queue.cc:260] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.785503 11753 ts_tablet_manager.cc:1434] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:11.790247 11753 tablet_bootstrap.cc:492] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.793154 11753 tablet_bootstrap.cc:654] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:11.795074 11176 consensus_peers.cc:597] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 818a792969a245f5b0fe5f80128206ba. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:11.810365 13126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Bootstrap replayed 1/1 log segments. Stats: ops{read=788 overwritten=0 applied=788 ignored=0} inserts{seen=738 ignored=0} mutations{seen=914 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 01:50:11.811528 13126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: Bootstrap complete.
I20260925 01:50:11.821738 13126 raft_consensus.cc:359] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:50:11.823758 13126 raft_consensus.cc:740] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec2f98d6295c4f8ead68b46f01e73d37, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.824697 13126 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 788, Last appended: 4.788, Last appended by leader: 788, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
W20260925 01:50:11.825891 11177 consensus_peers.cc:597] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:11.831758 13471 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:50:11.834425 13471 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:50:11.834295 13126 sys_catalog.cc:565] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 01:50:11.843132 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 899) took 1746 ms. Trace:
I20260925 01:50:11.843267 11946 rpcz_store.cc:276] 0925 01:50:10.096450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.299260 (+202810us) service_pool.cc:224] Handling call
0925 01:50:11.773711 (+1474451us) ts_tablet_manager.cc:1151] Deleting tablet 3f7e203f023745f0b9b44085b0943c6d
0925 01:50:11.773866 (+ 155us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.843096 (+ 69230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1437971}
I20260925 01:50:11.843453 11753 tablet_bootstrap.cc:492] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.843604 11753 ts_tablet_manager.cc:1403] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.053s user 0.012s sys 0.026s
I20260925 01:50:11.843741 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 905) took 1061 ms. Trace:
W20260925 01:50:11.843968 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3f7e203f023745f0b9b44085b0943c6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f7e203f023745f0b9b44085b0943c6d already in progress: creating tablet
I20260925 01:50:11.843833 11946 rpcz_store.cc:276] 0925 01:50:10.782219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.782629 (+ 410us) service_pool.cc:224] Handling call
0925 01:50:11.843613 (+1060984us) ts_tablet_manager.cc:1151] Deleting tablet 3ce8d023311b4a91adfebd6c5fedf1bd
0925 01:50:11.843625 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.843724 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1060651}
I20260925 01:50:11.844367 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 907) took 1061 ms. Trace:
I20260925 01:50:11.844434 11946 rpcz_store.cc:276] 0925 01:50:10.782429 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.783006 (+ 577us) service_pool.cc:224] Handling call
0925 01:50:11.844262 (+1061256us) ts_tablet_manager.cc:1151] Deleting tablet 9a4219ce09e54d268c55c19f7b5cbc7d
0925 01:50:11.844270 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.844351 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1060987}
I20260925 01:50:11.844597 11753 raft_consensus.cc:359] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.844772 11946 tablet_replica.cc:333] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:11.844770 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3ce8d023311b4a91adfebd6c5fedf1bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ce8d023311b4a91adfebd6c5fedf1bd already in progress: creating tablet
I20260925 01:50:11.844801 11753 raft_consensus.cc:385] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.844861 11753 raft_consensus.cc:740] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.844975 11946 raft_consensus.cc:2243] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:11.845135 11946 raft_consensus.cc:2272] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:11.845458 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9a4219ce09e54d268c55c19f7b5cbc7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a4219ce09e54d268c55c19f7b5cbc7d already in progress: creating tablet
I20260925 01:50:11.846540 11754 tablet_bootstrap.cc:492] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:11.846716 11754 ts_tablet_manager.cc:1403] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.498s user 0.006s sys 0.005s
I20260925 01:50:11.847489 11754 raft_consensus.cc:359] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.847699 11754 raft_consensus.cc:385] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.847756 11754 raft_consensus.cc:740] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.848023 11754 consensus_queue.cc:260] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.848634 11754 ts_tablet_manager.cc:1434] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:11.852243 13412 raft_consensus.cc:493] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.852389 13412 raft_consensus.cc:515] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.852985 13412 leader_election.cc:290] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:11.855541 11457 leader_election.cc:343] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.855652 11457 leader_election.cc:304] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.856089 13412 raft_consensus.cc:2749] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:11.856673 11457 leader_election.cc:343] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.856791 11457 leader_election.cc:304] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.857020 13464 tablet.cc:1751] T e6b97d37704f4a0d88457d124bb4f259 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:11.857224 13412 raft_consensus.cc:2749] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:11.858093 11457 leader_election.cc:343] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.858187 11457 leader_election.cc:304] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.858569 13412 raft_consensus.cc:2749] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:11.859699 11457 leader_election.cc:343] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.859789 11457 leader_election.cc:304] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:11.860226 13412 raft_consensus.cc:2749] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:11.864117 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 9feb00f881ed4518a32e08d170080a46 (table default.Table_a9bdcb0034c84520a7d9881bc8927159 [id=372975f12d544860a00670c2763bbbb4]). Expected version 3 got 0
I20260925 01:50:11.865530 11946 ts_tablet_manager.cc:1916] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:11.845139 11753 consensus_queue.cc:260] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.866581 11753 ts_tablet_manager.cc:1434] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.023s user 0.002s sys 0.000s
I20260925 01:50:11.866904 11753 tablet_bootstrap.cc:492] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.868324 13465 tablet.cc:1751] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:11.869333 11673 catalog_manager.cc:5838] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:11.873458 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet b81a0f0e096f4bdaaedb2122c3487079 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:11.876022 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.876411 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.877434 11753 tablet_bootstrap.cc:654] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.879626 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b7368994d6964edf87f8ed676a790ca0" } modify_external_catalogs: true
I20260925 01:50:11.879869 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_b7368994d6964edf87f8ed676a790ca0" } modify_external_catalogs: true
W20260925 01:50:11.880558 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e42dc54d78bb4a6b9b870543b6f1bc0d consensus state has no leader
I20260925 01:50:11.881635 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8853eb2058fe466db58b85c80ecacda1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:11.882407 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8853eb2058fe466db58b85c80ecacda1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:11.885848 13140 consensus_queue.cc:1048] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:11.891527 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b81a0f0e096f4bdaaedb2122c3487079
I20260925 01:50:11.892258 11677 catalog_manager.cc:6934] ReplaceTablet: tablet b81a0f0e096f4bdaaedb2122c3487079 deleted and replaced by tablet 0ae7e91450eb4d67b70560d854e7d74c
I20260925 01:50:11.893635 11946 ts_tablet_manager.cc:1929] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:11.893755 11946 log.cc:1199] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/226498ea628a475d8fcab28a6598a819
I20260925 01:50:11.894827 11753 tablet_bootstrap.cc:492] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.895040 11753 ts_tablet_manager.cc:1403] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.001s
I20260925 01:50:11.895788 11753 raft_consensus.cc:359] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.895974 11753 raft_consensus.cc:385] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.896040 11753 raft_consensus.cc:740] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.896320 11753 consensus_queue.cc:260] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.896844 11753 ts_tablet_manager.cc:1434] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:11.897267 11753 tablet_bootstrap.cc:492] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.898864 11753 tablet_bootstrap.cc:654] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.900007 11946 ts_tablet_manager.cc:1950] T 226498ea628a475d8fcab28a6598a819 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:11.900167 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet b81a0f0e096f4bdaaedb2122c3487079 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ae7e91450eb4d67b70560d854e7d74c) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.901226 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 908) took 1118 ms. Trace:
I20260925 01:50:11.901319 11946 rpcz_store.cc:276] 0925 01:50:10.782509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.783312 (+ 803us) service_pool.cc:224] Handling call
0925 01:50:11.844725 (+1061413us) ts_tablet_manager.cc:1151] Deleting tablet 226498ea628a475d8fcab28a6598a819
0925 01:50:11.844733 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.885750 (+ 41017us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.893579 (+ 7829us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.901205 (+ 7626us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1061144}
I20260925 01:50:11.901794 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 226498ea628a475d8fcab28a6598a819 (table default.Table_71c7a46468e24855b65e14b9221f5930 [id=cead6e15d1894994bb2fdaa3d7f0d88d]) successfully deleted
I20260925 01:50:11.902743 11677 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
I20260925 01:50:11.903285 11677 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet aaa2f7ef888846ec9667916ba47084db (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]). Expected version 1 got 0
I20260925 01:50:11.903880 11946 tablet_replica.cc:333] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:11.904143 11946 raft_consensus.cc:2243] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:11.904332 11946 raft_consensus.cc:2272] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:11.907128 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.907294 11753 tablet_bootstrap.cc:492] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.907434 11753 ts_tablet_manager.cc:1403] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260925 01:50:11.907635 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet f30fbaa9db5144debf9cc5124c9bf9bd
I20260925 01:50:11.908269 11753 raft_consensus.cc:359] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.908450 11753 raft_consensus.cc:385] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.908524 11753 raft_consensus.cc:740] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.908764 11753 consensus_queue.cc:260] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.909334 11753 ts_tablet_manager.cc:1434] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:11.909606 11753 tablet_bootstrap.cc:492] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.909734 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet f30fbaa9db5144debf9cc5124c9bf9bd with delete_type TABLET_DATA_DELETED (replaced by tablet a02464db4c3b4f408e4b26018f121121) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:11.909801 11676 catalog_manager.cc:6934] ReplaceTablet: tablet f30fbaa9db5144debf9cc5124c9bf9bd deleted and replaced by tablet a02464db4c3b4f408e4b26018f121121
I20260925 01:50:11.910292 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7ae1443a67e148b8aede8cd3e2734218" } new_table_name: "default.Table_1de1146b85324798b885c38035125fab" modify_external_catalogs: true
I20260925 01:50:11.910844 11946 ts_tablet_manager.cc:1916] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:11.912021 11753 tablet_bootstrap.cc:654] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.913605 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c4b146df79f340bf9b1dc7663cdbbcaf" } modify_external_catalogs: true
I20260925 01:50:11.914026 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c4b146df79f340bf9b1dc7663cdbbcaf" } modify_external_catalogs: true
I20260925 01:50:11.917630 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4ef3129ce4d545c0a2dae74dbc7798f0" } modify_external_catalogs: true
I20260925 01:50:11.918092 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4ef3129ce4d545c0a2dae74dbc7798f0" } modify_external_catalogs: true
W20260925 01:50:11.919078 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc4a51356880486a928181ee701f74d0 consensus state has no leader
I20260925 01:50:11.919739 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bc57955da3db41a0aefb397290d813d2" } modify_external_catalogs: true
I20260925 01:50:11.920001 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bc57955da3db41a0aefb397290d813d2" } modify_external_catalogs: true
I20260925 01:50:11.927160 11753 tablet_bootstrap.cc:492] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.927356 11753 ts_tablet_manager.cc:1403] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260925 01:50:11.928211 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet f30fbaa9db5144debf9cc5124c9bf9bd with delete_type TABLET_DATA_DELETED (replaced by tablet a02464db4c3b4f408e4b26018f121121) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:11.928753 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet b81a0f0e096f4bdaaedb2122c3487079 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ae7e91450eb4d67b70560d854e7d74c) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.930944 11753 raft_consensus.cc:359] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.933681 11753 raft_consensus.cc:385] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.933756 11753 raft_consensus.cc:740] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.934110 11753 consensus_queue.cc:260] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.934759 11753 ts_tablet_manager.cc:1434] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260925 01:50:11.940037 11753 tablet_bootstrap.cc:492] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.940363 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e5d28d466741a0a085a4f9938fffd1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:11.943003 11753 tablet_bootstrap.cc:654] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.955542 11953 ts_tablet_manager.cc:1929] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:11.955679 11953 log.cc:1199] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/17352fd6ea4e4ed9a178f1510edf4f6d
W20260925 01:50:11.956400 11177 consensus_peers.cc:597] T df5dcf3b6d134065be92ec6ea8caffc7 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:11.959575 13140 raft_consensus.cc:493] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:11.959720 13140 raft_consensus.cc:515] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.960934 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ffb404d93a4436ba9e624b45650fe1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:11.961151 11516 raft_consensus.cc:2468] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:11.961755 11753 tablet_bootstrap.cc:492] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.962183 11176 leader_election.cc:304] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:11.962237 11753 ts_tablet_manager.cc:1403] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.000s
I20260925 01:50:11.962613 13420 raft_consensus.cc:2804] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:11.962707 13420 raft_consensus.cc:493] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:11.962786 13420 raft_consensus.cc:3060] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.964126 11753 raft_consensus.cc:359] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.964346 11753 raft_consensus.cc:385] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.964447 11753 raft_consensus.cc:740] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.964694 11753 consensus_queue.cc:260] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.965369 11753 ts_tablet_manager.cc:1434] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260925 01:50:11.965502 13420 raft_consensus.cc:515] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.965770 11753 tablet_bootstrap.cc:492] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.967011 13140 leader_election.cc:290] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.967432 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ffb404d93a4436ba9e624b45650fe1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:11.967598 11513 raft_consensus.cc:3060] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:11.967739 11753 tablet_bootstrap.cc:654] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.971448 11513 raft_consensus.cc:2468] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:11.971849 11176 leader_election.cc:304] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:11.972386 13420 leader_election.cc:290] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:11.972533 13420 raft_consensus.cc:2804] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:11.972733 13420 raft_consensus.cc:697] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:11.972975 13420 consensus_queue.cc:237] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.976794 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f871e66b6b4445b68db378f00ada1145" } modify_external_catalogs: true
W20260925 01:50:11.977981 11456 leader_election.cc:343] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.982916 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet f30fbaa9db5144debf9cc5124c9bf9bd with delete_type TABLET_DATA_DELETED (replaced by tablet a02464db4c3b4f408e4b26018f121121) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:11.982916 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ffb404d93a4436ba9e624b45650fe1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:11.983536 11953 ts_tablet_manager.cc:1950] T 17352fd6ea4e4ed9a178f1510edf4f6d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:50:11.983544 11177 leader_election.cc:343] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:11.983845 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 608) took 9775 ms. Trace:
I20260925 01:50:11.983919 11953 rpcz_store.cc:276] 0925 01:50:02.208069 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.208133 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:11.486666 (+9278533us) ts_tablet_manager.cc:1151] Deleting tablet 17352fd6ea4e4ed9a178f1510edf4f6d
0925 01:50:11.486674 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.626594 (+139920us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.955468 (+328874us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.983830 (+ 28362us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9278340}
I20260925 01:50:11.984305 11953 tablet_replica.cc:333] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:11.984495 11953 raft_consensus.cc:2243] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:11.984643 11953 raft_consensus.cc:2272] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:11.987078 11753 tablet_bootstrap.cc:492] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:11.987265 11753 ts_tablet_manager.cc:1403] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.000s
I20260925 01:50:11.988175 11753 raft_consensus.cc:359] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.988386 11753 raft_consensus.cc:385] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:11.988442 11753 raft_consensus.cc:740] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:11.988667 11753 consensus_queue.cc:260] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:11.989285 11753 ts_tablet_manager.cc:1434] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:11.989423 11754 tablet_bootstrap.cc:492] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:11.992508 11754 tablet_bootstrap.cc:654] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.995187 11753 tablet_bootstrap.cc:492] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:11.996060 11953 ts_tablet_manager.cc:1916] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:11.996819 11753 tablet_bootstrap.cc:654] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:11.994962 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ffb404d93a4436ba9e624b45650fe1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:11.998349 11177 leader_election.cc:343] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.005121 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 882) took 2477 ms. Trace:
I20260925 01:50:11.977094 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e95fb28febd94a26ba9682fb9a462872
I20260925 01:50:11.984728 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 17352fd6ea4e4ed9a178f1510edf4f6d (table default.Table_ca88ffeaae4a4f1999cf9834715b791b [id=9389812769844f279c1e0c5fa9707dc0]) successfully deleted
I20260925 01:50:12.007721 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4b0fbc53a7e8455499f24027a13045f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.008425 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b0fbc53a7e8455499f24027a13045f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.011281 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet e95fb28febd94a26ba9682fb9a462872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.012424 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f871e66b6b4445b68db378f00ada1145" } modify_external_catalogs: true
I20260925 01:50:12.012785 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet e95fb28febd94a26ba9682fb9a462872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.016255 13488 consensus_queue.cc:1048] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:12.017238 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b8374f14bfc94d20955c84e90f3f6695"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.018218 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8374f14bfc94d20955c84e90f3f6695 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.025077 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ac24296ff95c4faaa1b79f2e134a175e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.025787 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac24296ff95c4faaa1b79f2e134a175e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.031131 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3d398851fb194c61a0a3b2c60c7a5e8b
I20260925 01:50:12.033331 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:12.034125 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_51b55c1a28a74a73a883a31c2d1e62d1" } new_table_name: "default.Table_256c4f08b4e041bca5bac667c1b1e860" modify_external_catalogs: true
I20260925 01:50:12.035172 13488 raft_consensus.cc:493] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.035372 13488 raft_consensus.cc:515] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.035516 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d398851fb194c61a0a3b2c60c7a5e8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.036199 13488 leader_election.cc:290] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.036638 11953 ts_tablet_manager.cc:1929] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.036765 11953 log.cc:1199] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/fcb56153a802427aaebbf55a8193d62b
I20260925 01:50:12.038954 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d398851fb194c61a0a3b2c60c7a5e8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.040593 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3e1405f7d12447309d5dbebd0aa43adc" } new_table_name: "default.Table_72f6ca2d7814492a9b3a6082a67a9ebf" modify_external_catalogs: true
W20260925 01:50:12.042935 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55405ccc8a7848f6addd4bf20e8379f5 consensus state has no leader
I20260925 01:50:12.044327 11946 ts_tablet_manager.cc:1929] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:12.044448 11946 log.cc:1199] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/35b123ac1e894239875404438ed19927
I20260925 01:50:12.044804 11946 ts_tablet_manager.cc:1950] T 35b123ac1e894239875404438ed19927 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.045522 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 909) took 1262 ms. Trace:
I20260925 01:50:12.045624 11946 rpcz_store.cc:276] 0925 01:50:10.782588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.783613 (+ 1025us) service_pool.cc:224] Handling call
0925 01:50:11.902601 (+1118988us) ts_tablet_manager.cc:1151] Deleting tablet 35b123ac1e894239875404438ed19927
0925 01:50:11.903820 (+ 1219us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.040862 (+137042us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.044273 (+ 3411us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.045502 (+ 1229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1118816}
I20260925 01:50:12.046615 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 35b123ac1e894239875404438ed19927 (table default.Table_3bcedabba6c244178b5f3479e7996282 [id=5405c0f51c3b4db8a58b97b60ea65777]) successfully deleted
W20260925 01:50:12.048043 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b5e1d832978450487009a8ff3eaec71 consensus state has no leader
I20260925 01:50:12.044796 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 29f28e49791744428729279a79b6c9f1
I20260925 01:50:12.049079 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 29f28e49791744428729279a79b6c9f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.007318 11212 tablet_service.cc:1558] Processing DeleteTablet for tablet e95fb28febd94a26ba9682fb9a462872 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.037122 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d398851fb194c61a0a3b2c60c7a5e8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.037832 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b6bde824d74acfaaffc23a0b05db8b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.051368 11456 leader_election.cc:343] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.051591 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 190806us
I20260925 01:50:12.053006 13356 rpcz_store.cc:276] 0925 01:50:09.527895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.527943 (+ 48us) service_pool.cc:224] Handling call
0925 01:50:11.355342 (+1827399us) ts_tablet_manager.cc:1151] Deleting tablet 0c01195f07b84b359a974fab5ed52582
0925 01:50:11.355357 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:11.453214 (+ 97857us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:11.627544 (+174330us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.004527 (+376983us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x61800000d518. stack: 00007fc2a418e5c6 00007fc2a418e380 00007fc2a319634d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007fc2a418405d 00007fc2a41850ce 00007fc2b810fecd 00007fc2b8090213 00007fc2b41d8d23 00007fc2b420ba64 00007fc2b41ec3a0 00007fc2b41ec12d 0000000000aaef9c 00007fc2a41d4aef
0925 01:50:12.005096 (+ 569us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161367936,"tablet-delete.queue_time_us":1827214}
W20260925 01:50:12.057701 11314 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 24cd89d238bf4220a48ecdf59cca5e6d
W20260925 01:50:12.057940 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98e13bbb749544afbb73e83b314c3d06 consensus state has no leader
W20260925 01:50:12.058463 11666 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet cc4a51356880486a928181ee701f74d0 (table default.Table_4ad3881ff5874f4594e9c336a16513e4 [id=ad62203df2f049f2988e6c7ad5b5188d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet cc4a51356880486a928181ee701f74d0 consensus state has no leader
I20260925 01:50:12.054540 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 29f28e49791744428729279a79b6c9f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.059384 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 0c01195f07b84b359a974fab5ed52582 (table default.Table_7eb435d3e2ec4209bdd1f04597fcadd8 [id=e93d9881c42d4a51a90c1ffb5fe17930]) successfully deleted
I20260925 01:50:12.060381 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 226498ea628a475d8fcab28a6598a819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.060887 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 29f28e49791744428729279a79b6c9f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.054965 11953 ts_tablet_manager.cc:1950] T fcb56153a802427aaebbf55a8193d62b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:12.061348 13356 tablet_replica.cc:333] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:12.061592 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 606) took 9876 ms. Trace:
I20260925 01:50:12.061724 11953 rpcz_store.cc:276] 0925 01:50:02.185340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.221657 (+ 36317us) service_pool.cc:224] Handling call
0925 01:50:11.984258 (+9762601us) ts_tablet_manager.cc:1151] Deleting tablet fcb56153a802427aaebbf55a8193d62b
0925 01:50:11.984268 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.007958 (+ 23690us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.036569 (+ 28611us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.061570 (+ 25001us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9761435}
I20260925 01:50:12.062425 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet fcb56153a802427aaebbf55a8193d62b (table default.Table_408d8b2c40464a69b5427f4713abff09 [id=ab32966818e7462982dc4ecfb0d662db]) successfully deleted
I20260925 01:50:12.062990 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 622) took 9504 ms. Trace:
I20260925 01:50:12.063122 11953 rpcz_store.cc:276] 0925 01:50:02.558455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.558520 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:12.062863 (+9504343us) ts_tablet_manager.cc:1151] Deleting tablet 501f41a3ee1d440bb07033e29c38bc7a
0925 01:50:12.062873 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.062971 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9504130}
W20260925 01:50:12.063779 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 501f41a3ee1d440bb07033e29c38bc7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 501f41a3ee1d440bb07033e29c38bc7a already in progress: creating tablet
I20260925 01:50:12.064172 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 623) took 9454 ms. Trace:
I20260925 01:50:12.064312 11953 rpcz_store.cc:276] 0925 01:50:02.609676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.609905 (+ 229us) service_pool.cc:224] Handling call
0925 01:50:12.064070 (+9454165us) ts_tablet_manager.cc:1151] Deleting tablet bd594870fa6a4ba190a18a48d821d72c
0925 01:50:12.064079 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.064154 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9439273}
W20260925 01:50:12.066133 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bd594870fa6a4ba190a18a48d821d72c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd594870fa6a4ba190a18a48d821d72c already in progress: creating tablet
W20260925 01:50:12.066514 11314 leader_election.cc:343] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 8234c4d0c72541158826416e40f34031
I20260925 01:50:12.070779 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.072346 13356 raft_consensus.cc:2243] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:12.072737 11314 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b306496f992f45a9b64b05b73712cb5b
I20260925 01:50:12.077947 11753 tablet_bootstrap.cc:492] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.078145 11753 ts_tablet_manager.cc:1403] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.083s user 0.010s sys 0.009s
I20260925 01:50:12.079218 11753 raft_consensus.cc:359] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.079622 11753 raft_consensus.cc:385] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.079710 11753 raft_consensus.cc:740] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.079972 11753 consensus_queue.cc:260] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.083307 11753 ts_tablet_manager.cc:1434] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:12.046025 11946 tablet_replica.cc:333] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.085997 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4b87558f2a98419f96b453a44aae814b" } new_table_name: "default.Table_024ab99d505f4f6eaed9ebd195ac0ffd" modify_external_catalogs: true
I20260925 01:50:12.087683 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.086380 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet a8d3b4ec14d5457eb0d0d364904e755d from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:12.086647 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_137ed1759a8941a2a663204df88796b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.089520 11946 raft_consensus.cc:2243] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.089706 11946 raft_consensus.cc:2272] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.064853 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet b81a0f0e096f4bdaaedb2122c3487079 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ae7e91450eb4d67b70560d854e7d74c) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:12.090838 11314 leader_election.cc:343] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:50:12.086973 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 6091ed7d816a46958a6de343fe682292
I20260925 01:50:12.091811 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 0749a0ae58df4ff8b74a86f072332fad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.092636 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 6091ed7d816a46958a6de343fe682292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.092919 13356 raft_consensus.cc:2272] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.087924 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ad3a481c07244253b0af257ba857a247"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.094642 11753 tablet_bootstrap.cc:492] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.094997 11946 ts_tablet_manager.cc:1916] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.097213 13356 ts_tablet_manager.cc:1916] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.098495 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 6091ed7d816a46958a6de343fe682292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:12.100100 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad3a481c07244253b0af257ba857a247 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:12.102090 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_137ed1759a8941a2a663204df88796b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.102361 11753 tablet_bootstrap.cc:654] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.103840 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 6091ed7d816a46958a6de343fe682292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:12.106158 11314 leader_election.cc:343] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 24cd89d238bf4220a48ecdf59cca5e6d
I20260925 01:50:12.106340 11314 leader_election.cc:304] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.106624 13321 raft_consensus.cc:2749] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.106782 13452 raft_consensus.cc:493] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.106946 13452 raft_consensus.cc:515] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:12.107152 11314 leader_election.cc:343] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 8234c4d0c72541158826416e40f34031
I20260925 01:50:12.107239 11314 leader_election.cc:304] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.107569 13321 raft_consensus.cc:2749] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.107663 13452 leader_election.cc:290] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:12.107930 11314 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b306496f992f45a9b64b05b73712cb5b
I20260925 01:50:12.108105 11314 leader_election.cc:304] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.108355 13452 raft_consensus.cc:2749] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:12.108538 11314 leader_election.cc:343] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:50:12.108690 11314 leader_election.cc:304] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.108916 13452 raft_consensus.cc:2749] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:12.112751 13496 tablet.cc:1751] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:12.113116 11753 tablet_bootstrap.cc:492] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.113258 11753 ts_tablet_manager.cc:1403] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260925 01:50:12.090607 11755 tablet_bootstrap.cc:492] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:12.113597 11755 ts_tablet_manager.cc:1403] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.620s user 0.007s sys 0.001s
I20260925 01:50:12.114006 11753 raft_consensus.cc:359] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.114212 11753 raft_consensus.cc:385] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.114275 11753 raft_consensus.cc:740] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.114472 11753 consensus_queue.cc:260] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.114846 11755 raft_consensus.cc:359] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:12.115049 11753 ts_tablet_manager.cc:1434] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:12.115077 11755 raft_consensus.cc:385] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.115218 11755 raft_consensus.cc:740] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.115538 11753 tablet_bootstrap.cc:492] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.115437 11755 consensus_queue.cc:260] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:12.116330 11755 ts_tablet_manager.cc:1434] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:12.071849 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 624) took 9462 ms. Trace:
I20260925 01:50:12.116686 11953 rpcz_store.cc:276] 0925 01:50:02.609772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.610103 (+ 331us) service_pool.cc:224] Handling call
0925 01:50:12.071665 (+9461562us) ts_tablet_manager.cc:1151] Deleting tablet bf8bd1bfa4db4706b545829d6d26b660
0925 01:50:12.071675 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.071826 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9446525}
I20260925 01:50:12.117070 11953 tablet_replica.cc:333] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:12.117273 11953 raft_consensus.cc:2243] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.117415 11953 raft_consensus.cc:2272] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.117818 11753 tablet_bootstrap.cc:654] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.118011 11953 ts_tablet_manager.cc:1916] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.119473 13488 raft_consensus.cc:493] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.119606 13488 raft_consensus.cc:515] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.120370 13488 leader_election.cc:290] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:12.121821 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bf8bd1bfa4db4706b545829d6d26b660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf8bd1bfa4db4706b545829d6d26b660 already in progress: creating tablet
I20260925 01:50:12.122677 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_17699cc3f8c945cfbc4a01267da6341c" } new_table_name: "default.Table_f3418c7b61b1456987fac5af765e86e4" modify_external_catalogs: true
I20260925 01:50:12.111297 11754 tablet_bootstrap.cc:492] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:12.120761 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9462215644a41ccb2f269f64e35392a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.124603 11754 ts_tablet_manager.cc:1403] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.135s user 0.004s sys 0.004s
I20260925 01:50:12.125324 11754 raft_consensus.cc:359] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.125473 11754 raft_consensus.cc:385] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.125516 11754 raft_consensus.cc:740] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.129665 11953 ts_tablet_manager.cc:1929] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.129874 11953 log.cc:1199] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/53d30f4940c44bcf900a8cf0de91a66d
I20260925 01:50:12.130290 11953 ts_tablet_manager.cc:1950] T 53d30f4940c44bcf900a8cf0de91a66d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:12.130867 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 625) took 9521 ms. Trace:
I20260925 01:50:12.131031 11953 rpcz_store.cc:276] 0925 01:50:02.609854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.610232 (+ 378us) service_pool.cc:224] Handling call
0925 01:50:12.117022 (+9506790us) ts_tablet_manager.cc:1151] Deleting tablet 53d30f4940c44bcf900a8cf0de91a66d
0925 01:50:12.117032 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.123991 (+ 6959us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.129607 (+ 5616us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.130849 (+ 1242us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9491814}
I20260925 01:50:12.131910 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 53d30f4940c44bcf900a8cf0de91a66d (table default.Table_fd114e03807f4a78964e4057de720bfa [id=a2353cff823048a2bfedf7ef1c58975b]) successfully deleted
I20260925 01:50:12.132319 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 9feb00f881ed4518a32e08d170080a46 (table default.Table_a9bdcb0034c84520a7d9881bc8927159 [id=372975f12d544860a00670c2763bbbb4]). Expected version 3 got 0
I20260925 01:50:12.125816 11754 consensus_queue.cc:260] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.133621 11754 ts_tablet_manager.cc:1434] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260925 01:50:12.133944 11754 tablet_bootstrap.cc:492] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:12.133929 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 626) took 9520 ms. Trace:
I20260925 01:50:12.134009 11953 rpcz_store.cc:276] 0925 01:50:02.613111 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.613168 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:12.133799 (+9520631us) ts_tablet_manager.cc:1151] Deleting tablet bd22b1eb643f4229a65566493e21d96c
0925 01:50:12.133809 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.133910 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9508569}
W20260925 01:50:12.134521 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bd22b1eb643f4229a65566493e21d96c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd22b1eb643f4229a65566493e21d96c already in progress: creating tablet
W20260925 01:50:12.136255 11456 leader_election.cc:343] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.136699 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_17dfbf84b0154c4692c3d29c06514c83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.137499 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17dfbf84b0154c4692c3d29c06514c83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.138993 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5cead8ca50414983bbaca4096eb3ee97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.139638 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cead8ca50414983bbaca4096eb3ee97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.149797 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 627) took 9500 ms. Trace:
I20260925 01:50:12.149935 11953 rpcz_store.cc:276] 0925 01:50:02.649388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.649446 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:12.146287 (+9496841us) ts_tablet_manager.cc:1151] Deleting tablet 98a94b6345ca427180e8f4e4b279efcf
0925 01:50:12.149645 (+ 3358us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.149759 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9496667}
I20260925 01:50:12.152896 11754 tablet_bootstrap.cc:654] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.154814 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 637) took 9209 ms. Trace:
I20260925 01:50:12.154954 11953 rpcz_store.cc:276] 0925 01:50:02.982704 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.982779 (+ 75us) service_pool.cc:224] Handling call
0925 01:50:12.150361 (+9167582us) ts_tablet_manager.cc:1151] Deleting tablet 0c01195f07b84b359a974fab5ed52582
0925 01:50:12.154642 (+ 4281us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.154785 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9167333}
I20260925 01:50:12.155417 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 639) took 9172 ms. Trace:
I20260925 01:50:12.155500 11953 rpcz_store.cc:276] 0925 01:50:02.983008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.983103 (+ 95us) service_pool.cc:224] Handling call
0925 01:50:12.155296 (+9172193us) ts_tablet_manager.cc:1151] Deleting tablet 7a5c9dac783d4ef3a24cb65275ff484f
0925 01:50:12.155308 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.155402 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9172059}
I20260925 01:50:12.155864 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 638) took 9173 ms. Trace:
I20260925 01:50:12.155952 11953 rpcz_store.cc:276] 0925 01:50:02.982882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:02.983743 (+ 861us) service_pool.cc:224] Handling call
0925 01:50:12.155756 (+9172013us) ts_tablet_manager.cc:1151] Deleting tablet 1575d0eb9ed64653b317edefd24f7dfd
0925 01:50:12.155767 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.155849 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9171005}
I20260925 01:50:12.156296 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 641) took 9148 ms. Trace:
I20260925 01:50:12.156369 11953 rpcz_store.cc:276] 0925 01:50:03.007819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.007890 (+ 71us) service_pool.cc:224] Handling call
0925 01:50:12.156192 (+9148302us) ts_tablet_manager.cc:1151] Deleting tablet 018f68f800c9489a846c3b1b3ee3fa2d
0925 01:50:12.156203 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.156281 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9146458}
I20260925 01:50:12.156656 11953 tablet_replica.cc:333] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:12.156953 11953 raft_consensus.cc:2243] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.157346 11953 raft_consensus.cc:2272] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.158007 11953 ts_tablet_manager.cc:1916] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:12.162408 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c86a78873e8847fa95bead4774bea606 consensus state has no leader
I20260925 01:50:12.162990 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_11388be1a8f34e8fa41e64a79b062b29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.166473 13321 raft_consensus.cc:493] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.166610 13321 raft_consensus.cc:515] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.167186 13321 leader_election.cc:290] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:12.169921 13412 raft_consensus.cc:493] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.170050 13412 raft_consensus.cc:515] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.170665 13412 leader_election.cc:290] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.172206 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f19bccf3c5540cb828ec7bfc89a1c17" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.173322 11456 leader_election.cc:343] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.175791 11946 ts_tablet_manager.cc:1929] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.175927 11946 log.cc:1199] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/31ecfc5a2a80449c9905c83b6bcb3652
I20260925 01:50:12.176297 11946 ts_tablet_manager.cc:1950] T 31ecfc5a2a80449c9905c83b6bcb3652 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.180291 11753 tablet_bootstrap.cc:492] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.180500 11753 ts_tablet_manager.cc:1403] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.065s user 0.016s sys 0.011s
I20260925 01:50:12.181897 11753 raft_consensus.cc:359] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.182158 11753 raft_consensus.cc:385] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.182260 11753 raft_consensus.cc:740] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.182567 11753 consensus_queue.cc:260] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.183449 11753 ts_tablet_manager.cc:1434] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:12.184077 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 910) took 1400 ms. Trace:
I20260925 01:50:12.184154 11946 rpcz_store.cc:276] 0925 01:50:10.783934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.783979 (+ 45us) service_pool.cc:224] Handling call
0925 01:50:12.045971 (+1261992us) ts_tablet_manager.cc:1151] Deleting tablet 31ecfc5a2a80449c9905c83b6bcb3652
0925 01:50:12.045983 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.107501 (+ 61518us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.175717 (+ 68216us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.184058 (+ 8341us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1261779}
I20260925 01:50:12.184549 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 31ecfc5a2a80449c9905c83b6bcb3652 (table default.Table_3b5c5e5eccf6419294fcf649547572ac [id=17f681ed73a4408db51a13e3764c7ef7]) successfully deleted
I20260925 01:50:12.186133 11946 tablet_replica.cc:333] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.186317 11946 raft_consensus.cc:2243] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.186470 11946 raft_consensus.cc:2272] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.187675 11753 tablet_bootstrap.cc:492] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.188966 11946 ts_tablet_manager.cc:1916] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.190213 11753 tablet_bootstrap.cc:654] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.194700 11953 ts_tablet_manager.cc:1929] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:50:12.194720 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fd865bada9e548ef8301c58492d7b90b has no consensus state
I20260925 01:50:12.194813 11953 log.cc:1199] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/6ff85bac0d22416987e8e3b379154b09
I20260925 01:50:12.195109 11953 ts_tablet_manager.cc:1950] T 6ff85bac0d22416987e8e3b379154b09 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:12.195417 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 642) took 9173 ms. Trace:
I20260925 01:50:12.195482 11953 rpcz_store.cc:276] 0925 01:50:03.022469 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.022535 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:12.156603 (+9134068us) ts_tablet_manager.cc:1151] Deleting tablet 6ff85bac0d22416987e8e3b379154b09
0925 01:50:12.156613 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.179362 (+ 22749us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.194639 (+ 15277us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.195402 (+ 763us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9133846}
I20260925 01:50:12.195883 13420 raft_consensus.cc:493] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.196020 13420 raft_consensus.cc:515] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.196700 13420 leader_election.cc:290] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.197176 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9771b89303094974902c4ad1f1c8608e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.197343 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9771b89303094974902c4ad1f1c8608e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:12.197535 11513 raft_consensus.cc:2468] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:12.197674 11177 leader_election.cc:343] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.197983 11176 leader_election.cc:304] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:12.198412 13420 raft_consensus.cc:2804] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:12.198511 13420 raft_consensus.cc:493] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:12.198580 13420 raft_consensus.cc:3060] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:12.198930 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 649) took 8749 ms. Trace:
I20260925 01:50:12.199033 11953 rpcz_store.cc:276] 0925 01:50:03.449428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.457352 (+ 7924us) service_pool.cc:224] Handling call
0925 01:50:12.198813 (+8741461us) ts_tablet_manager.cc:1151] Deleting tablet ea10c9a7e20b48c69eb5f24631403e93
0925 01:50:12.198825 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.198914 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8741131}
I20260925 01:50:12.201524 13420 raft_consensus.cc:515] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.202044 11953 tablet_replica.cc:333] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:12.202288 11953 raft_consensus.cc:2243] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.202463 11953 raft_consensus.cc:2272] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.202589 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9771b89303094974902c4ad1f1c8608e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:12.202771 11513 raft_consensus.cc:3060] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:12.202996 11953 ts_tablet_manager.cc:1916] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.206488 13420 leader_election.cc:290] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.207028 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9771b89303094974902c4ad1f1c8608e" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:12.206008 11513 raft_consensus.cc:2468] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:12.207561 11177 leader_election.cc:343] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.207885 11176 leader_election.cc:304] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:12.208323 13420 raft_consensus.cc:2804] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:12.208565 13420 raft_consensus.cc:697] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:12.208636 13411 raft_consensus.cc:493] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.208761 13411 raft_consensus.cc:515] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.208809 13420 consensus_queue.cc:237] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.209298 13411 leader_election.cc:290] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.210093 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6715233be44b9aad5210d17500f59d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.210667 11456 leader_election.cc:343] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.216739 11753 tablet_bootstrap.cc:492] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.216914 11753 ts_tablet_manager.cc:1403] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.006s
I20260925 01:50:12.217128 11946 ts_tablet_manager.cc:1929] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:12.217291 11946 log.cc:1199] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/f2618c46630c4295949b36f3d0087941
I20260925 01:50:12.217423 11676 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:12.217705 11946 ts_tablet_manager.cc:1950] T f2618c46630c4295949b36f3d0087941 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.217748 11753 raft_consensus.cc:359] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.217911 11753 raft_consensus.cc:385] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.217981 11753 raft_consensus.cc:740] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.218231 11753 consensus_queue.cc:260] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.116623 11755 tablet_bootstrap.cc:492] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:12.221601 11753 ts_tablet_manager.cc:1434] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260925 01:50:12.221885 11753 tablet_bootstrap.cc:492] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.222419 11953 ts_tablet_manager.cc:1929] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.222548 11953 log.cc:1199] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/75a8e09b8838443c9bfff440ff1f877d
I20260925 01:50:12.222857 11953 ts_tablet_manager.cc:1950] T 75a8e09b8838443c9bfff440ff1f877d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:12.223177 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 650) took 8705 ms. Trace:
I20260925 01:50:12.223264 11953 rpcz_store.cc:276] 0925 01:50:03.517979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.518043 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:12.201993 (+8683950us) ts_tablet_manager.cc:1151] Deleting tablet 75a8e09b8838443c9bfff440ff1f877d
0925 01:50:12.202002 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.219062 (+ 17060us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.222364 (+ 3302us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.223162 (+ 798us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8683641}
I20260925 01:50:12.223649 11753 tablet_bootstrap.cc:654] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.223768 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 911) took 1439 ms. Trace:
I20260925 01:50:12.223855 11946 rpcz_store.cc:276] 0925 01:50:10.784321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.784363 (+ 42us) service_pool.cc:224] Handling call
0925 01:50:12.184537 (+1400174us) ts_tablet_manager.cc:1151] Deleting tablet f2618c46630c4295949b36f3d0087941
0925 01:50:12.186093 (+ 1556us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.201091 (+ 14998us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.217059 (+ 15968us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.223749 (+ 6690us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1536,"tablet-delete.queue_time_us":1399840}
I20260925 01:50:12.224751 11946 tablet_replica.cc:333] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.224944 11946 raft_consensus.cc:2243] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.225090 11946 raft_consensus.cc:2272] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.225610 11946 ts_tablet_manager.cc:1916] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.229862 11755 tablet_bootstrap.cc:654] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.235208 11753 tablet_bootstrap.cc:492] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.235370 11753 ts_tablet_manager.cc:1403] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260925 01:50:12.236445 11753 raft_consensus.cc:359] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.236626 11753 raft_consensus.cc:385] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.236694 11753 raft_consensus.cc:740] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.236948 11753 consensus_queue.cc:260] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.237512 11753 ts_tablet_manager.cc:1434] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:12.237787 11753 tablet_bootstrap.cc:492] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.240193 11753 tablet_bootstrap.cc:654] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.240867 11946 ts_tablet_manager.cc:1929] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.241052 11946 log.cc:1199] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/31ffb404d93a4436ba9e624b45650fe1
I20260925 01:50:12.241411 11946 ts_tablet_manager.cc:1950] T 31ffb404d93a4436ba9e624b45650fe1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.248111 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 912) took 1463 ms. Trace:
I20260925 01:50:12.248224 11946 rpcz_store.cc:276] 0925 01:50:10.784829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.784874 (+ 45us) service_pool.cc:224] Handling call
0925 01:50:12.224705 (+1439831us) ts_tablet_manager.cc:1151] Deleting tablet 31ffb404d93a4436ba9e624b45650fe1
0925 01:50:12.224715 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.236904 (+ 12189us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.240787 (+ 3883us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.248093 (+ 7306us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1439577}
W20260925 01:50:12.251641 11176 consensus_peers.cc:597] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2618c46630c4295949b36f3d0087941. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:12.252702 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 913) took 1467 ms. Trace:
I20260925 01:50:12.252822 11946 rpcz_store.cc:276] 0925 01:50:10.785261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.786905 (+ 1644us) service_pool.cc:224] Handling call
0925 01:50:12.248644 (+1461739us) ts_tablet_manager.cc:1151] Deleting tablet 2c93bb7a34f94deaa65f8b588c604b81
0925 01:50:12.249018 (+ 374us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.252675 (+ 3657us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461363}
I20260925 01:50:12.236606 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 651) took 8686 ms. Trace:
I20260925 01:50:12.253682 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 906) took 1471 ms. Trace:
I20260925 01:50:12.253549 11953 rpcz_store.cc:276] 0925 01:50:03.550576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.550628 (+ 52us) service_pool.cc:224] Handling call
0925 01:50:12.236446 (+8685818us) ts_tablet_manager.cc:1151] Deleting tablet 49692d2824a34f48a4dcefad8c89618b
0925 01:50:12.236458 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.236582 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8685578}
I20260925 01:50:12.253756 11946 rpcz_store.cc:276] 0925 01:50:10.782337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.787555 (+ 5218us) service_pool.cc:224] Handling call
0925 01:50:12.253524 (+1465969us) ts_tablet_manager.cc:1151] Deleting tablet fe3627bfb342448591ccaf3d7ab23c4a
0925 01:50:12.253533 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.253662 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1465610}
I20260925 01:50:12.254092 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 652) took 8687 ms. Trace:
I20260925 01:50:12.254236 11946 tablet_replica.cc:333] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.254173 11953 rpcz_store.cc:276] 0925 01:50:03.566755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.566811 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:12.253927 (+8687116us) ts_tablet_manager.cc:1151] Deleting tablet f46004be36b543a395a783a13b1b14cf
0925 01:50:12.253939 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.254044 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8686878}
I20260925 01:50:12.254408 11946 raft_consensus.cc:2243] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.254530 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 653) took 8626 ms. Trace:
I20260925 01:50:12.254549 11946 raft_consensus.cc:2272] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.254628 11753 tablet_bootstrap.cc:492] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.254597 11953 rpcz_store.cc:276] 0925 01:50:03.628323 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.630150 (+ 1827us) service_pool.cc:224] Handling call
0925 01:50:12.254419 (+8624269us) ts_tablet_manager.cc:1151] Deleting tablet 728157ec17ed4df5a4a8559df6c1ac78
0925 01:50:12.254438 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.254515 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8624069}
I20260925 01:50:12.254733 11753 ts_tablet_manager.cc:1403] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.001s
I20260925 01:50:12.254935 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 654) took 8626 ms. Trace:
I20260925 01:50:12.255000 11953 rpcz_store.cc:276] 0925 01:50:03.628498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.630382 (+ 1884us) service_pool.cc:224] Handling call
0925 01:50:12.254834 (+8624452us) ts_tablet_manager.cc:1151] Deleting tablet f92450c05b394603ba475328d5a3eb71
0925 01:50:12.254844 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.254920 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8624321}
I20260925 01:50:12.255091 11946 ts_tablet_manager.cc:1916] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.255244 11953 tablet_replica.cc:333] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:12.255518 11953 raft_consensus.cc:2243] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:12.255426 11753 raft_consensus.cc:359] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.255616 11753 raft_consensus.cc:385] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.255671 11753 raft_consensus.cc:740] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.255831 11953 raft_consensus.cc:2272] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.255872 11753 consensus_queue.cc:260] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.256410 11953 ts_tablet_manager.cc:1916] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.249085 13321 raft_consensus.cc:493] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:12.258525 13321 raft_consensus.cc:515] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.258822 11753 ts_tablet_manager.cc:1434] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:12.259081 11753 tablet_bootstrap.cc:492] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.259147 13321 leader_election.cc:290] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:12.260634 11753 tablet_bootstrap.cc:654] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.265529 11953 ts_tablet_manager.cc:1929] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:12.266631 11953 log.cc:1199] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/f892954cd22c48aaad2f0e20b1277844
I20260925 01:50:12.267118 11953 ts_tablet_manager.cc:1950] T f892954cd22c48aaad2f0e20b1277844 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:12.267534 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 655) took 8591 ms. Trace:
I20260925 01:50:12.267699 11953 rpcz_store.cc:276] 0925 01:50:03.675986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:03.676051 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:12.255204 (+8579153us) ts_tablet_manager.cc:1151] Deleting tablet f892954cd22c48aaad2f0e20b1277844
0925 01:50:12.255211 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.262392 (+ 7181us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.265477 (+ 3085us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.267515 (+ 2038us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8578969}
I20260925 01:50:12.270555 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 658) took 8104 ms. Trace:
I20260925 01:50:12.274919 11753 tablet_bootstrap.cc:492] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.275146 11753 ts_tablet_manager.cc:1403] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260925 01:50:12.276043 11753 raft_consensus.cc:359] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.276203 11753 raft_consensus.cc:385] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.276252 11753 raft_consensus.cc:740] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.276479 11753 consensus_queue.cc:260] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.277134 11753 ts_tablet_manager.cc:1434] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:12.277392 11753 tablet_bootstrap.cc:492] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.279477 11753 tablet_bootstrap.cc:654] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.282982 11946 ts_tablet_manager.cc:1929] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.283074 11946 log.cc:1199] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/f46004be36b543a395a783a13b1b14cf
I20260925 01:50:12.283351 11946 ts_tablet_manager.cc:1950] T f46004be36b543a395a783a13b1b14cf P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.283669 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 914) took 1496 ms. Trace:
I20260925 01:50:12.283743 11946 rpcz_store.cc:276] 0925 01:50:10.787426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.788368 (+ 942us) service_pool.cc:224] Handling call
0925 01:50:12.254186 (+1465818us) ts_tablet_manager.cc:1151] Deleting tablet f46004be36b543a395a783a13b1b14cf
0925 01:50:12.254197 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.265241 (+ 11044us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.282926 (+ 17685us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.283654 (+ 728us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1465587}
I20260925 01:50:12.284335 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 915) took 1495 ms. Trace:
I20260925 01:50:12.284407 11946 rpcz_store.cc:276] 0925 01:50:10.788719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.788758 (+ 39us) service_pool.cc:224] Handling call
0925 01:50:12.284225 (+1495467us) ts_tablet_manager.cc:1151] Deleting tablet dcbe8d08a1ff4c97a2f9a40d706f4281
0925 01:50:12.284234 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.284322 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1495288}
I20260925 01:50:12.284983 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 935) took 1173 ms. Trace:
I20260925 01:50:12.285056 11946 rpcz_store.cc:276] 0925 01:50:11.111803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.111849 (+ 46us) service_pool.cc:224] Handling call
0925 01:50:12.284902 (+1173053us) ts_tablet_manager.cc:1151] Deleting tablet 031687d4b26b4c7889dfbe3485c9f4c5
0925 01:50:12.284911 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.284966 (+ 55us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1172880}
I20260925 01:50:12.285416 11946 tablet_replica.cc:333] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.285647 11946 raft_consensus.cc:2243] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.285785 11946 raft_consensus.cc:2272] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.286789 11946 ts_tablet_manager.cc:1916] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.288090 11753 tablet_bootstrap.cc:492] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.288380 11753 ts_tablet_manager.cc:1403] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260925 01:50:12.289011 11753 raft_consensus.cc:359] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.289165 11753 raft_consensus.cc:385] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.289212 11753 raft_consensus.cc:740] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.289428 11753 consensus_queue.cc:260] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.289955 11753 ts_tablet_manager.cc:1434] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:12.290225 11753 tablet_bootstrap.cc:492] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.296144 13411 raft_consensus.cc:493] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.296293 13411 raft_consensus.cc:515] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.296942 13411 leader_election.cc:290] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.297338 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728157ec17ed4df5a4a8559df6c1ac78" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.297973 11456 leader_election.cc:343] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.303669 11946 ts_tablet_manager.cc:1929] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.303566 11953 rpcz_store.cc:276] 0925 01:50:04.166407 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.166464 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:12.270391 (+8103927us) ts_tablet_manager.cc:1151] Deleting tablet 2487a41e682740cb83a4281aeef0368a
0925 01:50:12.270405 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.270531 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8103725}
I20260925 01:50:12.303794 11946 log.cc:1199] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/0c01195f07b84b359a974fab5ed52582
I20260925 01:50:12.304159 11946 ts_tablet_manager.cc:1950] T 0c01195f07b84b359a974fab5ed52582 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.304780 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 659) took 8131 ms. Trace:
I20260925 01:50:12.304893 11953 rpcz_store.cc:276] 0925 01:50:04.173181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.173246 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:12.304616 (+8131370us) ts_tablet_manager.cc:1151] Deleting tablet 2957cbd4669749b381f59d1e301a692d
0925 01:50:12.304630 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.304755 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8131176}
I20260925 01:50:12.306564 11753 tablet_bootstrap.cc:654] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.315948 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 933) took 1204 ms. Trace:
I20260925 01:50:12.316076 11946 rpcz_store.cc:276] 0925 01:50:11.111506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.112329 (+ 823us) service_pool.cc:224] Handling call
0925 01:50:12.285375 (+1173046us) ts_tablet_manager.cc:1151] Deleting tablet 0c01195f07b84b359a974fab5ed52582
0925 01:50:12.285383 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.300482 (+ 15099us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.303600 (+ 3118us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.315918 (+ 12318us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1172785}
I20260925 01:50:12.317240 11946 tablet_replica.cc:333] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.317466 11946 raft_consensus.cc:2243] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.317634 11946 raft_consensus.cc:2272] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.318496 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 660) took 8139 ms. Trace:
I20260925 01:50:12.318614 11953 rpcz_store.cc:276] 0925 01:50:04.179077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.179136 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:12.318318 (+8139182us) ts_tablet_manager.cc:1151] Deleting tablet 75014fc54fc7481f83da07e1d96c4370
0925 01:50:12.318331 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.318468 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8138997}
I20260925 01:50:12.319120 11953 tablet_replica.cc:333] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:12.319311 11953 raft_consensus.cc:2243] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.319331 11946 ts_tablet_manager.cc:1916] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.319625 11953 raft_consensus.cc:2272] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.321069 11953 ts_tablet_manager.cc:1916] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.224372 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet f2618c46630c4295949b36f3d0087941 (table default.Table_4dc4550a013e44da8eecc5fc94e0bd3d [id=9084029417354d6a8fd7cbb2b0b68e81]) successfully deleted
W20260925 01:50:12.334290 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 109881us
I20260925 01:50:12.334842 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 31ffb404d93a4436ba9e624b45650fe1 (table default.Table_d7b8d87cdc614126a5b456bfaef70491 [id=a26d8b5cd5b94f7392cd13e13ca79d80]) successfully deleted
W20260925 01:50:12.335132 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2c93bb7a34f94deaa65f8b588c604b81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c93bb7a34f94deaa65f8b588c604b81 already in progress: creating tablet
W20260925 01:50:12.335350 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet fe3627bfb342448591ccaf3d7ab23c4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe3627bfb342448591ccaf3d7ab23c4a already in progress: creating tablet
I20260925 01:50:12.335597 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet f46004be36b543a395a783a13b1b14cf (table default.Table_a0cea089195844d4a3f2e191f31d3750 [id=82de5b3161a5463693e13ea92f4ae6cf]) successfully deleted
W20260925 01:50:12.335848 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcbe8d08a1ff4c97a2f9a40d706f4281 already in progress: creating tablet
W20260925 01:50:12.336087 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 031687d4b26b4c7889dfbe3485c9f4c5 because the tablet was not found. No further retry: Not found: Tablet not found: 031687d4b26b4c7889dfbe3485c9f4c5
I20260925 01:50:12.336318 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 0c01195f07b84b359a974fab5ed52582 (table default.Table_7eb435d3e2ec4209bdd1f04597fcadd8 [id=e93d9881c42d4a51a90c1ffb5fe17930]) successfully deleted
I20260925 01:50:12.302024 11672 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7b590678fd634ad89ee5d6acec384f3b" } modify_external_catalogs: true
I20260925 01:50:12.336676 11672 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7b590678fd634ad89ee5d6acec384f3b" } modify_external_catalogs: true
I20260925 01:50:12.337805 13411 raft_consensus.cc:493] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.337966 13411 raft_consensus.cc:515] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:12.338593 11176 consensus_peers.cc:597] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35b123ac1e894239875404438ed19927. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:12.338654 13411 leader_election.cc:290] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.301977 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3339d70d2a3c4e8fbab219c2001f5430"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.302570 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_72072fbf36e743aa92a12c27cc05bc77" } modify_external_catalogs: true
I20260925 01:50:12.339419 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff70e44b72d1425c81751ff0b3d93b11" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.339478 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_72072fbf36e743aa92a12c27cc05bc77" } modify_external_catalogs: true
I20260925 01:50:12.303233 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a2a3e2f46f664f189955e806cc8c0757"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.340332 11456 leader_election.cc:343] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.344769 11946 ts_tablet_manager.cc:1929] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.345337 11946 log.cc:1199] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/fce91b00d3a14e6398abacad61ff5b0f
I20260925 01:50:12.346235 11946 ts_tablet_manager.cc:1950] T fce91b00d3a14e6398abacad61ff5b0f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.347100 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 934) took 1235 ms. Trace:
I20260925 01:50:12.347769 11946 rpcz_store.cc:276] 0925 01:50:11.111689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.112624 (+ 935us) service_pool.cc:224] Handling call
0925 01:50:12.317181 (+1204557us) ts_tablet_manager.cc:1151] Deleting tablet fce91b00d3a14e6398abacad61ff5b0f
0925 01:50:12.317193 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.331882 (+ 14689us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.344692 (+ 12810us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.347080 (+ 2388us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1204361}
I20260925 01:50:12.348637 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet fce91b00d3a14e6398abacad61ff5b0f (table default.Table_f1000553782a4118a246bbda71eaf618 [id=283f50719ac648e297b59efd4f00941d]) successfully deleted
I20260925 01:50:12.349092 11946 tablet_replica.cc:333] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.349519 11946 raft_consensus.cc:2243] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.350158 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3ba459a81845699435c2e44f5c9f19" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.352029 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e5d28d466741a0a085a4f9938fffd1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.358821 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b6bde824d74acfaaffc23a0b05db8b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.359929 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9462215644a41ccb2f269f64e35392a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:12.150692 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 98a94b6345ca427180e8f4e4b279efcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98a94b6345ca427180e8f4e4b279efcf already in progress: creating tablet
W20260925 01:50:12.360670 11666 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 209926us
W20260925 01:50:12.361430 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 0c01195f07b84b359a974fab5ed52582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c01195f07b84b359a974fab5ed52582 already in progress: creating tablet
W20260925 01:50:12.361811 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 7a5c9dac783d4ef3a24cb65275ff484f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a5c9dac783d4ef3a24cb65275ff484f already in progress: creating tablet
W20260925 01:50:12.362167 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2a3e2f46f664f189955e806cc8c0757 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:12.362176 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1575d0eb9ed64653b317edefd24f7dfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1575d0eb9ed64653b317edefd24f7dfd already in progress: creating tablet
W20260925 01:50:12.362735 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 018f68f800c9489a846c3b1b3ee3fa2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018f68f800c9489a846c3b1b3ee3fa2d already in progress: creating tablet
I20260925 01:50:12.363129 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 6ff85bac0d22416987e8e3b379154b09 (table default.Table_1cdf240ece4148e88d0b728903d255df [id=6ea8e28751c84e1181aa299006fa643f]) successfully deleted
I20260925 01:50:12.367844 13356 ts_tablet_manager.cc:1929] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:12.368214 13356 log.cc:1199] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b61b1bf5a8d446918edc6d166b7712ef
I20260925 01:50:12.369210 13356 ts_tablet_manager.cc:1950] T b61b1bf5a8d446918edc6d166b7712ef P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:12.371308 11754 tablet_bootstrap.cc:492] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:12.371526 11754 ts_tablet_manager.cc:1403] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.238s user 0.004s sys 0.005s
I20260925 01:50:12.372359 11754 raft_consensus.cc:359] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.372649 11754 raft_consensus.cc:385] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.374886 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_43670b6626f54ad98b4b1540fa2d09bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.377090 11946 raft_consensus.cc:2272] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.377717 11946 ts_tablet_manager.cc:1916] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.381143 13411 raft_consensus.cc:493] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.381312 13411 raft_consensus.cc:515] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:12.382086 13411 leader_election.cc:290] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:12.389608 11753 tablet_bootstrap.cc:492] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.389757 11753 ts_tablet_manager.cc:1403] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.100s user 0.013s sys 0.005s
I20260925 01:50:12.390878 11753 raft_consensus.cc:359] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.391119 11753 raft_consensus.cc:385] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.391214 11753 raft_consensus.cc:740] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.391510 11753 consensus_queue.cc:260] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.394410 11753 ts_tablet_manager.cc:1434] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:12.394765 11753 tablet_bootstrap.cc:492] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.397306 11753 tablet_bootstrap.cc:654] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:12.363499 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ea10c9a7e20b48c69eb5f24631403e93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea10c9a7e20b48c69eb5f24631403e93 already in progress: creating tablet
I20260925 01:50:12.398574 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 75a8e09b8838443c9bfff440ff1f877d (table default.Table_4ef5d67e1d2e46ae9ca261d1bc8af3ea [id=22de07c9013f4c3ab9568e926ea5b8c1]) successfully deleted
W20260925 01:50:12.398882 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 49692d2824a34f48a4dcefad8c89618b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49692d2824a34f48a4dcefad8c89618b already in progress: creating tablet
W20260925 01:50:12.399271 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f46004be36b543a395a783a13b1b14cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f46004be36b543a395a783a13b1b14cf already in progress: creating tablet
W20260925 01:50:12.399475 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 728157ec17ed4df5a4a8559df6c1ac78 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 728157ec17ed4df5a4a8559df6c1ac78 already in progress: creating tablet
W20260925 01:50:12.399672 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f92450c05b394603ba475328d5a3eb71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f92450c05b394603ba475328d5a3eb71 already in progress: creating tablet
I20260925 01:50:12.399842 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet f892954cd22c48aaad2f0e20b1277844 (table default.Table_c361990e57274e58b9e99c7086a27792 [id=8dcfe1cef923411faea69f4f694a51e6]) successfully deleted
W20260925 01:50:12.400007 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2487a41e682740cb83a4281aeef0368a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2487a41e682740cb83a4281aeef0368a already in progress: creating tablet
W20260925 01:50:12.400223 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2957cbd4669749b381f59d1e301a692d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2957cbd4669749b381f59d1e301a692d already in progress: creating tablet
W20260925 01:50:12.400388 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 75014fc54fc7481f83da07e1d96c4370 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75014fc54fc7481f83da07e1d96c4370 already in progress: creating tablet
W20260925 01:50:12.400550 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11388be1a8f34e8fa41e64a79b062b29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:12.403178 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3339d70d2a3c4e8fbab219c2001f5430 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.406837 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5e7e88dc65b94eeeb4237ab59d5977e5" } new_table_name: "default.Table_7c7221346e01453b94b67caf6ad2263e" modify_external_catalogs: true
I20260925 01:50:12.409128 11753 tablet_bootstrap.cc:492] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:12.409564 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43670b6626f54ad98b4b1540fa2d09bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.411691 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1d9e0df190b94930b265ce5f2de23d50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.412236 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d9e0df190b94930b265ce5f2de23d50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.414295 11753 ts_tablet_manager.cc:1403] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260925 01:50:12.415182 11753 raft_consensus.cc:359] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.415436 11753 raft_consensus.cc:385] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.415546 11753 raft_consensus.cc:740] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.415853 11753 consensus_queue.cc:260] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.416527 11753 ts_tablet_manager.cc:1434] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260925 01:50:12.416822 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c28a226deca04da6a7a3f7a2b60598bd consensus state has no leader
I20260925 01:50:12.416865 11753 tablet_bootstrap.cc:492] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.417672 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fef5840c829a432aaad089bb8b851e88" } new_table_name: "default.Table_0d2da381fa144ba28afbbf590256ffe8" modify_external_catalogs: true
I20260925 01:50:12.419104 11753 tablet_bootstrap.cc:654] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.373050 11754 raft_consensus.cc:740] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.419843 11754 consensus_queue.cc:260] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.383051 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2f7ef888846ec9667916ba47084db" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.402751 11177 consensus_peers.cc:597] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:12.421110 11456 leader_election.cc:343] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.421095 11946 ts_tablet_manager.cc:1929] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.422206 11946 log.cc:1199] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b4e5d28d466741a0a085a4f9938fffd1
I20260925 01:50:12.422704 11946 ts_tablet_manager.cc:1950] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.424015 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 942) took 1192 ms. Trace:
I20260925 01:50:12.424412 11946 rpcz_store.cc:276] 0925 01:50:11.231436 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.231495 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:12.349039 (+1117544us) ts_tablet_manager.cc:1151] Deleting tablet b4e5d28d466741a0a085a4f9938fffd1
0925 01:50:12.349049 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.398697 (+ 49648us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.421035 (+ 22338us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.423986 (+ 2951us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117320}
I20260925 01:50:12.425065 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b4e5d28d466741a0a085a4f9938fffd1 (table default.Table_bcb7951d232d405aa37610b2feac232d [id=75fabdd6afe3465ea2fa07ac644cda0a]) successfully deleted
I20260925 01:50:12.425101 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f19bccf3c5540cb828ec7bfc89a1c17" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.427896 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 938) took 1197 ms. Trace:
I20260925 01:50:12.428171 11946 rpcz_store.cc:276] 0925 01:50:11.230958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.231629 (+ 671us) service_pool.cc:224] Handling call
0925 01:50:12.427740 (+1196111us) ts_tablet_manager.cc:1151] Deleting tablet 03232387650b450c97c41701b306ac77
0925 01:50:12.427752 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.427876 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1195932}
I20260925 01:50:12.428556 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1d8dce29493342b78a7966e35b2ffa82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.429136 11946 tablet_replica.cc:333] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:12.428896 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 03232387650b450c97c41701b306ac77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03232387650b450c97c41701b306ac77 already in progress: creating tablet
I20260925 01:50:12.429185 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9ec319c6e6fc4eb99b24cd6c3108082b" } new_table_name: "default.Table_7c4b111132a547f59aa83a6b83f1627f" modify_external_catalogs: true
W20260925 01:50:12.429771 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d8dce29493342b78a7966e35b2ffa82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.429806 11946 raft_consensus.cc:2243] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.430263 11946 raft_consensus.cc:2272] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.430951 11946 ts_tablet_manager.cc:1916] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.431012 11754 ts_tablet_manager.cc:1434] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.059s user 0.000s sys 0.002s
I20260925 01:50:12.431768 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2f7ef888846ec9667916ba47084db" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.431828 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff70e44b72d1425c81751ff0b3d93b11" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:12.434661 11457 leader_election.cc:343] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.434792 11457 leader_election.cc:304] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.435060 13411 raft_consensus.cc:2749] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:12.436805 11457 leader_election.cc:343] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.437032 11457 leader_election.cc:304] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:12.437201 11457 raft_consensus.cc:2686] T b4e5d28d466741a0a085a4f9938fffd1 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:12.441232 11754 tablet_bootstrap.cc:492] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:12.443255 11946 ts_tablet_manager.cc:1929] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.443370 11946 log.cc:1199] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/81024a75b31e45e098d108bae4cc17c9
I20260925 01:50:12.443728 11946 ts_tablet_manager.cc:1950] T 81024a75b31e45e098d108bae4cc17c9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.443823 11754 tablet_bootstrap.cc:654] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.444474 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 940) took 1213 ms. Trace:
I20260925 01:50:12.444571 11946 rpcz_store.cc:276] 0925 01:50:11.231205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.231845 (+ 640us) service_pool.cc:224] Handling call
0925 01:50:12.429085 (+1197240us) ts_tablet_manager.cc:1151] Deleting tablet 81024a75b31e45e098d108bae4cc17c9
0925 01:50:12.429095 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.439489 (+ 10394us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.443197 (+ 3708us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.444452 (+ 1255us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1197075}
W20260925 01:50:12.444965 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0554adf2d9a4ce1a25586367cb7e66f consensus state has no leader
I20260925 01:50:12.445078 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 81024a75b31e45e098d108bae4cc17c9 (table default.Table_e2abaeb692e1458dacd8e8bab6cf101f [id=3a20320201fe4834bd86c120b86856a8]) successfully deleted
I20260925 01:50:12.446000 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_93ee32c298354a5bbb21cb437993fe10" } modify_external_catalogs: true
I20260925 01:50:12.446291 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_93ee32c298354a5bbb21cb437993fe10" } modify_external_catalogs: true
I20260925 01:50:12.448930 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 883) took 2888 ms. Trace:
I20260925 01:50:12.449046 13356 rpcz_store.cc:276] 0925 01:50:09.560741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.560797 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:12.061284 (+2500487us) ts_tablet_manager.cc:1151] Deleting tablet b61b1bf5a8d446918edc6d166b7712ef
0925 01:50:12.061299 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.227604 (+166305us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.367776 (+140172us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.448889 (+ 81113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2500300}
I20260925 01:50:12.449692 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 884) took 2886 ms. Trace:
I20260925 01:50:12.449791 13356 rpcz_store.cc:276] 0925 01:50:09.562744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.562823 (+ 79us) service_pool.cc:224] Handling call
0925 01:50:12.449536 (+2886713us) ts_tablet_manager.cc:1151] Deleting tablet 8b2eed649c6f447d8f9af98637061af1
0925 01:50:12.449549 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.449674 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2886527}
I20260925 01:50:12.450351 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 887) took 2806 ms. Trace:
I20260925 01:50:12.450429 13356 rpcz_store.cc:276] 0925 01:50:09.643714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.646094 (+ 2380us) service_pool.cc:224] Handling call
0925 01:50:12.450245 (+2804151us) ts_tablet_manager.cc:1151] Deleting tablet db1339652d744cda9215d84e846d1e8e
0925 01:50:12.450254 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.450332 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2797235}
I20260925 01:50:12.450837 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 888) took 2778 ms. Trace:
I20260925 01:50:12.450927 13356 rpcz_store.cc:276] 0925 01:50:09.671957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.672025 (+ 68us) service_pool.cc:224] Handling call
0925 01:50:12.450751 (+2778726us) ts_tablet_manager.cc:1151] Deleting tablet 86f3f75784af42f6b14b919815ab1890
0925 01:50:12.450760 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.450824 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2778502}
I20260925 01:50:12.451719 11946 tablet_replica.cc:333] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.451920 11946 raft_consensus.cc:2243] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:12.449524 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b61b1bf5a8d446918edc6d166b7712ef (table default.Table_91355e6a2a11467f8375581add0caae9 [id=350f9fe5f3ae4c419ac210a46eb8d38e]) successfully deleted
W20260925 01:50:12.452937 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 8b2eed649c6f447d8f9af98637061af1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2eed649c6f447d8f9af98637061af1 already in progress: creating tablet
W20260925 01:50:12.453297 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet db1339652d744cda9215d84e846d1e8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db1339652d744cda9215d84e846d1e8e already in progress: creating tablet
W20260925 01:50:12.453593 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 86f3f75784af42f6b14b919815ab1890 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f3f75784af42f6b14b919815ab1890 already in progress: creating tablet
I20260925 01:50:12.452191 11946 raft_consensus.cc:2272] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.459348 11946 ts_tablet_manager.cc:1916] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.462323 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 890) took 2714 ms. Trace:
I20260925 01:50:12.462445 13356 rpcz_store.cc:276] 0925 01:50:09.747800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.748345 (+ 545us) service_pool.cc:224] Handling call
0925 01:50:12.462147 (+2713802us) ts_tablet_manager.cc:1151] Deleting tablet f4533c3500a3431ca6ef5f23b0cf6830
0925 01:50:12.462159 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.462295 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2674890}
I20260925 01:50:12.462886 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 912) took 2475 ms. Trace:
I20260925 01:50:12.462977 13356 rpcz_store.cc:276] 0925 01:50:09.987507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.988600 (+ 1093us) service_pool.cc:224] Handling call
0925 01:50:12.462768 (+2474168us) ts_tablet_manager.cc:1151] Deleting tablet bb9ce40cb55d4f90b3c333b55bc5fe18
0925 01:50:12.462780 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.462870 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448601}
W20260925 01:50:12.463173 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f4533c3500a3431ca6ef5f23b0cf6830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4533c3500a3431ca6ef5f23b0cf6830 already in progress: creating tablet
I20260925 01:50:12.463512 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 918) took 2467 ms. Trace:
W20260925 01:50:12.463578 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb9ce40cb55d4f90b3c333b55bc5fe18 already in progress: creating tablet
I20260925 01:50:12.463634 13356 rpcz_store.cc:276] 0925 01:50:09.996509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.014196 (+ 17687us) service_pool.cc:224] Handling call
0925 01:50:12.463391 (+2449195us) ts_tablet_manager.cc:1151] Deleting tablet f8ffc45058774a878d4b802400feecb7
0925 01:50:12.463401 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.463493 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2449011}
W20260925 01:50:12.464154 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f8ffc45058774a878d4b802400feecb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8ffc45058774a878d4b802400feecb7 already in progress: creating tablet
I20260925 01:50:12.465658 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 919) took 2468 ms. Trace:
I20260925 01:50:12.465749 13356 rpcz_store.cc:276] 0925 01:50:09.997658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.014391 (+ 16733us) service_pool.cc:224] Handling call
0925 01:50:12.465549 (+2451158us) ts_tablet_manager.cc:1151] Deleting tablet 532e290a0db34fbfab0328ca8f8d1e6c
0925 01:50:12.465558 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.465639 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2451019}
W20260925 01:50:12.466289 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 532e290a0db34fbfab0328ca8f8d1e6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532e290a0db34fbfab0328ca8f8d1e6c already in progress: creating tablet
I20260925 01:50:12.467183 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 915) took 2474 ms. Trace:
I20260925 01:50:12.467633 13356 rpcz_store.cc:276] 0925 01:50:09.992529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.992584 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:12.467076 (+2474492us) ts_tablet_manager.cc:1151] Deleting tablet 0258eac5971842878c62326952115490
0925 01:50:12.467085 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.467166 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2440767}
I20260925 01:50:12.468142 13356 tablet_replica.cc:333] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
W20260925 01:50:12.468575 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 0258eac5971842878c62326952115490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0258eac5971842878c62326952115490 already in progress: creating tablet
I20260925 01:50:12.469064 13356 raft_consensus.cc:2243] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:50:12.469301 11457 leader_election.cc:343] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.469437 13356 raft_consensus.cc:2272] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.469465 11457 leader_election.cc:304] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.469786 13411 raft_consensus.cc:2749] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.470105 13356 ts_tablet_manager.cc:1916] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.472376 11946 ts_tablet_manager.cc:1929] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:12.472508 11946 log.cc:1199] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b97f703869d4471cb940ef654203ec2b
I20260925 01:50:12.473048 11946 ts_tablet_manager.cc:1950] T b97f703869d4471cb940ef654203ec2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.473939 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 941) took 1242 ms. Trace:
I20260925 01:50:12.474038 11946 rpcz_store.cc:276] 0925 01:50:11.231318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.232061 (+ 743us) service_pool.cc:224] Handling call
0925 01:50:12.451667 (+1219606us) ts_tablet_manager.cc:1151] Deleting tablet b97f703869d4471cb940ef654203ec2b
0925 01:50:12.451678 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.463564 (+ 11886us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.472318 (+ 8754us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.473916 (+ 1598us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1219479}
I20260925 01:50:12.474581 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b97f703869d4471cb940ef654203ec2b (table default.Table_508d50254458453d8ce5ae125aa65da5 [id=e9edf18c4d10412cb249878f4a94e7d3]) successfully deleted
I20260925 01:50:12.479300 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 944) took 1246 ms. Trace:
I20260925 01:50:12.479837 11946 rpcz_store.cc:276] 0925 01:50:11.232373 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.232414 (+ 41us) service_pool.cc:224] Handling call
0925 01:50:12.479154 (+1246740us) ts_tablet_manager.cc:1151] Deleting tablet 61c1181b38a247e79bd7a6355950881e
0925 01:50:12.479165 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.479278 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246608}
W20260925 01:50:12.480752 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 61c1181b38a247e79bd7a6355950881e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61c1181b38a247e79bd7a6355950881e already in progress: creating tablet
I20260925 01:50:12.481422 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 937) took 1250 ms. Trace:
I20260925 01:50:12.481848 11946 rpcz_store.cc:276] 0925 01:50:11.230715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.230793 (+ 78us) service_pool.cc:224] Handling call
0925 01:50:12.481249 (+1250456us) ts_tablet_manager.cc:1151] Deleting tablet 681356bc659f4ca990cd2ffc0c10b533
0925 01:50:12.481262 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.481403 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1242932}
W20260925 01:50:12.482558 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 681356bc659f4ca990cd2ffc0c10b533 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 681356bc659f4ca990cd2ffc0c10b533 already in progress: creating tablet
I20260925 01:50:12.483036 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 939) took 1251 ms. Trace:
I20260925 01:50:12.483484 11946 rpcz_store.cc:276] 0925 01:50:11.231104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.275247 (+ 44143us) service_pool.cc:224] Handling call
0925 01:50:12.482930 (+1207683us) ts_tablet_manager.cc:1151] Deleting tablet dceeedf3471d45508f025e7a4c7f73f2
0925 01:50:12.482939 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.483020 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207099}
W20260925 01:50:12.484227 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet dceeedf3471d45508f025e7a4c7f73f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dceeedf3471d45508f025e7a4c7f73f2 already in progress: creating tablet
I20260925 01:50:12.484666 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 945) took 1184 ms. Trace:
I20260925 01:50:12.484995 11946 rpcz_store.cc:276] 0925 01:50:11.300575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.300768 (+ 193us) service_pool.cc:224] Handling call
0925 01:50:12.484570 (+1183802us) ts_tablet_manager.cc:1151] Deleting tablet e5bc61637d944b60ba9e703e9894174c
0925 01:50:12.484579 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.484651 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1183585}
W20260925 01:50:12.485819 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e5bc61637d944b60ba9e703e9894174c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5bc61637d944b60ba9e703e9894174c already in progress: creating tablet
I20260925 01:50:12.486253 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 946) took 1181 ms. Trace:
I20260925 01:50:12.486654 11946 rpcz_store.cc:276] 0925 01:50:11.304894 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.304955 (+ 61us) service_pool.cc:224] Handling call
0925 01:50:12.486160 (+1181205us) ts_tablet_manager.cc:1151] Deleting tablet dc00e20861c54760ac8409c54abd1795
0925 01:50:12.486169 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.486238 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1180937}
W20260925 01:50:12.487464 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet dc00e20861c54760ac8409c54abd1795 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc00e20861c54760ac8409c54abd1795 already in progress: creating tablet
I20260925 01:50:12.487895 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 948) took 1181 ms. Trace:
I20260925 01:50:12.488256 11946 rpcz_store.cc:276] 0925 01:50:11.306184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.327463 (+ 21279us) service_pool.cc:224] Handling call
0925 01:50:12.487798 (+1160335us) ts_tablet_manager.cc:1151] Deleting tablet 1b4f58554cb84a08a3fdf14cb279ca56
0925 01:50:12.487808 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.487879 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1160047}
W20260925 01:50:12.489106 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1b4f58554cb84a08a3fdf14cb279ca56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b4f58554cb84a08a3fdf14cb279ca56 already in progress: creating tablet
I20260925 01:50:12.489471 11946 tablet_replica.cc:333] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.489856 11946 raft_consensus.cc:2243] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.490303 11946 raft_consensus.cc:2272] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.491052 11946 ts_tablet_manager.cc:1916] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.491214 13411 raft_consensus.cc:493] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.491807 13411 raft_consensus.cc:515] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.492604 13411 leader_election.cc:290] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.431281 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6715233be44b9aad5210d17500f59d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.431682 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728157ec17ed4df5a4a8559df6c1ac78" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.499114 13411 raft_consensus.cc:493] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.499241 13411 raft_consensus.cc:515] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.499804 13411 leader_election.cc:290] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.502329 11946 ts_tablet_manager.cc:1929] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.502466 11946 log.cc:1199] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/9771b89303094974902c4ad1f1c8608e
I20260925 01:50:12.502941 11946 ts_tablet_manager.cc:1950] T 9771b89303094974902c4ad1f1c8608e P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:12.503132 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 162a3ebad091460b9d424c83df6c54a0 consensus state has no leader
I20260925 01:50:12.503948 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 953) took 1103 ms. Trace:
I20260925 01:50:12.504070 11946 rpcz_store.cc:276] 0925 01:50:11.400977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.401057 (+ 80us) service_pool.cc:224] Handling call
0925 01:50:12.489427 (+1088370us) ts_tablet_manager.cc:1151] Deleting tablet 9771b89303094974902c4ad1f1c8608e
0925 01:50:12.489436 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.494777 (+ 5341us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.502255 (+ 7478us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.503922 (+ 1667us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1018192}
I20260925 01:50:12.504457 11946 tablet_replica.cc:333] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.504593 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 9771b89303094974902c4ad1f1c8608e (table default.Table_b2c0a186ead548bca5ccee40cb8df40f [id=0715eef3ce6a4fa292556da81676ed28]) successfully deleted
I20260925 01:50:12.504665 11946 raft_consensus.cc:2243] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.504839 11946 raft_consensus.cc:2272] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:12.504873 11457 leader_election.cc:343] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.505213 11457 leader_election.cc:304] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.505527 11946 ts_tablet_manager.cc:1916] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.505715 13412 raft_consensus.cc:2749] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.511301 13411 raft_consensus.cc:493] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.511435 13411 raft_consensus.cc:515] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.512048 13411 leader_election.cc:290] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:12.513083 11457 leader_election.cc:343] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.513265 11457 leader_election.cc:304] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.513844 13412 raft_consensus.cc:2749] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:12.515771 11314 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:12.516376 11946 ts_tablet_manager.cc:1929] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.516518 11946 log.cc:1199] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8afcf8f6d0e24472a3190059df032698
I20260925 01:50:12.517060 11946 ts_tablet_manager.cc:1950] T 8afcf8f6d0e24472a3190059df032698 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:12.517556 11314 leader_election.cc:343] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 93329036763146beb8e6a9b039cc1ec1
I20260925 01:50:12.518095 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 954) took 1105 ms. Trace:
I20260925 01:50:12.518211 11946 rpcz_store.cc:276] 0925 01:50:11.413038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.413124 (+ 86us) service_pool.cc:224] Handling call
0925 01:50:12.504407 (+1091283us) ts_tablet_manager.cc:1151] Deleting tablet 8afcf8f6d0e24472a3190059df032698
0925 01:50:12.504419 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.511662 (+ 7243us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.516310 (+ 4648us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.518049 (+ 1739us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24,"tablet-delete.queue_time_us":1031460}
I20260925 01:50:12.518674 11946 tablet_replica.cc:333] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.518931 11946 raft_consensus.cc:2243] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.518951 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8afcf8f6d0e24472a3190059df032698 (table default.Table_77556b8645c143cba6b3bee14942c58b [id=749545cadfbc47f3a12a9d327cfda9ff]) successfully deleted
I20260925 01:50:12.519098 11946 raft_consensus.cc:2272] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.519730 11946 ts_tablet_manager.cc:1916] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:12.523205 11314 leader_election.cc:343] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 519d954b6a214d0b8e960e128cfcea10
I20260925 01:50:12.527635 11946 ts_tablet_manager.cc:1929] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.527673 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_76ddcad4f1a84ce599a5c29562a9ae9b" } modify_external_catalogs: true
I20260925 01:50:12.527784 11946 log.cc:1199] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/4f19bccf3c5540cb828ec7bfc89a1c17
I20260925 01:50:12.527885 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_76ddcad4f1a84ce599a5c29562a9ae9b" } modify_external_catalogs: true
I20260925 01:50:12.528185 11946 ts_tablet_manager.cc:1950] T 4f19bccf3c5540cb828ec7bfc89a1c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.529489 11946 tablet_replica.cc:333] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.529685 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 4f19bccf3c5540cb828ec7bfc89a1c17 (table default.Table_ec6a77ed80f04e6d8eaa7f81d505133f [id=0f94e9a1c0e44ed2a4fe40673de847db]) successfully deleted
I20260925 01:50:12.529765 11946 raft_consensus.cc:2243] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.529932 11946 raft_consensus.cc:2272] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.530627 11946 ts_tablet_manager.cc:1916] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.534093 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5f04dbdc3964422c9966d0a6449ba013" } new_table_name: "default.Table_06e8af2441024994ac91b6361c7d2e5e" modify_external_catalogs: true
I20260925 01:50:12.541865 11946 ts_tablet_manager.cc:1929] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.542027 11946 log.cc:1199] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/0e3ba459a81845699435c2e44f5c9f19
I20260925 01:50:12.542321 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet ae948bf42ae34a7ab72112d5f1f02585 with delete_type TABLET_DATA_DELETED (replaced by tablet aaa2f7ef888846ec9667916ba47084db) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.542516 11946 ts_tablet_manager.cc:1950] T 0e3ba459a81845699435c2e44f5c9f19 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.543917 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 0e3ba459a81845699435c2e44f5c9f19 (table default.Table_d143a5ee928e48efae3ed675e65f4871 [id=bf9b5cb2e68745dabd9184ea927e76a6]) successfully deleted
W20260925 01:50:12.544883 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b81a0f0e096f4bdaaedb2122c3487079 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b81a0f0e096f4bdaaedb2122c3487079 already in progress: creating tablet
I20260925 01:50:12.545362 11946 tablet_replica.cc:333] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.545696 11946 raft_consensus.cc:2243] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.545933 11946 raft_consensus.cc:2272] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.546676 11946 ts_tablet_manager.cc:1916] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.548934 13412 raft_consensus.cc:493] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.549113 13412 raft_consensus.cc:515] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.549853 13412 leader_election.cc:290] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:12.550876 11314 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:12.551061 11314 leader_election.cc:304] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.551343 13321 raft_consensus.cc:2749] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:12.552119 11314 leader_election.cc:343] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 519d954b6a214d0b8e960e128cfcea10
I20260925 01:50:12.552284 11314 leader_election.cc:304] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.552599 13321 raft_consensus.cc:2749] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:12.552995 11314 leader_election.cc:343] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 93329036763146beb8e6a9b039cc1ec1
I20260925 01:50:12.553290 11314 leader_election.cc:304] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.553735 13321 raft_consensus.cc:2749] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:12.555622 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1cd17f1ecead409ab7b54c2120476a3b
I20260925 01:50:12.556258 11680 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60372 (request call id 1109) took 1145 ms. Trace:
I20260925 01:50:12.556798 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cd17f1ecead409ab7b54c2120476a3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.556388 11680 rpcz_store.cc:276] 0925 01:50:11.410409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.879457 (+469048us) service_pool.cc:224] Handling call
0925 01:50:11.880067 (+ 610us) catalog_manager.cc:2432] Looking up, locking, and authorizing table
0925 01:50:11.880210 (+ 143us) catalog_manager.cc:2854] Modifying in-memory table state
0925 01:50:11.880277 (+ 67us) catalog_manager.cc:2863] Locking tablets
0925 01:50:12.517259 (+636982us) catalog_manager.cc:2877] Removing table and tablets from system table
0925 01:50:12.555376 (+ 38117us) catalog_manager.cc:2895] Removing table from by-name map
0925 01:50:12.555486 (+ 110us) catalog_manager.cc:2911] Committing in-memory state
0925 01:50:12.555531 (+ 45us) catalog_manager.cc:2915] Aborting table tasks
0925 01:50:12.556204 (+ 673us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0925 01:50:12.520210 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 01:50:12.520337 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0925 01:50:12.520344 (+ 7us) write_op.cc:435] Acquired schema lock
0925 01:50:12.520347 (+ 3us) tablet.cc:662] Decoding operations
0925 01:50:12.520461 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0925 01:50:12.520474 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0925 01:50:12.520479 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0925 01:50:12.520595 (+ 116us) tablet.cc:701] Row locks acquired
0925 01:50:12.520598 (+ 3us) write_op.cc:260] PREPARE: finished
0925 01:50:12.520639 (+ 41us) write_op.cc:270] Start()
0925 01:50:12.520674 (+ 35us) write_op.cc:276] Timestamp: P: 1790301012520585 usec, L: 0
0925 01:50:12.520678 (+ 4us) op_driver.cc:348] REPLICATION: starting
0925 01:50:12.530976 (+ 10298us) log.cc:844] Serialized 734 byte log entry
0925 01:50:12.531817 (+ 841us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x616000040c54. stack: 00007f46baf1d5c6 00007f46baf1d380 00007f46b9f2534d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f46c6fe71b2 00007f46c8404f55 00007f46c8403a79 00007f46c840bea0 00007f46c840bcad 0000000000aaef9c 00007f46baf63aef 00007f46baf66deb 00007f46baf66c68 0000000000aaef9c
0925 01:50:12.543425 (+ 11608us) op_driver.cc:464] REPLICATION: finished
0925 01:50:12.545840 (+ 2415us) write_op.cc:301] APPLY: starting
0925 01:50:12.545858 (+ 18us) tablet.cc:1394] starting BulkCheckPresence
0925 01:50:12.545901 (+ 43us) tablet.cc:1397] finished BulkCheckPresence
0925 01:50:12.545903 (+ 2us) tablet.cc:1399] starting ApplyRowOperation cycle
0925 01:50:12.545976 (+ 73us) tablet.cc:1410] finished ApplyRowOperation cycle
0925 01:50:12.546009 (+ 33us) tablet_metrics.cc:600] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0925 01:50:12.546016 (+ 7us) write_op.cc:312] APPLY: finished
0925 01:50:12.554973 (+ 8957us) log.cc:844] Serialized 29 byte log entry
0925 01:50:12.555253 (+ 280us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:12.555278 (+ 25us) write_op.cc:454] Released schema lock
0925 01:50:12.555286 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0925 01:50:12.555370 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0925 01:50:12.555374 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2338,"apply.run_cpu_time_us":489,"apply.run_wall_time_us":9528,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":1249,"prepare.run_wall_time_us":12502,"raft.queue_time_us":49,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":270,"replication_time_us":22709,"spinlock_wait_cycles":23179648}]]}
I20260925 01:50:12.557417 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9765e66a22054b0a936048c1e6fbbb61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.559957 11946 ts_tablet_manager.cc:1929] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.560102 11946 log.cc:1199] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/86c8c3bba9614539bfe3018461ad21f8
I20260925 01:50:12.560256 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cd17f1ecead409ab7b54c2120476a3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.560464 11946 ts_tablet_manager.cc:1950] T 86c8c3bba9614539bfe3018461ad21f8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.561596 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 86c8c3bba9614539bfe3018461ad21f8 (table default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]) successfully deleted
W20260925 01:50:12.561754 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9765e66a22054b0a936048c1e6fbbb61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:12.562412 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet f30fbaa9db5144debf9cc5124c9bf9bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f30fbaa9db5144debf9cc5124c9bf9bd already in progress: creating tablet
I20260925 01:50:12.562707 11946 tablet_replica.cc:333] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.562903 11946 raft_consensus.cc:2243] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.563082 11946 raft_consensus.cc:2272] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.563709 11946 ts_tablet_manager.cc:1916] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.570006 11946 ts_tablet_manager.cc:1929] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:12.570233 11946 log.cc:1199] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e95fb28febd94a26ba9682fb9a462872
I20260925 01:50:12.570616 11946 ts_tablet_manager.cc:1950] T e95fb28febd94a26ba9682fb9a462872 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.571791 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]) successfully deleted
I20260925 01:50:12.572242 11946 tablet_replica.cc:333] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.572458 11946 raft_consensus.cc:2243] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.572664 11946 raft_consensus.cc:2272] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.572700 11677 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:12.573079 11677 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet e7b6bde824d74acfaaffc23a0b05db8b (table default.Table_c0c2a440fcfd4cdc8f97e52a83a31318 [id=2a9ff32ac39e45a898876d49c1332249]). Expected version 1 got 0
I20260925 01:50:12.574136 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 824719105840401cb518dd5eea76f229 (DEFAULT_TABLE table=default.Table_3f06c30890b148468b29c92d1e399bbd [id=90c985ac68bf4e659f4cc97180e2b37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.574527 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824719105840401cb518dd5eea76f229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.574574 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 824719105840401cb518dd5eea76f229 (DEFAULT_TABLE table=default.Table_3f06c30890b148468b29c92d1e399bbd [id=90c985ac68bf4e659f4cc97180e2b37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.574936 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824719105840401cb518dd5eea76f229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.575688 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d28dc51fc345487ba74c56b9b8f1ad42
I20260925 01:50:12.576416 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_31382de7dc454cf59b1075bd3d55ac9b" } new_table_name: "default.Table_30e92d3ebe9c4a86a4a48c57f7e2903e" modify_external_catalogs: true
I20260925 01:50:12.578838 13321 raft_consensus.cc:493] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.578958 13321 raft_consensus.cc:515] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.579572 13321 leader_election.cc:290] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:12.579797 11487 tablet_service.cc:1511] Processing CreateTablet for tablet accbd2dcbe004599a274a919e0958223 (DEFAULT_TABLE table=default.Table_c4ac9dcad4044cb582e5536c7213a978 [id=0968fe5b72cc42de9e664e3131624371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.579869 11496 tablet_service.cc:1511] Processing CreateTablet for tablet fc26097a2b7a410bb15ae730ccb9c1b7 (DEFAULT_TABLE table=default.Table_f00ae318500247e78454967ad6f6b04c [id=44b84677194e41f589fe65a5bfb51b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.579895 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3c2124ce2a4f51b45db17a38775462 (DEFAULT_TABLE table=default.Table_b7548999462a4a90b7843382fc8adc0c [id=e7f33360a18343ea891fe6c77af425dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.580062 11501 tablet_service.cc:1558] Processing DeleteTablet for tablet d28dc51fc345487ba74c56b9b8f1ad42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.580190 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet accbd2dcbe004599a274a919e0958223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.581329 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3c2124ce2a4f51b45db17a38775462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.581432 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a8d3b4ec14d5457eb0d0d364904e755d
I20260925 01:50:12.581880 11678 catalog_manager.cc:6934] ReplaceTablet: tablet a8d3b4ec14d5457eb0d0d364904e755d deleted and replaced by tablet d6f1ff7274a64bcd909d3f84d2b37163
I20260925 01:50:12.582280 11492 tablet_service.cc:1511] Processing CreateTablet for tablet f19d53f59bda4a63afe554d7f8bffa47 (DEFAULT_TABLE table=default.Table_d9319bb3e508473686691911e58a49cf [id=1d3e823b288041e29121f0ca31c3ff7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.582311 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_be3d5d08cb224209b54b3d5ec64152db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.582581 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d53f59bda4a63afe554d7f8bffa47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:12.582858 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be3d5d08cb224209b54b3d5ec64152db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.584218 13412 raft_consensus.cc:493] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.584348 13412 raft_consensus.cc:515] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.584259 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc26097a2b7a410bb15ae730ccb9c1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.584965 13412 leader_election.cc:290] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.586210 11676 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf] alter complete (version 2)
I20260925 01:50:12.587311 11946 ts_tablet_manager.cc:1916] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.587584 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_54a0e9bc29834eb89498d7b09ce78d6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.588160 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54a0e9bc29834eb89498d7b09ce78d6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.589664 11753 tablet_bootstrap.cc:492] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.589789 11753 ts_tablet_manager.cc:1403] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.173s user 0.029s sys 0.049s
I20260925 01:50:12.590407 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet a8d3b4ec14d5457eb0d0d364904e755d with delete_type TABLET_DATA_DELETED (replaced by tablet d6f1ff7274a64bcd909d3f84d2b37163) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.590617 11753 raft_consensus.cc:359] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.590772 11753 raft_consensus.cc:385] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.590831 11753 raft_consensus.cc:740] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.591027 11753 consensus_queue.cc:260] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.591388 11350 tablet_service.cc:1511] Processing CreateTablet for tablet fc26097a2b7a410bb15ae730ccb9c1b7 (DEFAULT_TABLE table=default.Table_f00ae318500247e78454967ad6f6b04c [id=44b84677194e41f589fe65a5bfb51b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.591555 11753 ts_tablet_manager.cc:1434] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:12.591786 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc26097a2b7a410bb15ae730ccb9c1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.591830 11753 tablet_bootstrap.cc:492] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.591892 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 7c617bb54bb1440eb468689f122e83a6 (DEFAULT_TABLE table=default.Table_6821b0e5714046c69acfc48f4d0bc8d9 [id=e0bf032402504142a3096c8b3d198890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.592201 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c617bb54bb1440eb468689f122e83a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.593444 11753 tablet_bootstrap.cc:654] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.594329 11342 tablet_service.cc:1511] Processing CreateTablet for tablet accbd2dcbe004599a274a919e0958223 (DEFAULT_TABLE table=default.Table_c4ac9dcad4044cb582e5536c7213a978 [id=0968fe5b72cc42de9e664e3131624371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.594651 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet accbd2dcbe004599a274a919e0958223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.595487 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3c2124ce2a4f51b45db17a38775462 (DEFAULT_TABLE table=default.Table_b7548999462a4a90b7843382fc8adc0c [id=e7f33360a18343ea891fe6c77af425dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.595834 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet d28dc51fc345487ba74c56b9b8f1ad42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.596139 11347 tablet_service.cc:1511] Processing CreateTablet for tablet f19d53f59bda4a63afe554d7f8bffa47 (DEFAULT_TABLE table=default.Table_d9319bb3e508473686691911e58a49cf [id=1d3e823b288041e29121f0ca31c3ff7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.596452 11351 tablet_service.cc:1558] Processing DeleteTablet for tablet a8d3b4ec14d5457eb0d0d364904e755d with delete_type TABLET_DATA_DELETED (replaced by tablet d6f1ff7274a64bcd909d3f84d2b37163) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.596715 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 7c617bb54bb1440eb468689f122e83a6 (DEFAULT_TABLE table=default.Table_6821b0e5714046c69acfc48f4d0bc8d9 [id=e0bf032402504142a3096c8b3d198890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.597819 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c33214035c564fd88b2b0a1d079edd8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.598449 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c33214035c564fd88b2b0a1d079edd8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.598549 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet 915b1621cea64c03bd486ef32e815f5f from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:12.600630 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e1480131c1e74536b5f3fa54764dc4f3
W20260925 01:50:12.602569 11457 leader_election.cc:343] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.602581 11351 tablet_service.cc:1511] Processing CreateTablet for tablet fdc26312580742a8a01b897e551a3a3d (DEFAULT_TABLE table=default.Table_7b590678fd634ad89ee5d6acec384f3b [id=9d54b28f524e4b83a5309b69bc4e0b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.602690 11457 leader_election.cc:304] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.603402 13412 raft_consensus.cc:2749] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.603549 11501 tablet_service.cc:1511] Processing CreateTablet for tablet fdc26312580742a8a01b897e551a3a3d (DEFAULT_TABLE table=default.Table_7b590678fd634ad89ee5d6acec384f3b [id=9d54b28f524e4b83a5309b69bc4e0b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.603960 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc26312580742a8a01b897e551a3a3d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:12.604058 11457 leader_election.cc:343] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.604168 11457 leader_election.cc:304] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.604507 13412 raft_consensus.cc:2749] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:12.605959 11457 leader_election.cc:343] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.606050 11457 leader_election.cc:304] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.606228 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet e1480131c1e74536b5f3fa54764dc4f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.606390 13412 raft_consensus.cc:2749] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.606552 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet e1480131c1e74536b5f3fa54764dc4f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:12.606859 11457 leader_election.cc:343] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.606951 11457 leader_election.cc:304] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.607295 13411 raft_consensus.cc:2749] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.622305 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fdc26312580742a8a01b897e551a3a3d
I20260925 01:50:12.622453 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9513d1d55fe846f5b1a2b7d315209002" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.622974 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0749a0ae58df4ff8b74a86f072332fad" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.623158 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a5de1a12493e459a962b2fd1dadda16e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.623268 13412 raft_consensus.cc:493] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.623430 13412 raft_consensus.cc:515] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.623842 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc26312580742a8a01b897e551a3a3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.624066 13412 leader_election.cc:290] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.624442 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33967e5e11524b78bb86ce7a3e2e16ad" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:12.624964 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5de1a12493e459a962b2fd1dadda16e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.625036 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc26312580742a8a01b897e551a3a3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.625833 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b92054aaa704c7ebd6b075c30db2616" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.630239 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7da05066834173bd01ffcc00a5095e (DEFAULT_TABLE table=default.Table_fd97f72498c3402e89e99df9815178db [id=22819c00a7d045129848b63bfd27b8c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.630690 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341dca6f396449daadcaf8bbb77ed04b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.631959 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5048a0fca2e64ffa9f19000f48a4c090" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:12.633324 11457 leader_election.cc:343] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.633805 11457 leader_election.cc:343] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.634248 11457 leader_election.cc:343] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.634650 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 03487a3fa9574fd583d9c95d0624203c
W20260925 01:50:12.634680 11457 leader_election.cc:343] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.636495 11457 leader_election.cc:343] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.636960 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e8a2afd07254a16927a4db800985237 consensus state has no leader
I20260925 01:50:12.638581 11753 tablet_bootstrap.cc:492] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:12.639616 13412 raft_consensus.cc:493] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.639727 13412 raft_consensus.cc:515] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.640300 13412 leader_election.cc:290] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.654357 11755 tablet_bootstrap.cc:492] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:12.654506 11755 ts_tablet_manager.cc:1403] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.538s user 0.003s sys 0.010s
I20260925 01:50:12.655304 11755 raft_consensus.cc:359] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:12.655580 11755 raft_consensus.cc:385] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.655717 11755 raft_consensus.cc:740] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.656080 11755 consensus_queue.cc:260] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:12.638718 11753 ts_tablet_manager.cc:1403] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.003s
I20260925 01:50:12.661329 11753 raft_consensus.cc:359] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.661561 11753 raft_consensus.cc:385] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.661643 11753 raft_consensus.cc:740] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.662328 11753 consensus_queue.cc:260] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.663472 11753 ts_tablet_manager.cc:1434] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:12.664034 11753 tablet_bootstrap.cc:492] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.666862 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 with delete_type TABLET_DATA_DELETED (replaced by tablet 03487a3fa9574fd583d9c95d0624203c) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.667065 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.667375 11494 tablet_service.cc:1511] Processing CreateTablet for tablet d968b35807db4db3a13c7625202d7e0f (DEFAULT_TABLE table=default.Table_3e3c0d82d2f6449f835a8db116eb1f08 [id=881f7a8eaffd4b68b85f8fcf70f8d94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.667483 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet e40083a885974e3595ec2fb5b16d4a5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.667568 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 05213c1723664f5b8ec35faeec7988f2 (DEFAULT_TABLE table=default.Table_1308e456be4643dd8d055b56b014a0e0 [id=8f77f23e3f884b53a5a50def4e5c4b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.637364 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_78e368302b404cfbba593121c96fafe1" } new_table_name: "default.Table_22ccb6469f34453cba597d0d922fe631" modify_external_catalogs: true
I20260925 01:50:12.667766 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d968b35807db4db3a13c7625202d7e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.667933 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05213c1723664f5b8ec35faeec7988f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.668195 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8abf83b758465188e8937cdb8f7e0f (DEFAULT_TABLE table=default.Table_051053b5f32b4ceeac66666a2b2bbfdc [id=ae0715b3e9ef4e639edc836c1a6b09bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.668511 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8abf83b758465188e8937cdb8f7e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.672091 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 01425dae383748d2a465da909ba1f666 (DEFAULT_TABLE table=default.Table_922ca81707ad4d368e920fae60995f2c [id=32ec1e1c396947d49abf628232f89e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.672428 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01425dae383748d2a465da909ba1f666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.667375 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 905697a881ca417588717a5fa29e979b (DEFAULT_TABLE table=default.Table_75a4b6a0e201453282a955e6b54ae4c9 [id=2e1117ecbf7e43edb8f54e6463a36282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.673871 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905697a881ca417588717a5fa29e979b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.672101 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 61838dea54fd4d23965fae1f91d10c66 (DEFAULT_TABLE table=default.Table_7368edcc9df84c73b799d90f8e2f54b0 [id=63ff4979cee248a99af4f46a93dd5a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.675836 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61838dea54fd4d23965fae1f91d10c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.667920 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.678791 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 05213c1723664f5b8ec35faeec7988f2 (DEFAULT_TABLE table=default.Table_1308e456be4643dd8d055b56b014a0e0 [id=8f77f23e3f884b53a5a50def4e5c4b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.678917 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1f4098d245d74165bbb7902a63b56907"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.679385 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 905697a881ca417588717a5fa29e979b (DEFAULT_TABLE table=default.Table_75a4b6a0e201453282a955e6b54ae4c9 [id=2e1117ecbf7e43edb8f54e6463a36282]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:12.679551 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f4098d245d74165bbb7902a63b56907 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.679945 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8abf83b758465188e8937cdb8f7e0f (DEFAULT_TABLE table=default.Table_051053b5f32b4ceeac66666a2b2bbfdc [id=ae0715b3e9ef4e639edc836c1a6b09bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.680449 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 61838dea54fd4d23965fae1f91d10c66 (DEFAULT_TABLE table=default.Table_7368edcc9df84c73b799d90f8e2f54b0 [id=63ff4979cee248a99af4f46a93dd5a56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.680974 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 01425dae383748d2a465da909ba1f666 (DEFAULT_TABLE table=default.Table_922ca81707ad4d368e920fae60995f2c [id=32ec1e1c396947d49abf628232f89e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.681480 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 725ea4fc2cbb49a1be1a606f6e91e54b (DEFAULT_TABLE table=default.Table_db441414252c4a9f92baf9e3854a4498 [id=aa73a1588e7540bebeecc36f574360c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.683357 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3971153031a6480ca07158be22e8b9db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:12.692471 11353 tablet_service.cc:1511] Processing CreateTablet for tablet d968b35807db4db3a13c7625202d7e0f (DEFAULT_TABLE table=default.Table_3e3c0d82d2f6449f835a8db116eb1f08 [id=881f7a8eaffd4b68b85f8fcf70f8d94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.693033 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e6715233be44b9aad5210d17500f59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.470419 11754 tablet_bootstrap.cc:492] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:12.493731 11237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9513d1d55fe846f5b1a2b7d315209002" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.693650 11754 ts_tablet_manager.cc:1403] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.253s user 0.000s sys 0.005s
I20260925 01:50:12.500475 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33967e5e11524b78bb86ce7a3e2e16ad" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.512478 11240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0749a0ae58df4ff8b74a86f072332fad" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.550949 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b92054aaa704c7ebd6b075c30db2616" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.559020 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cd17f1ecead409ab7b54c2120476a3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:11 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.694402 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 725ea4fc2cbb49a1be1a606f6e91e54b (DEFAULT_TABLE table=default.Table_db441414252c4a9f92baf9e3854a4498 [id=aa73a1588e7540bebeecc36f574360c9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:12.694538 11456 leader_election.cc:343] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.694538 11754 raft_consensus.cc:359] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.694648 11456 leader_election.cc:304] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.694701 11754 raft_consensus.cc:385] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.694774 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725ea4fc2cbb49a1be1a606f6e91e54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.694751 11754 raft_consensus.cc:740] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:50:12.695065 11456 leader_election.cc:343] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.695026 11754 consensus_queue.cc:260] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.695176 11456 leader_election.cc:304] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:12.695513 11456 leader_election.cc:343] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.695574 11754 ts_tablet_manager.cc:1434] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:12.695590 11456 leader_election.cc:304] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.695868 11754 tablet_bootstrap.cc:492] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:12.696213 13411 raft_consensus.cc:2749] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.696353 13411 raft_consensus.cc:2749] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.696455 13411 raft_consensus.cc:2749] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.697647 11754 tablet_bootstrap.cc:654] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.563354 13420 raft_consensus.cc:493] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.698175 13420 raft_consensus.cc:515] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.698906 13420 leader_election.cc:290] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.573783 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 824719105840401cb518dd5eea76f229 (DEFAULT_TABLE table=default.Table_3f06c30890b148468b29c92d1e399bbd [id=90c985ac68bf4e659f4cc97180e2b37f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.699484 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824719105840401cb518dd5eea76f229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.699915 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8afcf8f6d0e24472a3190059df032698" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:12.700476 11177 leader_election.cc:343] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.700662 11176 leader_election.cc:343] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 8afcf8f6d0e24472a3190059df032698
I20260925 01:50:12.700778 11176 leader_election.cc:304] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:12.701114 13420 raft_consensus.cc:2749] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.701599 13411 raft_consensus.cc:493] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.701728 13411 raft_consensus.cc:515] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.578254 13209 raft_consensus.cc:493] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.702176 13209 raft_consensus.cc:515] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.702894 13209 leader_election.cc:290] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.580955 11210 tablet_service.cc:1511] Processing CreateTablet for tablet f19d53f59bda4a63afe554d7f8bffa47 (DEFAULT_TABLE table=default.Table_d9319bb3e508473686691911e58a49cf [id=1d3e823b288041e29121f0ca31c3ff7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.585911 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341dca6f396449daadcaf8bbb77ed04b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.586319 11212 tablet_service.cc:1511] Processing CreateTablet for tablet fc26097a2b7a410bb15ae730ccb9c1b7 (DEFAULT_TABLE table=default.Table_f00ae318500247e78454967ad6f6b04c [id=44b84677194e41f589fe65a5bfb51b7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.586755 11208 tablet_service.cc:1511] Processing CreateTablet for tablet accbd2dcbe004599a274a919e0958223 (DEFAULT_TABLE table=default.Table_c4ac9dcad4044cb582e5536c7213a978 [id=0968fe5b72cc42de9e664e3131624371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.587056 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3c2124ce2a4f51b45db17a38775462 (DEFAULT_TABLE table=default.Table_b7548999462a4a90b7843382fc8adc0c [id=e7f33360a18343ea891fe6c77af425dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.587219 11206 tablet_service.cc:1558] Processing DeleteTablet for tablet d28dc51fc345487ba74c56b9b8f1ad42 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.703435 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d53f59bda4a63afe554d7f8bffa47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.587483 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 7c617bb54bb1440eb468689f122e83a6 (DEFAULT_TABLE table=default.Table_6821b0e5714046c69acfc48f4d0bc8d9 [id=e0bf032402504142a3096c8b3d198890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.594345 11222 tablet_service.cc:1558] Processing DeleteTablet for tablet 9771b89303094974902c4ad1f1c8608e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.596727 11218 tablet_service.cc:1511] Processing CreateTablet for tablet fdc26312580742a8a01b897e551a3a3d (DEFAULT_TABLE table=default.Table_7b590678fd634ad89ee5d6acec384f3b [id=9d54b28f524e4b83a5309b69bc4e0b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.602401 11219 tablet_service.cc:1558] Processing DeleteTablet for tablet e1480131c1e74536b5f3fa54764dc4f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.615830 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7da05066834173bd01ffcc00a5095e (DEFAULT_TABLE table=default.Table_fd97f72498c3402e89e99df9815178db [id=22819c00a7d045129848b63bfd27b8c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.624636 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet fdc26312580742a8a01b897e551a3a3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.704180 13411 leader_election.cc:290] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.625051 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5048a0fca2e64ffa9f19000f48a4c090" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.643067 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a5af9fb654d4c894e1cf4fd636c13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.645884 11290 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:12.594220 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet a8d3b4ec14d5457eb0d0d364904e755d with delete_type TABLET_DATA_DELETED (replaced by tablet d6f1ff7274a64bcd909d3f84d2b37163) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.665222 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 01425dae383748d2a465da909ba1f666 (DEFAULT_TABLE table=default.Table_922ca81707ad4d368e920fae60995f2c [id=32ec1e1c396947d49abf628232f89e65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.665426 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 905697a881ca417588717a5fa29e979b (DEFAULT_TABLE table=default.Table_75a4b6a0e201453282a955e6b54ae4c9 [id=2e1117ecbf7e43edb8f54e6463a36282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.665727 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8abf83b758465188e8937cdb8f7e0f (DEFAULT_TABLE table=default.Table_051053b5f32b4ceeac66666a2b2bbfdc [id=ae0715b3e9ef4e639edc836c1a6b09bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.665241 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 05213c1723664f5b8ec35faeec7988f2 (DEFAULT_TABLE table=default.Table_1308e456be4643dd8d055b56b014a0e0 [id=8f77f23e3f884b53a5a50def4e5c4b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.666011 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 61838dea54fd4d23965fae1f91d10c66 (DEFAULT_TABLE table=default.Table_7368edcc9df84c73b799d90f8e2f54b0 [id=63ff4979cee248a99af4f46a93dd5a56]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:12.692337 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3971153031a6480ca07158be22e8b9db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.664863 11214 tablet_service.cc:1511] Processing CreateTablet for tablet d968b35807db4db3a13c7625202d7e0f (DEFAULT_TABLE table=default.Table_3e3c0d82d2f6449f835a8db116eb1f08 [id=881f7a8eaffd4b68b85f8fcf70f8d94f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.708324 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc26097a2b7a410bb15ae730ccb9c1b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.708262 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4e5d28d466741a0a085a4f9938fffd1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:12.710479 11177 leader_election.cc:343] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.711886 11176 leader_election.cc:343] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b4e5d28d466741a0a085a4f9938fffd1
I20260925 01:50:12.712013 11176 leader_election.cc:304] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:12.712358 13507 raft_consensus.cc:2749] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.713265 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 43b8e5a02efe40118ae75200a48ba0c1 (DEFAULT_TABLE table=default.Table_8d514818f2024dce89bf6d1480c69b09 [id=0a48dd4feb2542deaa4dacfa997da5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.714315 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet accbd2dcbe004599a274a919e0958223. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:12.717231 11176 consensus_peers.cc:597] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:12.718325 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3c2124ce2a4f51b45db17a38775462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.718575 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7da05066834173bd01ffcc00a5095e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.720167 13412 raft_consensus.cc:493] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.720314 13412 raft_consensus.cc:515] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.720978 13412 leader_election.cc:290] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.722270 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01425dae383748d2a465da909ba1f666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.726171 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc26312580742a8a01b897e551a3a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.726593 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c617bb54bb1440eb468689f122e83a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.727101 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905697a881ca417588717a5fa29e979b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.727567 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8abf83b758465188e8937cdb8f7e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.728114 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05213c1723664f5b8ec35faeec7988f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.728550 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 03487a3fa9574fd583d9c95d0624203c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:12.728904 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61838dea54fd4d23965fae1f91d10c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.729831 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 03487a3fa9574fd583d9c95d0624203c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:12.739883 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 44341.9us
W20260925 01:50:12.740340 11456 leader_election.cc:343] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.740552 11456 leader_election.cc:304] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.741384 13412 raft_consensus.cc:2749] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:12.741983 11456 leader_election.cc:343] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.742193 11456 leader_election.cc:304] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.742527 13412 raft_consensus.cc:2749] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:12.743040 11456 leader_election.cc:343] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.743326 11456 leader_election.cc:343] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.744163 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40083a885974e3595ec2fb5b16d4a5d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.740612 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 1d7da05066834173bd01ffcc00a5095e (DEFAULT_TABLE table=default.Table_fd97f72498c3402e89e99df9815178db [id=22819c00a7d045129848b63bfd27b8c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.745628 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113d7ccee4e349e19d3948e09d2c533d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.746876 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 725ea4fc2cbb49a1be1a606f6e91e54b (DEFAULT_TABLE table=default.Table_db441414252c4a9f92baf9e3854a4498 [id=aa73a1588e7540bebeecc36f574360c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.747112 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 43b8e5a02efe40118ae75200a48ba0c1 (DEFAULT_TABLE table=default.Table_8d514818f2024dce89bf6d1480c69b09 [id=0a48dd4feb2542deaa4dacfa997da5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.747267 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725ea4fc2cbb49a1be1a606f6e91e54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.747692 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b8e5a02efe40118ae75200a48ba0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.749441 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 43b8e5a02efe40118ae75200a48ba0c1 (DEFAULT_TABLE table=default.Table_8d514818f2024dce89bf6d1480c69b09 [id=0a48dd4feb2542deaa4dacfa997da5e3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:12.749717 11456 leader_election.cc:343] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.750792 13520 raft_consensus.cc:493] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.750945 13520 raft_consensus.cc:515] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.752166 11221 tablet_service.cc:1511] Processing CreateTablet for tablet ff6912001830438e92a989af2771396b (DEFAULT_TABLE table=default.Table_b7b07e2438fa4ef5932c4cabe9d786c9 [id=ab722fa6eccd462ebe805ebb563278ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.753170 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602af3d6e7bb44f8a316691019f85c25" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.754446 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d968b35807db4db3a13c7625202d7e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.754455 13520 leader_election.cc:290] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.755787 11357 tablet_service.cc:1511] Processing CreateTablet for tablet ff6912001830438e92a989af2771396b (DEFAULT_TABLE table=default.Table_b7b07e2438fa4ef5932c4cabe9d786c9 [id=ab722fa6eccd462ebe805ebb563278ba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:12.760705 11457 leader_election.cc:343] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.760825 11457 leader_election.cc:304] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.761549 13520 raft_consensus.cc:2749] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:12.762396 11572 tablet.cc:2433] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 01:50:12.762707 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7da05066834173bd01ffcc00a5095e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:12.772684 11456 leader_election.cc:343] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.775573 11953 ts_tablet_manager.cc:1929] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.775971 11953 log.cc:1199] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8234c4d0c72541158826416e40f34031
I20260925 01:50:12.777104 11953 ts_tablet_manager.cc:1950] T 8234c4d0c72541158826416e40f34031 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:12.785614 13452 raft_consensus.cc:493] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.785760 13452 raft_consensus.cc:515] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.786414 13452 leader_election.cc:290] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:12.786793 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3e5bfe5c108041978d6f6cbf9e1f2b27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.787355 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e5bfe5c108041978d6f6cbf9e1f2b27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.792064 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b8e5a02efe40118ae75200a48ba0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.798314 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6912001830438e92a989af2771396b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.801789 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 03487a3fa9574fd583d9c95d0624203c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:12 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:12.803363 11314 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 06fca09010f841c5a7b58678560065f3
I20260925 01:50:12.804628 13520 raft_consensus.cc:493] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.804764 13520 raft_consensus.cc:515] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.805416 13520 leader_election.cc:290] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.806175 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7347b31f782c4508b004c7523dc11dbb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.806772 11456 leader_election.cc:343] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.810132 11314 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 06fca09010f841c5a7b58678560065f3
I20260925 01:50:12.810920 11314 leader_election.cc:304] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.812495 13452 raft_consensus.cc:2749] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.815196 13452 raft_consensus.cc:493] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:12.815346 13452 raft_consensus.cc:515] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.815903 13452 leader_election.cc:290] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:12.823508 11754 tablet_bootstrap.cc:492] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:12.824077 11754 ts_tablet_manager.cc:1403] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.008s
I20260925 01:50:12.824158 11755 ts_tablet_manager.cc:1434] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.169s user 0.001s sys 0.001s
I20260925 01:50:12.824692 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_17e80afce4044b87b69f9e75284121f4" } new_table_name: "default.Table_26ec1ad5810942a885efb5a9a1a7bf6d" modify_external_catalogs: true
I20260925 01:50:12.824992 11755 tablet_bootstrap.cc:492] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:12.825101 11754 raft_consensus.cc:359] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.825278 11754 raft_consensus.cc:385] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.825332 11754 raft_consensus.cc:740] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.825553 11754 consensus_queue.cc:260] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.826493 11754 ts_tablet_manager.cc:1434] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:12.829967 11754 tablet_bootstrap.cc:492] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:12.833367 13452 raft_consensus.cc:493] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.833493 13452 raft_consensus.cc:515] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:12.834081 13452 leader_election.cc:290] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:12.835005 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.836138 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afcf8f6d0e24472a3190059df032698 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:12.843634 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 663) took 8605 ms. Trace:
I20260925 01:50:12.844724 11953 rpcz_store.cc:276] 0925 01:50:04.238231 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.238290 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:12.319059 (+8080769us) ts_tablet_manager.cc:1151] Deleting tablet 8234c4d0c72541158826416e40f34031
0925 01:50:12.319069 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.541282 (+222213us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.775357 (+234075us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.843607 (+ 68250us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8080584}
I20260925 01:50:12.847422 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 8234c4d0c72541158826416e40f34031 (table default.Table_69dd9b3d7d624415aacea6486cb9caeb [id=dfef0ea9809c46c8971e29b2f080e7df]) successfully deleted
W20260925 01:50:12.848589 11176 consensus_peers.cc:597] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e95fb28febd94a26ba9682fb9a462872. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:12.849296 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 670) took 8504 ms. Trace:
I20260925 01:50:12.849895 13507 raft_consensus.cc:493] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.850047 13507 raft_consensus.cc:515] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.850749 13507 leader_election.cc:290] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.851388 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81024a75b31e45e098d108bae4cc17c9" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.850256 11953 rpcz_store.cc:276] 0925 01:50:04.344490 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.344546 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:12.848037 (+8503491us) ts_tablet_manager.cc:1151] Deleting tablet b8f82aa815bd42bdbf70a673e3a4c9da
0925 01:50:12.848055 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.848982 (+ 927us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8503012}
W20260925 01:50:12.852001 11177 leader_election.cc:343] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.852672 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b8f82aa815bd42bdbf70a673e3a4c9da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8f82aa815bd42bdbf70a673e3a4c9da already in progress: creating tablet
W20260925 01:50:12.853111 11176 leader_election.cc:343] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 81024a75b31e45e098d108bae4cc17c9
I20260925 01:50:12.853231 11176 leader_election.cc:304] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:12.853761 13507 raft_consensus.cc:2749] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.856092 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 672) took 8443 ms. Trace:
I20260925 01:50:12.856302 11953 rpcz_store.cc:276] 0925 01:50:04.412257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.412703 (+ 446us) service_pool.cc:224] Handling call
0925 01:50:12.853281 (+8440578us) ts_tablet_manager.cc:1151] Deleting tablet ff70e44b72d1425c81751ff0b3d93b11
0925 01:50:12.855894 (+ 2613us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.856072 (+ 178us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8440133}
I20260925 01:50:12.859761 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 671) took 8447 ms. Trace:
I20260925 01:50:12.859973 11953 rpcz_store.cc:276] 0925 01:50:04.412154 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.510122 (+ 97968us) service_pool.cc:224] Handling call
0925 01:50:12.857638 (+8347516us) ts_tablet_manager.cc:1151] Deleting tablet db217278aa27439587768291c4ca7e3a
0925 01:50:12.859601 (+ 1963us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.859743 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8347010}
W20260925 01:50:12.861115 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet db217278aa27439587768291c4ca7e3a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db217278aa27439587768291c4ca7e3a already in progress: creating tablet
I20260925 01:50:12.862123 13520 raft_consensus.cc:493] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.862676 13520 raft_consensus.cc:515] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.861986 11753 tablet_bootstrap.cc:654] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.863329 13520 leader_election.cc:290] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.863927 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e28aeabdf724784b8ed27535ea0701b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.863083 13412 raft_consensus.cc:493] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.864369 13412 raft_consensus.cc:515] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.865075 13412 leader_election.cc:290] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:12.865985 11456 leader_election.cc:343] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.866357 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811b957c4e6647ccaa688d7273ec9eeb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.866938 11456 leader_election.cc:343] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.868247 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c617bb54bb1440eb468689f122e83a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.868469 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61838dea54fd4d23965fae1f91d10c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.868676 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05213c1723664f5b8ec35faeec7988f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.869027 11953 tablet_replica.cc:333] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:12.869271 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdc26312580742a8a01b897e551a3a3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.869442 11953 raft_consensus.cc:2243] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:12.869508 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b8e5a02efe40118ae75200a48ba0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.870164 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19d53f59bda4a63afe554d7f8bffa47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.870915 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01425dae383748d2a465da909ba1f666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.871223 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d968b35807db4db3a13c7625202d7e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.874150 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6912001830438e92a989af2771396b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.876439 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3c2124ce2a4f51b45db17a38775462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.877426 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8abf83b758465188e8937cdb8f7e0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.880683 11953 raft_consensus.cc:2272] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.882159 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 905697a881ca417588717a5fa29e979b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.882680 11953 ts_tablet_manager.cc:1916] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.884079 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7da05066834173bd01ffcc00a5095e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.894032 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725ea4fc2cbb49a1be1a606f6e91e54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.894541 13412 raft_consensus.cc:493] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.894676 13412 raft_consensus.cc:515] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.895262 13412 leader_election.cc:290] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.896047 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a00b69e42e1465981d6c3eec217393f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:12.896687 11755 tablet_bootstrap.cc:654] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:12.896832 11456 leader_election.cc:343] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.885753 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 75830.6us
I20260925 01:50:12.900017 13458 raft_consensus.cc:493] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.900144 13458 raft_consensus.cc:515] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.900714 13458 leader_election.cc:290] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:12.901834 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40083a885974e3595ec2fb5b16d4a5d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.902340 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113d7ccee4e349e19d3948e09d2c533d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.903225 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602af3d6e7bb44f8a316691019f85c25" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.903792 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7347b31f782c4508b004c7523dc11dbb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.904361 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e28aeabdf724784b8ed27535ea0701b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.904946 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811b957c4e6647ccaa688d7273ec9eeb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.905341 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a5af9fb654d4c894e1cf4fd636c13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.905885 13412 raft_consensus.cc:493] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:12.906028 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a00b69e42e1465981d6c3eec217393f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:12.906024 13412 raft_consensus.cc:515] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.906672 13412 leader_election.cc:290] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:12.907078 11953 ts_tablet_manager.cc:1929] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:12.907397 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f1e725fe84552943563aa95687842" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:12.908042 11456 leader_election.cc:343] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.914165 11953 log.cc:1199] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/93329036763146beb8e6a9b039cc1ec1
I20260925 01:50:12.914660 11953 ts_tablet_manager.cc:1950] T 93329036763146beb8e6a9b039cc1ec1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:12.920416 11674 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 341dca6f396449daadcaf8bbb77ed04b (table default.Table_500b95f7b4bf49b7bc5fb405085bcc85 [id=fffcb55426084429ade6e3c4daa22722]). Expected version 2 got 0
I20260925 01:50:12.920747 11674 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 9c4f1e725fe84552943563aa95687842 (table default.Table_d10a845bf44e48a091bfd078a1a436d7 [id=564bdd9ee3404040b32798c6890aff6e]). Expected version 3 got 0
I20260925 01:50:12.920888 11674 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 9513d1d55fe846f5b1a2b7d315209002 (table default.Table_76c89167538945999999e21b0ddaba59 [id=fc884308e078422c86ce1d6f7b0af92e]). Expected version 2 got 0
I20260925 01:50:12.921605 13356 ts_tablet_manager.cc:1929] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:12.921729 13356 log.cc:1199] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/818a792969a245f5b0fe5f80128206ba
I20260925 01:50:12.922106 11490 tablet_service.cc:1511] Processing CreateTablet for tablet ff6912001830438e92a989af2771396b (DEFAULT_TABLE table=default.Table_b7b07e2438fa4ef5932c4cabe9d786c9 [id=ab722fa6eccd462ebe805ebb563278ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.922567 11213 tablet_service.cc:1511] Processing CreateTablet for tablet e76fe124682a483e84f96d1ed733744f (DEFAULT_TABLE table=default.Table_199a67f3de15419596bd30573b668ac3 [id=00ae5f0e45c14b9cae6683ad47225c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.922941 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76fe124682a483e84f96d1ed733744f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.922994 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6912001830438e92a989af2771396b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.923544 11488 tablet_service.cc:1511] Processing CreateTablet for tablet e76fe124682a483e84f96d1ed733744f (DEFAULT_TABLE table=default.Table_199a67f3de15419596bd30573b668ac3 [id=00ae5f0e45c14b9cae6683ad47225c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.923857 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76fe124682a483e84f96d1ed733744f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.924238 11350 tablet_service.cc:1511] Processing CreateTablet for tablet fd865bada9e548ef8301c58492d7b90b (DEFAULT_TABLE table=default.Table_f3418c7b61b1456987fac5af765e86e4 [id=7f245dfb0db6476686c5128f06109c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.925371 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 01feb77050b94c64a0681fe32e802bcc (DEFAULT_TABLE table=default.Table_c3701457633346d4b7d3c3bf2fceb1f9 [id=25e795e2a01341338f9ea6e52fbdc811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.928347 11946 ts_tablet_manager.cc:1929] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:12.928450 11946 log.cc:1199] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/3d398851fb194c61a0a3b2c60c7a5e8b
I20260925 01:50:12.928710 11946 ts_tablet_manager.cc:1950] T 3d398851fb194c61a0a3b2c60c7a5e8b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:12.929755 11754 tablet_bootstrap.cc:654] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:12.930315 11207 tablet_service.cc:1511] Processing CreateTablet for tablet fd865bada9e548ef8301c58492d7b90b (DEFAULT_TABLE table=default.Table_f3418c7b61b1456987fac5af765e86e4 [id=7f245dfb0db6476686c5128f06109c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.930708 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd865bada9e548ef8301c58492d7b90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.930819 11492 tablet_service.cc:1511] Processing CreateTablet for tablet fd865bada9e548ef8301c58492d7b90b (DEFAULT_TABLE table=default.Table_f3418c7b61b1456987fac5af765e86e4 [id=7f245dfb0db6476686c5128f06109c04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.931172 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd865bada9e548ef8301c58492d7b90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.933245 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd865bada9e548ef8301c58492d7b90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.934330 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 01feb77050b94c64a0681fe32e802bcc (DEFAULT_TABLE table=default.Table_c3701457633346d4b7d3c3bf2fceb1f9 [id=25e795e2a01341338f9ea6e52fbdc811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.934680 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01feb77050b94c64a0681fe32e802bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.936569 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01feb77050b94c64a0681fe32e802bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.936503 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_656244678e8846349b09949a289a987b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:12.937080 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_656244678e8846349b09949a289a987b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:12.938380 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 01feb77050b94c64a0681fe32e802bcc (DEFAULT_TABLE table=default.Table_c3701457633346d4b7d3c3bf2fceb1f9 [id=25e795e2a01341338f9ea6e52fbdc811]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.938774 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01feb77050b94c64a0681fe32e802bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.943326 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 81024a75b31e45e098d108bae4cc17c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:12.948465 11314 leader_election.cc:343] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5b11c6526dbc4177b3a54b3c952bbd31
W20260925 01:50:12.949295 11314 leader_election.cc:343] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: dfde700aff8049f4b10c46059da6907f
W20260925 01:50:12.949455 11314 leader_election.cc:343] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 96b68399843a422b8da3ddfab2c522e6
W20260925 01:50:12.949783 11457 leader_election.cc:343] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.949914 11457 leader_election.cc:304] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:12.949982 11176 consensus_peers.cc:597] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 226498ea628a475d8fcab28a6598a819. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:12.950346 11457 leader_election.cc:343] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:12.950636 11457 leader_election.cc:343] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.950723 11457 leader_election.cc:304] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.951164 13520 raft_consensus.cc:2749] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:12.951296 11314 leader_election.cc:343] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 96b68399843a422b8da3ddfab2c522e6
I20260925 01:50:12.951395 11314 leader_election.cc:304] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.951500 13520 raft_consensus.cc:2749] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.951614 13458 raft_consensus.cc:2749] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:12.955458 11314 leader_election.cc:343] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:50:12.959029 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 113d7ccee4e349e19d3948e09d2c533d with delete_type TABLET_DATA_DELETED (replaced by tablet daf6b1408d094086a79488d64dc62c75) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.959481 11494 tablet_service.cc:1558] Processing DeleteTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.959643 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e28aeabdf724784b8ed27535ea0701b with delete_type TABLET_DATA_DELETED (replaced by tablet dceeedf3471d45508f025e7a4c7f73f2) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.960388 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 7347b31f782c4508b004c7523dc11dbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.963280 11353 tablet_service.cc:1511] Processing CreateTablet for tablet e76fe124682a483e84f96d1ed733744f (DEFAULT_TABLE table=default.Table_199a67f3de15419596bd30573b668ac3 [id=00ae5f0e45c14b9cae6683ad47225c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:12.963668 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 3d398851fb194c61a0a3b2c60c7a5e8b (table default.Table_4ef3129ce4d545c0a2dae74dbc7798f0 [id=13bb30253d2c46e8aadf3c0065334d43]) successfully deleted
I20260925 01:50:12.964514 11946 tablet_replica.cc:333] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:12.964905 11946 raft_consensus.cc:2243] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:12.964954 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 226498ea628a475d8fcab28a6598a819 because the tablet was not found. No further retry: Not found: Tablet not found: 226498ea628a475d8fcab28a6598a819
I20260925 01:50:12.965233 11946 raft_consensus.cc:2272] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.966423 11946 ts_tablet_manager.cc:1916] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:12.966620 11755 tablet_bootstrap.cc:492] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:12.966751 11755 ts_tablet_manager.cc:1403] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.142s user 0.000s sys 0.007s
I20260925 01:50:12.967495 11755 raft_consensus.cc:359] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:12.967686 11755 raft_consensus.cc:385] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.967742 11755 raft_consensus.cc:740] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.967960 11755 consensus_queue.cc:260] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:12.968470 11755 ts_tablet_manager.cc:1434] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:12.955690 11314 leader_election.cc:304] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.974179 13356 ts_tablet_manager.cc:1950] T 818a792969a245f5b0fe5f80128206ba P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:12.974231 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.974625 13452 raft_consensus.cc:2749] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.975216 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 924) took 2957 ms. Trace:
I20260925 01:50:12.975319 13356 rpcz_store.cc:276] 0925 01:50:10.018006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.043605 (+ 25599us) service_pool.cc:224] Handling call
0925 01:50:12.468091 (+2424486us) ts_tablet_manager.cc:1151] Deleting tablet 818a792969a245f5b0fe5f80128206ba
0925 01:50:12.468101 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.849558 (+381457us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.921525 (+ 71967us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.975189 (+ 53664us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2424286}
I20260925 01:50:12.975814 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 917) took 2979 ms. Trace:
I20260925 01:50:12.975891 13356 rpcz_store.cc:276] 0925 01:50:09.996217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.009984 (+ 13767us) service_pool.cc:224] Handling call
0925 01:50:12.975668 (+2965684us) ts_tablet_manager.cc:1151] Deleting tablet 3ac251aa75344cf8ac29dd30c893d84b
0925 01:50:12.975680 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.975795 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2906220}
I20260925 01:50:12.976138 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 818a792969a245f5b0fe5f80128206ba (table default.Table_b2202b3e9b174d9a9bff1f005144d412 [id=3a0322c7d2bf4cc89a0e09ac46a62440]) successfully deleted
I20260925 01:50:12.976253 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 935) took 2879 ms. Trace:
I20260925 01:50:12.976332 13356 rpcz_store.cc:276] 0925 01:50:10.097001 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.100229 (+ 3228us) service_pool.cc:224] Handling call
0925 01:50:12.976144 (+2875915us) ts_tablet_manager.cc:1151] Deleting tablet 3f7e203f023745f0b9b44085b0943c6d
0925 01:50:12.976155 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.976238 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2875662}
W20260925 01:50:12.977139 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 3ac251aa75344cf8ac29dd30c893d84b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ac251aa75344cf8ac29dd30c893d84b already in progress: creating tablet
I20260925 01:50:12.977432 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a00b69e42e1465981d6c3eec217393f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:12.980182 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76fe124682a483e84f96d1ed733744f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:12.981009 11755 tablet_bootstrap.cc:492] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:12.988211 11339 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:35276 (request call id 255) took 1493 ms. Trace:
I20260925 01:50:12.994634 11753 tablet_bootstrap.cc:492] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:12.994475 11456 leader_election.cc:343] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:12.994910 11456 leader_election.cc:304] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:12.995543 11753 ts_tablet_manager.cc:1403] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.332s user 0.003s sys 0.006s
I20260925 01:50:12.996361 11753 raft_consensus.cc:359] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.996623 11753 raft_consensus.cc:385] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:12.996726 11753 raft_consensus.cc:740] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:12.997008 11753 consensus_queue.cc:260] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:12.997465 13411 raft_consensus.cc:2749] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:12.997738 11753 ts_tablet_manager.cc:1434] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:12.998045 11753 tablet_bootstrap.cc:492] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:12.999591 11753 tablet_bootstrap.cc:654] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:13.000562 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 3f7e203f023745f0b9b44085b0943c6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f7e203f023745f0b9b44085b0943c6d already in progress: creating tablet
I20260925 01:50:13.000690 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 941) took 2533 ms. Trace:
I20260925 01:50:13.000813 13356 rpcz_store.cc:276] 0925 01:50:10.467274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.469747 (+ 2473us) service_pool.cc:224] Handling call
0925 01:50:13.000551 (+2530804us) ts_tablet_manager.cc:1151] Deleting tablet 3ce8d023311b4a91adfebd6c5fedf1bd
0925 01:50:13.000564 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.000668 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2525150}
W20260925 01:50:13.001333 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 3ce8d023311b4a91adfebd6c5fedf1bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ce8d023311b4a91adfebd6c5fedf1bd already in progress: creating tablet
I20260925 01:50:13.001442 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 942) took 2529 ms. Trace:
I20260925 01:50:13.001528 13356 rpcz_store.cc:276] 0925 01:50:10.471799 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.472052 (+ 253us) service_pool.cc:224] Handling call
0925 01:50:13.001324 (+2529272us) ts_tablet_manager.cc:1151] Deleting tablet fe3627bfb342448591ccaf3d7ab23c4a
0925 01:50:13.001335 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.001425 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2524906}
W20260925 01:50:13.001892 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet fe3627bfb342448591ccaf3d7ab23c4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe3627bfb342448591ccaf3d7ab23c4a already in progress: creating tablet
I20260925 01:50:13.001988 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 943) took 2529 ms. Trace:
I20260925 01:50:13.002106 13356 rpcz_store.cc:276] 0925 01:50:10.472555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.472636 (+ 81us) service_pool.cc:224] Handling call
0925 01:50:13.001885 (+2529249us) ts_tablet_manager.cc:1151] Deleting tablet 9a4219ce09e54d268c55c19f7b5cbc7d
0925 01:50:13.001895 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.001972 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2525405}
W20260925 01:50:13.002543 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 9a4219ce09e54d268c55c19f7b5cbc7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a4219ce09e54d268c55c19f7b5cbc7d already in progress: creating tablet
I20260925 01:50:13.004855 13356 tablet_replica.cc:333] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:13.005103 13356 raft_consensus.cc:2243] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:13.007413 13356 raft_consensus.cc:2272] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:12.989280 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 689) took 8264 ms. Trace:
I20260925 01:50:13.010620 11339 rpcz_store.cc:276] 0925 01:50:11.494356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.494423 (+ 67us) service_pool.cc:224] Handling call
0925 01:50:12.988188 (+1493765us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260925 01:50:13.011385 13356 ts_tablet_manager.cc:1916] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:13.011482 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 60806.2us
I20260925 01:50:13.004688 11755 tablet_bootstrap.cc:654] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.010721 11953 rpcz_store.cc:276] 0925 01:50:04.724746 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.730831 (+ 6085us) service_pool.cc:224] Handling call
0925 01:50:12.861755 (+8130924us) ts_tablet_manager.cc:1151] Deleting tablet 93329036763146beb8e6a9b039cc1ec1
0925 01:50:12.868550 (+ 6795us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:12.895596 (+ 27046us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.907031 (+ 11435us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:12.989265 (+ 82234us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8130328}
I20260925 01:50:13.012259 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 93329036763146beb8e6a9b039cc1ec1 (table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]) successfully deleted
I20260925 01:50:13.012360 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 688) took 8287 ms. Trace:
I20260925 01:50:13.012436 11953 rpcz_store.cc:276] 0925 01:50:04.724542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.731324 (+ 6782us) service_pool.cc:224] Handling call
0925 01:50:13.012255 (+8280931us) ts_tablet_manager.cc:1151] Deleting tablet ccffbe61eea34333abdc6da94612c0f6
0925 01:50:13.012265 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.012343 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8280764}
W20260925 01:50:13.012771 11457 leader_election.cc:343] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.012928 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 690) took 8136 ms. Trace:
I20260925 01:50:13.013029 11953 rpcz_store.cc:276] 0925 01:50:04.876466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:04.877535 (+ 1069us) service_pool.cc:224] Handling call
0925 01:50:13.012818 (+8135283us) ts_tablet_manager.cc:1151] Deleting tablet 17d628e46be942b3be3a69afd3f6968b
0925 01:50:13.012827 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.012912 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8072067}
I20260925 01:50:13.013139 11457 leader_election.cc:304] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:13.013422 11666 catalog_manager.cc:5030] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ccffbe61eea34333abdc6da94612c0f6 because the tablet was not found. No further retry: Not found: Tablet not found: ccffbe61eea34333abdc6da94612c0f6
W20260925 01:50:13.013681 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 17d628e46be942b3be3a69afd3f6968b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d628e46be942b3be3a69afd3f6968b already in progress: creating tablet
W20260925 01:50:13.001806 11314 leader_election.cc:343] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: dfde700aff8049f4b10c46059da6907f
I20260925 01:50:13.013824 13412 raft_consensus.cc:2749] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:13.013963 11953 tablet_replica.cc:333] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:13.013875 11314 leader_election.cc:304] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.014182 11953 raft_consensus.cc:2243] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:13.014364 13458 raft_consensus.cc:2749] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:13.014364 11953 raft_consensus.cc:2272] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.014950 11953 ts_tablet_manager.cc:1916] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:13.015662 11457 leader_election.cc:343] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.015930 11457 leader_election.cc:304] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.016430 13412 raft_consensus.cc:2749] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.017170 11457 leader_election.cc:343] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:13.015163 11314 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 95ac080782664fca8661c188ab822e89
I20260925 01:50:13.018795 11457 leader_election.cc:304] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.019379 13412 raft_consensus.cc:2749] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.020188 11457 leader_election.cc:343] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.020924 11457 leader_election.cc:304] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.023051 13412 raft_consensus.cc:2749] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.029683 11176 consensus_peers.cc:597] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31ffb404d93a4436ba9e624b45650fe1. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:13.030260 13356 ts_tablet_manager.cc:1929] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260925 01:50:13.032631 11457 leader_election.cc:343] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.034255 11457 leader_election.cc:304] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.035681 13507 raft_consensus.cc:493] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.035751 13356 log.cc:1199] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/f2618c46630c4295949b36f3d0087941
I20260925 01:50:13.035840 13507 raft_consensus.cc:515] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.036468 13356 ts_tablet_manager.cc:1950] T f2618c46630c4295949b36f3d0087941 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:13.036547 13507 leader_election.cc:290] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.035702 11754 tablet_bootstrap.cc:492] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.037168 11754 ts_tablet_manager.cc:1403] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.208s user 0.004s sys 0.003s
I20260925 01:50:13.037413 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9462215644a41ccb2f269f64e35392a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.038046 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9462215644a41ccb2f269f64e35392a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:13.038326 11514 raft_consensus.cc:2468] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:13.039113 11177 leader_election.cc:343] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.038862 11754 raft_consensus.cc:359] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.039399 11754 raft_consensus.cc:385] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.039549 11176 leader_election.cc:304] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:13.039783 13507 raft_consensus.cc:2804] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:13.039845 13507 raft_consensus.cc:493] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:13.039912 13507 raft_consensus.cc:3060] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.039563 11754 raft_consensus.cc:740] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.040674 11754 consensus_queue.cc:260] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.042718 13507 raft_consensus.cc:515] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.043418 13507 leader_election.cc:290] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.043990 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9462215644a41ccb2f269f64e35392a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:13.045123 11177 leader_election.cc:343] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.046882 13412 raft_consensus.cc:2749] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:13.048218 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9462215644a41ccb2f269f64e35392a" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:13.048375 11514 raft_consensus.cc:3060] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.051186 11514 raft_consensus.cc:2468] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:13.051924 11176 leader_election.cc:304] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:13.052335 13209 raft_consensus.cc:2804] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:13.052459 13209 raft_consensus.cc:697] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:13.052686 13209 consensus_queue.cc:237] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.052845 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.053694 11753 tablet_bootstrap.cc:492] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.053848 11753 ts_tablet_manager.cc:1403] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.056s user 0.000s sys 0.002s
I20260925 01:50:13.054553 11753 raft_consensus.cc:359] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.054720 11753 raft_consensus.cc:385] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.054783 11753 raft_consensus.cc:740] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.054970 11753 consensus_queue.cc:260] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.055481 11753 ts_tablet_manager.cc:1434] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:13.055775 11753 tablet_bootstrap.cc:492] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.055425 11754 ts_tablet_manager.cc:1434] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20260925 01:50:13.057307 11753 tablet_bootstrap.cc:654] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.059677 11754 tablet_bootstrap.cc:492] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.063967 13420 raft_consensus.cc:493] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.064112 13420 raft_consensus.cc:515] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.037295 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 947) took 2514 ms. Trace:
I20260925 01:50:13.064697 13420 leader_election.cc:290] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.065297 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5048a0fca2e64ffa9f19000f48a4c090" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:13.065467 11514 raft_consensus.cc:2468] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:13.065867 11176 leader_election.cc:304] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:13.066234 13420 raft_consensus.cc:2804] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:13.066303 13420 raft_consensus.cc:493] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:13.066378 13420 raft_consensus.cc:3060] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.064807 13356 rpcz_store.cc:276] 0925 01:50:10.522813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.523413 (+ 600us) service_pool.cc:224] Handling call
0925 01:50:13.004809 (+2481396us) ts_tablet_manager.cc:1151] Deleting tablet f2618c46630c4295949b36f3d0087941
0925 01:50:13.004819 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.024755 (+ 19936us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.030199 (+ 5444us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.037276 (+ 7077us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2481181}
I20260925 01:50:13.067628 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5048a0fca2e64ffa9f19000f48a4c090" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:13.068390 11177 leader_election.cc:343] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.069036 11753 tablet_bootstrap.cc:492] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.069195 11753 ts_tablet_manager.cc:1403] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260925 01:50:13.069161 13420 raft_consensus.cc:515] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.069371 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet f2618c46630c4295949b36f3d0087941 (table default.Table_4dc4550a013e44da8eecc5fc94e0bd3d [id=9084029417354d6a8fd7cbb2b0b68e81]) successfully deleted
I20260925 01:50:13.069784 13420 leader_election.cc:290] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.069927 11753 raft_consensus.cc:359] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:13.070108 11753 raft_consensus.cc:385] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.070165 11753 raft_consensus.cc:740] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.070317 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5048a0fca2e64ffa9f19000f48a4c090" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:13.070354 11753 consensus_queue.cc:260] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:13.070879 11753 ts_tablet_manager.cc:1434] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260925 01:50:13.071012 11177 leader_election.cc:343] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.071455 11753 tablet_bootstrap.cc:492] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.072954 11753 tablet_bootstrap.cc:654] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.074337 13458 raft_consensus.cc:493] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:50:13.074544 11177 consensus_peers.cc:597] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:13.074484 13458 raft_consensus.cc:515] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:13.075139 13458 leader_election.cc:290] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:13.076521 13356 tablet_replica.cc:333] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:13.076045 11953 ts_tablet_manager.cc:1929] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:13.078121 11953 log.cc:1199] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/8c1abd3c2cb34915a595ea73a8d10743
I20260925 01:50:13.079504 13356 raft_consensus.cc:2243] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:13.081393 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5048a0fca2e64ffa9f19000f48a4c090" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:13.081914 11514 raft_consensus.cc:3060] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.083664 11953 ts_tablet_manager.cc:1950] T 8c1abd3c2cb34915a595ea73a8d10743 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:13.084450 13356 pending_rounds.cc:70] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:13.087504 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 915b1621cea64c03bd486ef32e815f5f
I20260925 01:50:13.088133 11680 catalog_manager.cc:6934] ReplaceTablet: tablet 915b1621cea64c03bd486ef32e815f5f deleted and replaced by tablet f093df623d384a41b466758e99284f3e
W20260925 01:50:13.087620 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c97236543c96426e94a4b910e4891a20 consensus state has no leader
W20260925 01:50:13.088534 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cabb4f9eb185456889acadaa624e66bb has no consensus state
I20260925 01:50:13.090235 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 915b1621cea64c03bd486ef32e815f5f with delete_type TABLET_DATA_DELETED (replaced by tablet f093df623d384a41b466758e99284f3e) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.090482 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 915b1621cea64c03bd486ef32e815f5f with delete_type TABLET_DATA_DELETED (replaced by tablet f093df623d384a41b466758e99284f3e) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:13.090536 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2147c104b494441988b7e3b39a1c457b consensus state has no leader
I20260925 01:50:13.091293 11514 raft_consensus.cc:2468] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:13.091881 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 915b1621cea64c03bd486ef32e815f5f with delete_type TABLET_DATA_DELETED (replaced by tablet f093df623d384a41b466758e99284f3e) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.091930 11176 leader_election.cc:304] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:13.092429 13420 raft_consensus.cc:2804] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:13.092546 13420 raft_consensus.cc:697] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
W20260925 01:50:13.092671 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet c28a226deca04da6a7a3f7a2b60598bd (table default.Table_7c7221346e01453b94b67caf6ad2263e [id=1fbb7357f1f14c38bcaef36bfed118e5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c28a226deca04da6a7a3f7a2b60598bd consensus state has no leader
I20260925 01:50:13.092775 13420 consensus_queue.cc:237] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.093923 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 694) took 7941 ms. Trace:
I20260925 01:50:13.094019 11953 rpcz_store.cc:276] 0925 01:50:05.152264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.152321 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:13.013918 (+7861597us) ts_tablet_manager.cc:1151] Deleting tablet 8c1abd3c2cb34915a595ea73a8d10743
0925 01:50:13.013926 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.021156 (+ 7230us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.075095 (+ 53939us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.093903 (+ 18808us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7623622}
I20260925 01:50:13.094527 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 8c1abd3c2cb34915a595ea73a8d10743 (table default.Table_5036ab1f1580484c8b9367dfab1a8a84 [id=a7cc09b27b1b463a982f1f4266bdf7fd]) successfully deleted
I20260925 01:50:13.085371 13356 pending_rounds.cc:77] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072937939734528 op_type: NO_OP noop_request { }
I20260925 01:50:13.099032 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_eb0cc83e98e14a84b8ca8fcb5011b6c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.099822 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb0cc83e98e14a84b8ca8fcb5011b6c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.101227 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2a085030ab794dc8b1c4c57165ac244b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.101485 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_24c0459b555f4b568e866d7d89977bfd" } new_table_name: "default.Table_8d062c3eaca145699f6c9986f5a956a3" modify_external_catalogs: true
I20260925 01:50:13.101985 13458 raft_consensus.cc:493] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.102169 13458 raft_consensus.cc:515] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.102766 13458 leader_election.cc:290] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.102783 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_476bf1ac18a8424287eb6e04103c5437" } modify_external_catalogs: true
I20260925 01:50:13.102936 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_476bf1ac18a8424287eb6e04103c5437" } modify_external_catalogs: true
I20260925 01:50:13.103269 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_75c3e0255c9a431f82d32a7ab3a2a76e" } modify_external_catalogs: true
I20260925 01:50:13.103395 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_75c3e0255c9a431f82d32a7ab3a2a76e" } modify_external_catalogs: true
W20260925 01:50:13.104290 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a085030ab794dc8b1c4c57165ac244b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.104924 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_70bd693da6434458bd48271461931659" } modify_external_catalogs: true
I20260925 01:50:13.105140 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_70bd693da6434458bd48271461931659" } modify_external_catalogs: true
I20260925 01:50:13.106815 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.107148 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.107527 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e998f52add6a48c286e13a889e780f52" } modify_external_catalogs: true
I20260925 01:50:13.107695 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e998f52add6a48c286e13a889e780f52" } modify_external_catalogs: true
I20260925 01:50:13.107957 13458 raft_consensus.cc:493] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.108116 13458 raft_consensus.cc:515] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.106287 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_199a67f3de15419596bd30573b668ac3" } new_table_name: "default.Table_f7975057a605408ea2d31373c0014770" modify_external_catalogs: true
I20260925 01:50:13.108794 13458 leader_election.cc:290] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.111093 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_54a0e9bc29834eb89498d7b09ce78d6f" } modify_external_catalogs: true
I20260925 01:50:13.111332 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_54a0e9bc29834eb89498d7b09ce78d6f" } modify_external_catalogs: true
I20260925 01:50:13.112960 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.098110 13356 raft_consensus.cc:2889] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:13.113286 13356 raft_consensus.cc:2272] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.114037 13356 ts_tablet_manager.cc:1916] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.114523 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 711) took 7732 ms. Trace:
I20260925 01:50:13.127337 11754 tablet_bootstrap.cc:654] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.142448 11753 tablet_bootstrap.cc:492] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.142743 11753 ts_tablet_manager.cc:1403] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.071s user 0.013s sys 0.010s
I20260925 01:50:13.143528 11753 raft_consensus.cc:359] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.144631 11753 raft_consensus.cc:385] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.144863 11753 raft_consensus.cc:740] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.145249 11753 consensus_queue.cc:260] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.146198 11753 ts_tablet_manager.cc:1434] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:13.149410 11753 tablet_bootstrap.cc:492] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.151623 11753 tablet_bootstrap.cc:654] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.117697 11953 rpcz_store.cc:276] 0925 01:50:05.382502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.390323 (+ 7821us) service_pool.cc:224] Handling call
0925 01:50:13.114337 (+7724014us) ts_tablet_manager.cc:1151] Deleting tablet 6439ba0b0468416d9798a6ac1ee7fddd
0925 01:50:13.114353 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.114500 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7723780}
W20260925 01:50:13.159134 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 6439ba0b0468416d9798a6ac1ee7fddd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6439ba0b0468416d9798a6ac1ee7fddd already in progress: creating tablet
I20260925 01:50:13.159598 11953 tablet_replica.cc:333] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:13.159847 11953 raft_consensus.cc:2243] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:13.160166 11953 raft_consensus.cc:2272] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.160451 11753 tablet_bootstrap.cc:492] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.160805 11753 ts_tablet_manager.cc:1403] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260925 01:50:13.161283 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f1d2d998d834c21ab83694daae37520 with delete_type TABLET_DATA_DELETED (replaced by tablet 4930edeb2edd4e7494dbf1761b5d20c0) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.162256 11753 raft_consensus.cc:359] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.166147 11753 raft_consensus.cc:385] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.166419 11753 raft_consensus.cc:740] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.166910 11753 consensus_queue.cc:260] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.167630 11754 tablet_bootstrap.cc:492] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.167829 11754 ts_tablet_manager.cc:1403] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.109s user 0.006s sys 0.007s
I20260925 01:50:13.168701 11754 raft_consensus.cc:359] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.168936 11754 raft_consensus.cc:385] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.169039 11754 raft_consensus.cc:740] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.169303 11754 consensus_queue.cc:260] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.169497 11753 ts_tablet_manager.cc:1434] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260925 01:50:13.169795 11753 tablet_bootstrap.cc:492] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.170163 11754 ts_tablet_manager.cc:1434] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260925 01:50:13.170686 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00345732f7314624831b4cfc59e981f4 consensus state has no leader
I20260925 01:50:13.171296 11753 tablet_bootstrap.cc:654] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.171316 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d08b978d9b2945ffa966e2237bddd48c
I20260925 01:50:13.172995 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet d08b978d9b2945ffa966e2237bddd48c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.173240 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5276072bbeca403fb06566b4a43489a0
I20260925 01:50:13.173449 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet d0edb8007afa42c6af8b289ff9cea830
I20260925 01:50:13.174185 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 5276072bbeca403fb06566b4a43489a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.174501 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet d0edb8007afa42c6af8b289ff9cea830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.174990 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet d0edb8007afa42c6af8b289ff9cea830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.175653 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c87a25d7403a414e8fe5bad44e1cf16c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.176972 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet d08b978d9b2945ffa966e2237bddd48c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:13.177032 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c87a25d7403a414e8fe5bad44e1cf16c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.177201 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 5276072bbeca403fb06566b4a43489a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.177356 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet a8055cc9b06045449e6133298c8074e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.177700 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e446bd8217484efab9bc956d45907276"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.178215 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e446bd8217484efab9bc956d45907276 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.178385 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet bd594870fa6a4ba190a18a48d821d72c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.180387 13525 raft_consensus.cc:493] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.180555 13525 raft_consensus.cc:515] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.181124 11344 tablet_service.cc:1558] Processing DeleteTablet for tablet d0edb8007afa42c6af8b289ff9cea830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.181218 13525 leader_election.cc:290] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.181376 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 5276072bbeca403fb06566b4a43489a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.181627 11946 ts_tablet_manager.cc:1929] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260925 01:50:13.181723 11946 log.cc:1199] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/29f28e49791744428729279a79b6c9f1
I20260925 01:50:13.182160 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a37a6deaeb24c99824b62fbb2d603b1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:13.183317 11946 ts_tablet_manager.cc:1950] T 29f28e49791744428729279a79b6c9f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:13.183673 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_ecbfb77555fc49d1a642966c2a8093bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.184489 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecbfb77555fc49d1a642966c2a8093bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.187119 11755 tablet_bootstrap.cc:492] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:13.187317 11755 ts_tablet_manager.cc:1403] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.206s user 0.009s sys 0.034s
I20260925 01:50:13.188254 11754 tablet_bootstrap.cc:492] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.188225 11755 raft_consensus.cc:359] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:13.188537 11755 raft_consensus.cc:385] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.189036 11755 raft_consensus.cc:740] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.189307 11755 consensus_queue.cc:260] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:13.189875 11755 ts_tablet_manager.cc:1434] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:13.194814 11754 tablet_bootstrap.cc:654] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:13.196835 11176 consensus_peers.cc:597] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9771b89303094974902c4ad1f1c8608e. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:13.199007 11755 tablet_bootstrap.cc:492] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:13.202287 11675 catalog_manager.cc:5838] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:13.204175 11754 tablet_bootstrap.cc:492] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.204331 11754 ts_tablet_manager.cc:1403] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260925 01:50:13.205062 11754 raft_consensus.cc:359] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.205243 11754 raft_consensus.cc:385] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.205297 11754 raft_consensus.cc:740] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.205499 11754 consensus_queue.cc:260] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.205989 11754 ts_tablet_manager.cc:1434] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:13.206302 11754 tablet_bootstrap.cc:492] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.207067 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 04f412cbebe04a629070aecf2753287c with delete_type TABLET_DATA_DELETED (replaced by tablet 87532a05a3cf4eccb5c27916d706adf9) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.207728 11754 tablet_bootstrap.cc:654] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.210850 11953 ts_tablet_manager.cc:1916] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.215483 13452 raft_consensus.cc:493] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.215627 13452 raft_consensus.cc:515] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.216226 13452 leader_election.cc:290] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.218271 11754 tablet_bootstrap.cc:492] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.218436 11754 ts_tablet_manager.cc:1403] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260925 01:50:13.219197 11754 raft_consensus.cc:359] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:13.219384 11754 raft_consensus.cc:385] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.219456 11754 raft_consensus.cc:740] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.219671 11754 consensus_queue.cc:260] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:13.220249 11754 ts_tablet_manager.cc:1434] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:13.220520 11754 tablet_bootstrap.cc:492] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.221987 11754 tablet_bootstrap.cc:654] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.230129 11754 tablet_bootstrap.cc:492] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.230299 11754 ts_tablet_manager.cc:1403] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260925 01:50:13.231024 11754 raft_consensus.cc:359] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.231205 11754 raft_consensus.cc:385] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.231259 11754 raft_consensus.cc:740] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.231468 11754 consensus_queue.cc:260] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.232393 11754 ts_tablet_manager.cc:1434] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:13.232709 11754 tablet_bootstrap.cc:492] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.234339 11754 tablet_bootstrap.cc:654] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.237411 11754 tablet_bootstrap.cc:492] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.237553 11754 ts_tablet_manager.cc:1403] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260925 01:50:13.238194 11754 raft_consensus.cc:359] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.238361 11754 raft_consensus.cc:385] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.238415 11754 raft_consensus.cc:740] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.238692 11754 consensus_queue.cc:260] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.239301 11754 ts_tablet_manager.cc:1434] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:13.239573 11754 tablet_bootstrap.cc:492] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.240051 11755 tablet_bootstrap.cc:654] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.241154 11754 tablet_bootstrap.cc:654] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.244576 11754 tablet_bootstrap.cc:492] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.244731 11754 ts_tablet_manager.cc:1403] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260925 01:50:13.245806 11754 raft_consensus.cc:359] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.245990 11754 raft_consensus.cc:385] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.246088 11754 raft_consensus.cc:740] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.246407 11754 consensus_queue.cc:260] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.247078 11754 ts_tablet_manager.cc:1434] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:13.247388 11754 tablet_bootstrap.cc:492] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.249675 11754 tablet_bootstrap.cc:654] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:13.250757 11177 consensus_peers.cc:597] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:13.252099 11754 tablet_bootstrap.cc:492] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.252225 11754 ts_tablet_manager.cc:1403] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260925 01:50:13.252983 11754 raft_consensus.cc:359] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.253140 11754 raft_consensus.cc:385] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.253192 11754 raft_consensus.cc:740] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
W20260925 01:50:13.253702 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e76fe124682a483e84f96d1ed733744f consensus state has no leader
I20260925 01:50:13.254031 11754 consensus_queue.cc:260] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.254707 11754 ts_tablet_manager.cc:1434] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:13.255306 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 38249392c0df4d50b0e09f3671f92800
I20260925 01:50:13.255699 13471 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:50:13.255967 13471 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:50:13.256776 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 38249392c0df4d50b0e09f3671f92800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.257622 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 38249392c0df4d50b0e09f3671f92800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.261057 13356 ts_tablet_manager.cc:1929] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:13.263496 13051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35046 (request call id 0) took 8012 ms. Trace:
I20260925 01:50:13.263072 13506 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a1694989f748dfa9cdb2c10f3f1de5. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:50:13.266724 11755 tablet_bootstrap.cc:492] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:13.266939 11755 ts_tablet_manager.cc:1403] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.002s
I20260925 01:50:13.267673 11755 raft_consensus.cc:359] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.267910 11755 raft_consensus.cc:385] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.268009 11755 raft_consensus.cc:740] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.268316 11755 consensus_queue.cc:260] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.268872 11755 ts_tablet_manager.cc:1434] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:13.269184 11755 tablet_bootstrap.cc:492] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:13.270890 11755 tablet_bootstrap.cc:654] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.266145 13506 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [sys.catalog]: This master's current role is: FOLLOWER
I20260925 01:50:13.269249 13471 leader_election.cc:290] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:50:13.294296 11680 catalog_manager.cc:6128] Not sending DeleteTablet requests; no consensus state for tablet 3a7cd598c2024eb7871642321c6653ae
I20260925 01:50:13.302145 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_84db866c4d6145caa30bfc8b43b0c182" } new_table_name: "default.Table_2c38f715e8564985b59a1312f1f31cc3" modify_external_catalogs: true
I20260925 01:50:13.302259 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f7975057a605408ea2d31373c0014770" } new_table_name: "default.Table_4060c8c3f9df442b9d2f3239d71b3222" modify_external_catalogs: true
I20260925 01:50:13.303776 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_02ce0d6160ed4598b09804acbfe785a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.304845 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8c48bf855090436ba60e5d1c81c2370f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.305372 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c48bf855090436ba60e5d1c81c2370f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.306303 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_22ccb6469f34453cba597d0d922fe631" } new_table_name: "default.Table_1fb84c7800674a8d9fc0d70cd6e57beb" modify_external_catalogs: true
I20260925 01:50:13.306326 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_99845f420c274423ac97431b16de7342"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.182626 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet d08b978d9b2945ffa966e2237bddd48c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.195526 11571 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
W20260925 01:50:13.306792 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99845f420c274423ac97431b16de7342 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.239128 11753 tablet_bootstrap.cc:492] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:13.182806 11456 leader_election.cc:343] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:13.307365 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 124555us
W20260925 01:50:13.308020 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02ce0d6160ed4598b09804acbfe785a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.308255 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 with delete_type TABLET_DATA_DELETED (replaced by tablet 137e34ae88eb453e819d82b1814bf895) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.308228 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_64d02d043b714fe1849b322e84285581"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.308373 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 38249392c0df4d50b0e09f3671f92800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.308576 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet d401574e89014d2aaa5f98d0d9a2729f with delete_type TABLET_DATA_DELETED (replaced by tablet 0492ea6f9d0a4cdf9e339920863b54f9) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.297365 13525 raft_consensus.cc:493] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:50:13.308724 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64d02d043b714fe1849b322e84285581 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.308756 13525 raft_consensus.cc:515] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.309643 13525 leader_election.cc:290] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.309850 11753 ts_tablet_manager.cc:1403] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.140s user 0.003s sys 0.000s
I20260925 01:50:13.310143 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet cc4a51356880486a928181ee701f74d0 (table default.Table_4ad3881ff5874f4594e9c336a16513e4 [id=ad62203df2f049f2988e6c7ad5b5188d]). Expected version 2 got 0
I20260925 01:50:13.310528 11753 raft_consensus.cc:359] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.310684 11753 raft_consensus.cc:385] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.310732 11753 raft_consensus.cc:740] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.310910 11753 consensus_queue.cc:260] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.311196 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
I20260925 01:50:13.311228 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f1e725fe84552943563aa95687842" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.311911 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet aaa2f7ef888846ec9667916ba47084db (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]). Expected version 1 got 0
I20260925 01:50:13.314019 11753 ts_tablet_manager.cc:1434] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260925 01:50:13.314138 13458 raft_consensus.cc:493] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.314265 13458 raft_consensus.cc:515] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:13.314741 11753 tablet_bootstrap.cc:492] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.314893 13458 leader_election.cc:290] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.315007 13458 raft_consensus.cc:493] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.315102 13458 raft_consensus.cc:515] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.315593 13458 leader_election.cc:290] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.316623 11753 tablet_bootstrap.cc:654] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.317458 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a37a6deaeb24c99824b62fbb2d603b1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.318480 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd594870fa6a4ba190a18a48d821d72c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:13.318917 11314 leader_election.cc:343] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 95ac080782664fca8661c188ab822e89
I20260925 01:50:13.319103 11314 leader_election.cc:304] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.319489 13452 raft_consensus.cc:2749] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.319754 11314 leader_election.cc:343] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 1f1d2d998d834c21ab83694daae37520
W20260925 01:50:13.320029 11314 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 1f778b87d307483b9edb17dce7355a65
I20260925 01:50:13.321533 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 967) took 1260 ms. Trace:
I20260925 01:50:13.321731 11946 rpcz_store.cc:276] 0925 01:50:12.060795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.060846 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:12.964436 (+903590us) ts_tablet_manager.cc:1151] Deleting tablet 29f28e49791744428729279a79b6c9f1
0925 01:50:12.964444 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.021564 (+ 57120us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.181564 (+160000us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.321501 (+139937us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":903361}
I20260925 01:50:13.322613 11946 tablet_replica.cc:333] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:13.322729 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_c4b146df79f340bf9b1dc7663cdbbcaf [id=f8317c3550b14fe3abf468ea0d755b88]) successfully deleted
I20260925 01:50:13.322940 11946 raft_consensus.cc:2243] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:13.323169 11946 raft_consensus.cc:2272] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.323843 11946 ts_tablet_manager.cc:1916] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.326391 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e11534843fc644449b4f55ebcbcbaf39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.327364 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e11534843fc644449b4f55ebcbcbaf39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.328938 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 3702f09e45a14c80af716d642d30cdfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.321246 11427 heartbeater.cc:344] Connected to a master server at 127.10.159.253:42889
I20260925 01:50:13.339427 11953 ts_tablet_manager.cc:1929] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:13.339571 11953 log.cc:1199] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a9944a1422d14ae2b22451e67c477d5b
I20260925 01:50:13.339984 11953 ts_tablet_manager.cc:1950] T a9944a1422d14ae2b22451e67c477d5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:13.340381 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 696) took 8186 ms. Trace:
I20260925 01:50:13.340469 11953 rpcz_store.cc:276] 0925 01:50:05.153809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.153864 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:13.159526 (+8005662us) ts_tablet_manager.cc:1151] Deleting tablet a9944a1422d14ae2b22451e67c477d5b
0925 01:50:13.159543 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.235809 (+ 76266us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.339355 (+103546us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.340362 (+ 1007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3328,"tablet-delete.queue_time_us":7768443}
I20260925 01:50:13.340899 11953 tablet_replica.cc:333] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:13.341151 11953 raft_consensus.cc:2243] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:13.341423 11314 leader_election.cc:343] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a9068770de0b473488bd8ea4752fb15d
I20260925 01:50:13.271389 11754 tablet_bootstrap.cc:492] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.313517 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd594870fa6a4ba190a18a48d821d72c" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:13.314548 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.315604 13209 raft_consensus.cc:493] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.315742 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.353958 13356 log.cc:1199] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/406d31139e1e441aa6fe204168486e28
I20260925 01:50:13.353893 13209 raft_consensus.cc:515] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.354480 13356 ts_tablet_manager.cc:1950] T 406d31139e1e441aa6fe204168486e28 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:13.354717 13209 leader_election.cc:290] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.355042 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a9944a1422d14ae2b22451e67c477d5b (table default.Table_024ab99d505f4f6eaed9ebd195ac0ffd [id=a1a3b3d0054a4bff8de55b5c5e71880f]) successfully deleted
I20260925 01:50:13.355261 11754 tablet_bootstrap.cc:654] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.355392 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 945) took 2832 ms. Trace:
I20260925 01:50:13.355481 13356 rpcz_store.cc:276] 0925 01:50:10.522587 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.523661 (+ 1074us) service_pool.cc:224] Handling call
0925 01:50:13.075596 (+2551935us) ts_tablet_manager.cc:1151] Deleting tablet 406d31139e1e441aa6fe204168486e28
0925 01:50:13.075615 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.225824 (+150209us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.260994 (+ 35170us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.355370 (+ 94376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2551515}
I20260925 01:50:13.355866 13356 tablet_replica.cc:333] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:13.355939 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a5af9fb654d4c894e1cf4fd636c13" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.316265 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.317464 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:13.344208 11291 tablet.cc:2433] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260925 01:50:13.356509 11177 leader_election.cc:343] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.356726 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 406d31139e1e441aa6fe204168486e28 (table default.Table_5f4b4ce122da40e4b0960e58bf811412 [id=ffb823f8ca1948faaf21d345a1643605]) successfully deleted
W20260925 01:50:13.357337 11456 leader_election.cc:343] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:13.357764 10884 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 78595.3us
I20260925 01:50:13.357860 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a5af9fb654d4c894e1cf4fd636c13" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:13.358096 11514 raft_consensus.cc:2468] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:13.358559 11176 leader_election.cc:304] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:13.358942 13209 raft_consensus.cc:2804] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:13.359025 13209 raft_consensus.cc:493] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:13.359078 13209 raft_consensus.cc:3060] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.362747 13209 raft_consensus.cc:515] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.364163 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a5af9fb654d4c894e1cf4fd636c13" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:13.364359 11519 raft_consensus.cc:3060] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.364388 13209 leader_election.cc:290] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.368053 13356 raft_consensus.cc:2243] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:13.368237 13411 raft_consensus.cc:493] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.368381 13411 raft_consensus.cc:515] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:13.368476 13356 raft_consensus.cc:2272] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.369095 13356 ts_tablet_manager.cc:1916] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.369139 13411 leader_election.cc:290] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:13.369695 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8055cc9b06045449e6133298c8074e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:13.368163 11519 raft_consensus.cc:2468] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:13.370275 11456 leader_election.cc:343] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.370410 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a5af9fb654d4c894e1cf4fd636c13" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:13.370811 11176 leader_election.cc:304] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:13.370978 13533 raft_consensus.cc:493] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.371099 13533 raft_consensus.cc:515] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.371644 13533 leader_election.cc:290] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.371775 13533 raft_consensus.cc:2804] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:13.371865 13533 raft_consensus.cc:697] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:13.372080 13533 consensus_queue.cc:237] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:13.373251 11176 leader_election.cc:343] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 86c8c3bba9614539bfe3018461ad21f8
W20260925 01:50:13.370985 11177 leader_election.cc:343] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.374553 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_564e5d550937462b9b930df2e64cf028" } new_table_name: "default.Table_22458b20c75448128c9eb14d3654ed30" modify_external_catalogs: true
I20260925 01:50:13.375401 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c8c3bba9614539bfe3018461ad21f8" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.376071 11373 raft_consensus.cc:3060] T 9b4f4321544a4f1d9de2e50aa5d7b42a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:13.378417 11428 tablet.cc:2433] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 01:50:13.380525 11753 tablet_bootstrap.cc:492] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.380671 11753 ts_tablet_manager.cc:1403] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.066s user 0.008s sys 0.000s
I20260925 01:50:13.380745 11953 raft_consensus.cc:2272] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:13.381073 11177 leader_election.cc:343] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.381202 11177 leader_election.cc:304] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:13.381450 11953 ts_tablet_manager.cc:1916] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.381378 11753 raft_consensus.cc:359] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.381546 11753 raft_consensus.cc:385] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.381594 13420 raft_consensus.cc:2749] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:13.381610 11753 raft_consensus.cc:740] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.381862 11753 consensus_queue.cc:260] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.384372 11753 ts_tablet_manager.cc:1434] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:13.384690 11753 tablet_bootstrap.cc:492] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.386139 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3b0c24ce448a44b5a1f5576908672b20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.386817 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b0c24ce448a44b5a1f5576908672b20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.396195 11754 tablet_bootstrap.cc:492] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.396394 11754 ts_tablet_manager.cc:1403] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.125s user 0.002s sys 0.007s
I20260925 01:50:13.397271 11754 raft_consensus.cc:359] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.397516 11754 raft_consensus.cc:385] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.397584 11754 raft_consensus.cc:740] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.397819 11754 consensus_queue.cc:260] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.398655 11754 ts_tablet_manager.cc:1434] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:13.399006 11754 tablet_bootstrap.cc:492] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.401084 11754 tablet_bootstrap.cc:654] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.412147 13025 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" instance_seqno: 1790300980724084) as {username='slave'} at 127.10.159.195:56117; Asking this server to re-register.
I20260925 01:50:13.412436 11755 tablet_bootstrap.cc:492] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:13.412652 11755 ts_tablet_manager.cc:1403] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.144s user 0.011s sys 0.003s
I20260925 01:50:13.413590 11755 raft_consensus.cc:359] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.413853 11755 raft_consensus.cc:385] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.413961 11755 raft_consensus.cc:740] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.414289 11755 consensus_queue.cc:260] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.414659 11571 heartbeater.cc:461] Registering TS with master...
I20260925 01:50:13.414909 13036 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" instance_seqno: 1790300980193841) as {username='slave'} at 127.10.159.194:42947; Asking this server to re-register.
W20260925 01:50:13.416471 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e76fe124682a483e84f96d1ed733744f consensus state has no leader
W20260925 01:50:13.416990 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92fec7ce0a494d47ba27dd61c2a87608 consensus state has no leader
I20260925 01:50:13.414686 11753 tablet_bootstrap.cc:654] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.418913 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_38b0c6e5f96842ad958e8d24379e8b22" } modify_external_catalogs: true
I20260925 01:50:13.419109 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_38b0c6e5f96842ad958e8d24379e8b22" } modify_external_catalogs: true
I20260925 01:50:13.421423 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.422304 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7b39199d7fc14264aa8010c7000a80fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.425124 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b39199d7fc14264aa8010c7000a80fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.424564 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_efa90132b756448babd6a66ce360d744" } modify_external_catalogs: true
I20260925 01:50:13.426911 13036 ts_manager.cc:194] Registered new tserver with Master: 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.426877 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_efa90132b756448babd6a66ce360d744" } modify_external_catalogs: true
I20260925 01:50:13.429869 13025 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" instance_seqno: 1790300979676140) as {username='slave'} at 127.10.159.193:49947; Asking this server to re-register.
I20260925 01:50:13.434943 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1050 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:50:13.436753 11290 heartbeater.cc:461] Registering TS with master...
W20260925 01:50:13.437417 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cabb4f9eb185456889acadaa624e66bb has no consensus state
I20260925 01:50:13.442034 11680 master_service.cc:960] ReplaceTablet: received request to replace tablet 9e86bd9a65dd46f09d87ddd831552b59 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:13.442884 11753 tablet_bootstrap.cc:492] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.443158 11753 ts_tablet_manager.cc:1403] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.000s
I20260925 01:50:13.444324 11753 raft_consensus.cc:359] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.444591 11753 raft_consensus.cc:385] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.444721 11753 raft_consensus.cc:740] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.444977 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f064ea2300ec4c6e809d8b54a18da7c0" } modify_external_catalogs: true
I20260925 01:50:13.444994 11753 consensus_queue.cc:260] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.445147 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f064ea2300ec4c6e809d8b54a18da7c0" } modify_external_catalogs: true
I20260925 01:50:13.447305 13411 raft_consensus.cc:493] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.447459 13411 raft_consensus.cc:515] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.448094 13411 leader_election.cc:290] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.448367 11754 tablet_bootstrap.cc:492] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.448617 11754 ts_tablet_manager.cc:1403] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.004s
I20260925 01:50:13.448791 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d401574e89014d2aaa5f98d0d9a2729f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:13.449232 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet ff70e44b72d1425c81751ff0b3d93b11 with delete_type TABLET_DATA_DELETED (replaced by tablet 03487a3fa9574fd583d9c95d0624203c) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:13.449653 11456 leader_election.cc:343] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.449637 11754 raft_consensus.cc:359] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.449803 11754 raft_consensus.cc:385] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.449858 11754 raft_consensus.cc:740] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.450103 11754 consensus_queue.cc:260] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:13.450368 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7457026bbf14466bb3585d514d4d898 consensus state has no leader
I20260925 01:50:13.450656 11754 ts_tablet_manager.cc:1434] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:13.457508 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet f385af75e11c4643b4e7c2d899ee99a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.457645 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8d062c3eaca145699f6c9986f5a956a3" } new_table_name: "default.Table_abbd127f2c334d6bbfd6097085ce053a" modify_external_catalogs: true
I20260925 01:50:13.458254 13025 ts_manager.cc:194] Registered new tserver with Master: b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:13.461203 11754 tablet_bootstrap.cc:492] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.461726 11679 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ee02eb5241724e1a8a9ade9adb5d0392" } modify_external_catalogs: true
I20260925 01:50:13.461900 11679 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ee02eb5241724e1a8a9ade9adb5d0392" } modify_external_catalogs: true
I20260925 01:50:13.463124 11754 tablet_bootstrap.cc:654] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.470976 13356 ts_tablet_manager.cc:1929] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:13.471109 13356 log.cc:1199] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/35b123ac1e894239875404438ed19927
I20260925 01:50:13.472494 11753 ts_tablet_manager.cc:1434] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.029s user 0.001s sys 0.000s
I20260925 01:50:13.473395 11753 tablet_bootstrap.cc:492] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.473721 13356 ts_tablet_manager.cc:1950] T 35b123ac1e894239875404438ed19927 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:13.473965 13533 raft_consensus.cc:493] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.474110 13533 raft_consensus.cc:515] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.474615 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 944) took 2952 ms. Trace:
I20260925 01:50:13.474764 13533 leader_election.cc:290] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.475404 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff70e44b72d1425c81751ff0b3d93b11" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:13.479245 11519 raft_consensus.cc:2468] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:13.479749 11176 leader_election.cc:304] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:13.480122 13533 raft_consensus.cc:2804] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:13.480201 13533 raft_consensus.cc:493] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:13.480257 13533 raft_consensus.cc:3060] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.483299 13533 raft_consensus.cc:515] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.484467 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff70e44b72d1425c81751ff0b3d93b11" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:13.484670 11519 raft_consensus.cc:3060] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.485267 13533 leader_election.cc:290] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.488813 11519 raft_consensus.cc:2468] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:13.489439 11176 leader_election.cc:304] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:13.489825 13533 raft_consensus.cc:2804] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:13.490119 13533 raft_consensus.cc:697] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:13.490442 13533 consensus_queue.cc:237] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.493330 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet ab8d5af739854f939ab585d943e7b7ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:01 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.474694 13356 rpcz_store.cc:276] 0925 01:50:10.522104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.523836 (+ 1732us) service_pool.cc:224] Handling call
0925 01:50:13.355809 (+2831973us) ts_tablet_manager.cc:1151] Deleting tablet 35b123ac1e894239875404438ed19927
0925 01:50:13.355822 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.387601 (+ 31779us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.470899 (+ 83298us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.474594 (+ 3695us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11933,"tablet-delete.queue_time_us":2831810}
I20260925 01:50:13.496693 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 35b123ac1e894239875404438ed19927 (table default.Table_3bcedabba6c244178b5f3479e7996282 [id=5405c0f51c3b4db8a58b97b60ea65777]) successfully deleted
I20260925 01:50:13.498476 13356 tablet_replica.cc:333] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:13.498785 13356 raft_consensus.cc:2243] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:13.416746 11427 heartbeater.cc:461] Registering TS with master...
I20260925 01:50:13.430399 13321 raft_consensus.cc:493] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:13.499662 13321 raft_consensus.cc:515] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.500378 13321 leader_election.cc:290] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.501008 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4dc36be8fb15447789f574e806bbb81e" } modify_external_catalogs: true
I20260925 01:50:13.501169 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4dc36be8fb15447789f574e806bbb81e" } modify_external_catalogs: true
I20260925 01:50:13.502003 11755 ts_tablet_manager.cc:1434] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.089s user 0.001s sys 0.001s
I20260925 01:50:13.502362 11755 tablet_bootstrap.cc:492] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:13.503139 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b06bd286d49842a79c6e999d9a4a3cf2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.503646 13356 raft_consensus.cc:2272] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:13.503793 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b06bd286d49842a79c6e999d9a4a3cf2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.504226 13036 ts_manager.cc:194] Registered new tserver with Master: aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.504303 13356 ts_tablet_manager.cc:1916] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.510749 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_117c3527619d4f8091a562c31100c670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.511639 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_117c3527619d4f8091a562c31100c670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.519354 11754 tablet_bootstrap.cc:492] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.519547 11754 ts_tablet_manager.cc:1403] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.003s
I20260925 01:50:13.520398 11754 raft_consensus.cc:359] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.520569 11754 raft_consensus.cc:385] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.520619 11754 raft_consensus.cc:740] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.520846 11754 consensus_queue.cc:260] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.521342 11754 ts_tablet_manager.cc:1434] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:13.521615 11754 tablet_bootstrap.cc:492] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:13.523265 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00345732f7314624831b4cfc59e981f4 consensus state has no leader
I20260925 01:50:13.523365 11754 tablet_bootstrap.cc:654] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.524796 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_52e6c161d59b404ca75a22cc9f043b7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.525418 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52e6c161d59b404ca75a22cc9f043b7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.525887 11753 tablet_bootstrap.cc:654] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.527482 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1050 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:50:13.530987 13533 raft_consensus.cc:493] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.531129 13533 raft_consensus.cc:515] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.533008 12952 leader_election.cc:304] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:50:13.533478 13471 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 01:50:13.538296 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385af75e11c4643b4e7c2d899ee99a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:13.538672 11519 raft_consensus.cc:2468] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:13.539258 11176 leader_election.cc:304] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:13.539583 13420 raft_consensus.cc:2804] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:13.539673 13420 raft_consensus.cc:493] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:13.539739 13420 raft_consensus.cc:3060] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.541812 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 0749a0ae58df4ff8b74a86f072332fad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.542619 13420 raft_consensus.cc:515] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.543771 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385af75e11c4643b4e7c2d899ee99a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:13.544045 11519 raft_consensus.cc:3060] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.544521 13420 leader_election.cc:290] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.544688 13533 leader_election.cc:290] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.546638 13551 catalog_manager.cc:1308] Loaded cluster ID: 11c5c376f1da40aaa00f02199edd4a80
I20260925 01:50:13.548344 11519 raft_consensus.cc:2468] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:13.548990 11176 leader_election.cc:304] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:13.549299 13533 raft_consensus.cc:2804] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:13.549832 13533 raft_consensus.cc:697] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:13.550195 13533 consensus_queue.cc:237] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.562170 11673 master_service.cc:960] ReplaceTablet: received request to replace tablet 1cac299e4f8e4c9d90f244cd8719005a from {username='slave'} at 127.0.0.1:60372
W20260925 01:50:13.563434 11457 leader_election.cc:343] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.563584 11457 leader_election.cc:304] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.563839 13411 raft_consensus.cc:2749] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.568007 11457 leader_election.cc:343] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.568146 11457 leader_election.cc:304] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.568357 13411 raft_consensus.cc:2749] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.568802 11457 leader_election.cc:343] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.568907 11457 leader_election.cc:304] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.569093 13411 raft_consensus.cc:2749] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:13.476954 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff70e44b72d1425c81751ff0b3d93b11" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.485051 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff70e44b72d1425c81751ff0b3d93b11" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:13.447885 11953 ts_tablet_manager.cc:1929] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:13.570658 11953 log.cc:1199] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/96b68399843a422b8da3ddfab2c522e6
I20260925 01:50:13.571110 11953 ts_tablet_manager.cc:1950] T 96b68399843a422b8da3ddfab2c522e6 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:50:13.571081 11177 leader_election.cc:343] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.536973 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385af75e11c4643b4e7c2d899ee99a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.544373 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f385af75e11c4643b4e7c2d899ee99a4" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:13.571453 11177 leader_election.cc:343] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:13.572146 11177 leader_election.cc:343] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:13.572464 11177 leader_election.cc:343] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.572654 11755 tablet_bootstrap.cc:654] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.573222 11753 tablet_bootstrap.cc:492] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.573405 11753 ts_tablet_manager.cc:1403] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.000s
I20260925 01:50:13.574234 11753 raft_consensus.cc:359] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.574613 11753 raft_consensus.cc:385] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.574698 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 697) took 8420 ms. Trace:
I20260925 01:50:13.574730 11753 raft_consensus.cc:740] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.574784 11953 rpcz_store.cc:276] 0925 01:50:05.154528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.154579 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:13.340846 (+8186267us) ts_tablet_manager.cc:1151] Deleting tablet 96b68399843a422b8da3ddfab2c522e6
0925 01:50:13.340857 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.385262 (+ 44405us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.447812 (+ 62550us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.574677 (+126865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3,"tablet-delete.queue_time_us":7949701}
I20260925 01:50:13.575169 11753 consensus_queue.cc:260] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.575404 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 96b68399843a422b8da3ddfab2c522e6 (table default.Table_7ad0a76f459148b29a5a3c029573cc5b [id=74fd2e729fe648ab90e6e4e9876d28f0]) successfully deleted
I20260925 01:50:13.575723 11753 ts_tablet_manager.cc:1434] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:13.575942 13420 raft_consensus.cc:493] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.576066 13420 raft_consensus.cc:515] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.576223 11953 tablet_replica.cc:333] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:13.576485 11953 raft_consensus.cc:2243] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:13.576625 11953 raft_consensus.cc:2272] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.576669 13420 leader_election.cc:290] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.577152 11953 ts_tablet_manager.cc:1916] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.577399 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602af3d6e7bb44f8a316691019f85c25" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:13.577972 11177 leader_election.cc:343] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.578614 11753 tablet_bootstrap.cc:492] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.579705 13411 raft_consensus.cc:493] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.579839 13411 raft_consensus.cc:515] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.580279 11753 tablet_bootstrap.cc:654] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.580472 13411 leader_election.cc:290] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.583873 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d5af739854f939ab585d943e7b7ca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:13.584599 11456 leader_election.cc:343] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.585355 11215 tablet_service.cc:1511] Processing CreateTablet for tablet db1b699f780b4568b603f800ecbe298e (DEFAULT_TABLE table=default.Table_9765e66a22054b0a936048c1e6fbbb61 [id=7bfd018856a945ecb4bf882381fab459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.585743 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1b699f780b4568b603f800ecbe298e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.586508 11490 tablet_service.cc:1511] Processing CreateTablet for tablet db1b699f780b4568b603f800ecbe298e (DEFAULT_TABLE table=default.Table_9765e66a22054b0a936048c1e6fbbb61 [id=7bfd018856a945ecb4bf882381fab459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.586557 11353 tablet_service.cc:1511] Processing CreateTablet for tablet db1b699f780b4568b603f800ecbe298e (DEFAULT_TABLE table=default.Table_9765e66a22054b0a936048c1e6fbbb61 [id=7bfd018856a945ecb4bf882381fab459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.586905 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1b699f780b4568b603f800ecbe298e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.586912 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1b699f780b4568b603f800ecbe298e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.593909 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 57db994a77c84338bf69f9334d6ef765 (DEFAULT_TABLE table=default.Table_be3d5d08cb224209b54b3d5ec64152db [id=c972ff94e3824e04ac9d43fce49c278d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.594403 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57db994a77c84338bf69f9334d6ef765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.601069 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602af3d6e7bb44f8a316691019f85c25" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:13.601269 11519 raft_consensus.cc:2468] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:13.601792 11176 leader_election.cc:304] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:13.602145 13551 catalog_manager.cc:1601] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: loading cluster ID for follower catalog manager: success
W20260925 01:50:13.570107 11314 leader_election.cc:343] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 1f1d2d998d834c21ab83694daae37520
I20260925 01:50:13.602488 13507 raft_consensus.cc:2804] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:13.602483 11314 leader_election.cc:304] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.602561 13507 raft_consensus.cc:493] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:13.602622 13507 raft_consensus.cc:3060] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.603724 13321 raft_consensus.cc:2749] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.604168 11314 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 1f778b87d307483b9edb17dce7355a65
I20260925 01:50:13.604267 11314 leader_election.cc:304] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.604643 11953 ts_tablet_manager.cc:1929] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:13.604739 11953 log.cc:1199] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c28c8f00a8634ef89e4773b62e095b74
I20260925 01:50:13.605048 11953 ts_tablet_manager.cc:1950] T c28c8f00a8634ef89e4773b62e095b74 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:13.605454 13507 raft_consensus.cc:515] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.607545 13321 raft_consensus.cc:2749] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:13.608223 13356 ts_tablet_manager.cc:1929] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:13.608354 13356 log.cc:1199] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/226498ea628a475d8fcab28a6598a819
I20260925 01:50:13.608721 13356 ts_tablet_manager.cc:1950] T 226498ea628a475d8fcab28a6598a819 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:13.609769 13507 leader_election.cc:290] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:13.610356 11314 leader_election.cc:343] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a9068770de0b473488bd8ea4752fb15d
I20260925 01:50:13.610484 11314 leader_election.cc:304] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.610782 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602af3d6e7bb44f8a316691019f85c25" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:13.611001 11519 raft_consensus.cc:3060] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:13.611282 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602af3d6e7bb44f8a316691019f85c25" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:13.611801 11177 leader_election.cc:343] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.612098 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 57db994a77c84338bf69f9334d6ef765 (DEFAULT_TABLE table=default.Table_be3d5d08cb224209b54b3d5ec64152db [id=c972ff94e3824e04ac9d43fce49c278d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.612574 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57db994a77c84338bf69f9334d6ef765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.612751 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 57db994a77c84338bf69f9334d6ef765 (DEFAULT_TABLE table=default.Table_be3d5d08cb224209b54b3d5ec64152db [id=c972ff94e3824e04ac9d43fce49c278d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.613117 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57db994a77c84338bf69f9334d6ef765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.616418 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 946) took 3093 ms. Trace:
I20260925 01:50:13.616523 13356 rpcz_store.cc:276] 0925 01:50:10.522689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.524133 (+ 1444us) service_pool.cc:224] Handling call
0925 01:50:13.498400 (+2974267us) ts_tablet_manager.cc:1151] Deleting tablet 226498ea628a475d8fcab28a6598a819
0925 01:50:13.498418 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.534994 (+ 36576us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.608167 (+ 73173us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.616362 (+ 8195us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2974124}
I20260925 01:50:13.617076 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 226498ea628a475d8fcab28a6598a819 (table default.Table_71c7a46468e24855b65e14b9221f5930 [id=cead6e15d1894994bb2fdaa3d7f0d88d]) successfully deleted
I20260925 01:50:13.619292 13321 raft_consensus.cc:2749] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:13.620631 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 949) took 3081 ms. Trace:
I20260925 01:50:13.620776 13356 rpcz_store.cc:276] 0925 01:50:10.538944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.539008 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:13.620459 (+3081451us) ts_tablet_manager.cc:1151] Deleting tablet 2c93bb7a34f94deaa65f8b588c604b81
0925 01:50:13.620469 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.620578 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3081243}
W20260925 01:50:13.621230 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 2c93bb7a34f94deaa65f8b588c604b81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c93bb7a34f94deaa65f8b588c604b81 already in progress: creating tablet
W20260925 01:50:13.622561 11314 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:50:13.623512 13356 tablet_replica.cc:333] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:13.624748 13356 raft_consensus.cc:2243] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:13.625931 13356 raft_consensus.cc:2272] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.626820 13356 ts_tablet_manager.cc:1916] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.628458 11492 tablet_service.cc:1511] Processing CreateTablet for tablet fe377fd17b8441b6a7feb807d1167850 (DEFAULT_TABLE table=default.Table_a2a3e2f46f664f189955e806cc8c0757 [id=26bb19b7508249b78301f00230bd0330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.628866 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe377fd17b8441b6a7feb807d1167850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.627904 11215 tablet_service.cc:1511] Processing CreateTablet for tablet fe377fd17b8441b6a7feb807d1167850 (DEFAULT_TABLE table=default.Table_a2a3e2f46f664f189955e806cc8c0757 [id=26bb19b7508249b78301f00230bd0330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.629230 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe377fd17b8441b6a7feb807d1167850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.629254 11753 tablet_bootstrap.cc:492] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.629366 11753 ts_tablet_manager.cc:1403] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260925 01:50:13.630013 11753 raft_consensus.cc:359] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.630195 11753 raft_consensus.cc:385] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.630244 11753 raft_consensus.cc:740] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.630419 11753 consensus_queue.cc:260] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.634981 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]). Expected version 2 got 0
I20260925 01:50:13.635181 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 75740fd25d274673b712d630962323ef (DEFAULT_TABLE table=default.Table_ad3a481c07244253b0af257ba857a247 [id=051dfa56a27a4655bac2a715a5ec0282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.635571 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75740fd25d274673b712d630962323ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.636154 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f82704d6ddcb4ac9b15dd5ba8fc31477" } new_table_name: "default.Table_372a9eb9b9fb460eade21be6215b106d" modify_external_catalogs: true
I20260925 01:50:13.636992 11753 ts_tablet_manager.cc:1434] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:50:13.637280 11753 tablet_bootstrap.cc:492] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.638396 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 75740fd25d274673b712d630962323ef (DEFAULT_TABLE table=default.Table_ad3a481c07244253b0af257ba857a247 [id=051dfa56a27a4655bac2a715a5ec0282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.638738 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75740fd25d274673b712d630962323ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.638855 11753 tablet_bootstrap.cc:654] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.638980 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 856eae329c5b4929a6f26385d1ece0c3 (DEFAULT_TABLE table=default.Table_3339d70d2a3c4e8fbab219c2001f5430 [id=c1492e1cafdc450896aa8ba08c1739b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.639312 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856eae329c5b4929a6f26385d1ece0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.641939 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_7e3bfe8ebb994997a8baf88fd0dcbf5c" } new_table_name: "default.Table_25110993bfc646ffb56dbfc8d197541a" modify_external_catalogs: true
I20260925 01:50:13.642477 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 9539f4091dfe419f8be3ec159165e110 (DEFAULT_TABLE table=default.Table_451dfd6e05704c959db39bdf1cccc265 [id=83e12f80810f4901b42c42b59b02734e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.642926 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9539f4091dfe419f8be3ec159165e110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.643389 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet bfc152df745b46fb84aec1c9fa017ba5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:05 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.643914 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 856eae329c5b4929a6f26385d1ece0c3 (DEFAULT_TABLE table=default.Table_3339d70d2a3c4e8fbab219c2001f5430 [id=c1492e1cafdc450896aa8ba08c1739b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.644543 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856eae329c5b4929a6f26385d1ece0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.649736 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1b0d592dcd7a4a119befea22c35f5b2d
I20260925 01:50:13.649680 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_28d5478034e044e8b29c2fed007c3dc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.650367 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28d5478034e044e8b29c2fed007c3dc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.650934 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3943c5408eb1475a9c0002764673e7d5" } new_table_name: "default.Table_781ee6b3999f45b88fbe3d3a0044a539" modify_external_catalogs: true
I20260925 01:50:13.651080 11754 tablet_bootstrap.cc:492] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.651292 11754 ts_tablet_manager.cc:1403] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.130s user 0.011s sys 0.003s
I20260925 01:50:13.652382 11754 raft_consensus.cc:359] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.652611 11754 raft_consensus.cc:385] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.652735 11754 raft_consensus.cc:740] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.653028 11754 consensus_queue.cc:260] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.653609 11754 ts_tablet_manager.cc:1434] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:13.653959 11754 tablet_bootstrap.cc:492] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.656284 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 48a2285922eb4c94bf0d7eadc41dd409 (DEFAULT_TABLE table=default.Table_4b0fbc53a7e8455499f24027a13045f5 [id=7a5fc27f7b844dd5a667ea56c84cd25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.656775 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a2285922eb4c94bf0d7eadc41dd409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.657043 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 48a2285922eb4c94bf0d7eadc41dd409 (DEFAULT_TABLE table=default.Table_4b0fbc53a7e8455499f24027a13045f5 [id=7a5fc27f7b844dd5a667ea56c84cd25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.657442 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a2285922eb4c94bf0d7eadc41dd409. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:13.622786 11314 leader_election.cc:343] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: ae948bf42ae34a7ab72112d5f1f02585
W20260925 01:50:13.659611 11314 leader_election.cc:343] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 98ffeb9d70374afdb72a728d7b211d33
I20260925 01:50:13.660228 13411 raft_consensus.cc:493] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.660382 13411 raft_consensus.cc:515] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.660944 13411 leader_election.cc:290] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.661245 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d592dcd7a4a119befea22c35f5b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.664104 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8055cc9b06045449e6133298c8074e1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.664410 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d401574e89014d2aaa5f98d0d9a2729f" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.665395 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d5af739854f939ab585d943e7b7ca" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.665802 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5122b8c24d3442a1a52ff0b003d65ffb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.666864 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5122b8c24d3442a1a52ff0b003d65ffb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:13.667294 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 9539f4091dfe419f8be3ec159165e110 (DEFAULT_TABLE table=default.Table_451dfd6e05704c959db39bdf1cccc265 [id=83e12f80810f4901b42c42b59b02734e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.667711 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9539f4091dfe419f8be3ec159165e110. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:13.668332 11456 leader_election.cc:343] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.670984 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d592dcd7a4a119befea22c35f5b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.678910 11946 ts_tablet_manager.cc:1929] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:13.679032 11946 log.cc:1199] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5048a0fca2e64ffa9f19000f48a4c090
I20260925 01:50:13.679263 11753 tablet_bootstrap.cc:492] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:13.679343 11946 ts_tablet_manager.cc:1950] T 5048a0fca2e64ffa9f19000f48a4c090 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:13.679387 11753 ts_tablet_manager.cc:1403] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.000s
I20260925 01:50:13.680368 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 968) took 1610 ms. Trace:
I20260925 01:50:13.680464 11946 rpcz_store.cc:276] 0925 01:50:12.070333 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.070720 (+ 387us) service_pool.cc:224] Handling call
0925 01:50:13.322547 (+1251827us) ts_tablet_manager.cc:1151] Deleting tablet 5048a0fca2e64ffa9f19000f48a4c090
0925 01:50:13.322560 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.552082 (+229522us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.678847 (+126765us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.680329 (+ 1482us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251619}
I20260925 01:50:13.681027 11946 tablet_replica.cc:333] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:13.681236 11946 raft_consensus.cc:2243] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:13.681442 11946 raft_consensus.cc:2272] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.681402 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5048a0fca2e64ffa9f19000f48a4c090 (table default.Table_fbb2f99ff1e94b04ac906f20c094f645 [id=fc1e6e3a4c5845d3865d8bf7bf658dea]) successfully deleted
I20260925 01:50:13.682013 11946 ts_tablet_manager.cc:1916] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.682415 11753 raft_consensus.cc:359] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.683468 11753 raft_consensus.cc:385] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.683707 11753 raft_consensus.cc:740] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.684106 11753 consensus_queue.cc:260] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.685622 11753 ts_tablet_manager.cc:1434] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:50:13.689944 11755 tablet_bootstrap.cc:492] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:13.690188 11755 ts_tablet_manager.cc:1403] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.188s user 0.004s sys 0.000s
I20260925 01:50:13.694432 11753 tablet_bootstrap.cc:492] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.695871 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 2c462a02004b44268c82176348aa9d6c (DEFAULT_TABLE table=default.Table_a251f96400af424cb8fe83c65616f9b8 [id=c1efab03b4124f989b3e0ea679643c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.688086 11519 raft_consensus.cc:2468] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:13.696449 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c462a02004b44268c82176348aa9d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.697016 11176 leader_election.cc:304] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:13.697243 11753 tablet_bootstrap.cc:654] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.697386 13209 raft_consensus.cc:2804] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:13.697592 13209 raft_consensus.cc:697] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:13.697947 13209 consensus_queue.cc:237] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.699303 11214 tablet_service.cc:1511] Processing CreateTablet for tablet a167a377d9cf4455b5a7e272ee4e791b (DEFAULT_TABLE table=default.Table_ab6c45a997374d28a59c1a32bc0a3b19 [id=c13bbc5239a74934a75ed153730dcb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.699762 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a167a377d9cf4455b5a7e272ee4e791b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.702389 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 73191f40cf084c3e8a3e9e605519dc8f (DEFAULT_TABLE table=default.Table_aea9aebcc6dd4d169ecab0e4c3dce453 [id=2ce1142f620d4a73a6469cc5be13fee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.702811 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73191f40cf084c3e8a3e9e605519dc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.707047 11490 tablet_service.cc:1511] Processing CreateTablet for tablet a167a377d9cf4455b5a7e272ee4e791b (DEFAULT_TABLE table=default.Table_ab6c45a997374d28a59c1a32bc0a3b19 [id=c13bbc5239a74934a75ed153730dcb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.707516 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a167a377d9cf4455b5a7e272ee4e791b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.711092 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 2c462a02004b44268c82176348aa9d6c (DEFAULT_TABLE table=default.Table_a251f96400af424cb8fe83c65616f9b8 [id=c1efab03b4124f989b3e0ea679643c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.711463 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c462a02004b44268c82176348aa9d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.721338 11754 tablet_bootstrap.cc:654] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.725096 11345 tablet_service.cc:1511] Processing CreateTablet for tablet a167a377d9cf4455b5a7e272ee4e791b (DEFAULT_TABLE table=default.Table_ab6c45a997374d28a59c1a32bc0a3b19 [id=c13bbc5239a74934a75ed153730dcb61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.725648 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 73191f40cf084c3e8a3e9e605519dc8f (DEFAULT_TABLE table=default.Table_aea9aebcc6dd4d169ecab0e4c3dce453 [id=2ce1142f620d4a73a6469cc5be13fee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.726243 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 2c462a02004b44268c82176348aa9d6c (DEFAULT_TABLE table=default.Table_a251f96400af424cb8fe83c65616f9b8 [id=c1efab03b4124f989b3e0ea679643c42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.726933 11755 raft_consensus.cc:359] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.727263 11755 raft_consensus.cc:385] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.727368 11755 raft_consensus.cc:740] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.727689 11755 consensus_queue.cc:260] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.728438 11755 ts_tablet_manager.cc:1434] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260925 01:50:13.729167 13411 raft_consensus.cc:493] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.729331 13411 raft_consensus.cc:515] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.730123 13411 leader_election.cc:290] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.737100 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 313ef1a795454be38e6ab617c3b21bf5
I20260925 01:50:13.738134 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 9e86bd9a65dd46f09d87ddd831552b59
I20260925 01:50:13.738554 11680 catalog_manager.cc:6934] ReplaceTablet: tablet 9e86bd9a65dd46f09d87ddd831552b59 deleted and replaced by tablet 912663c9513847748864b8c2064714b6
I20260925 01:50:13.739157 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 262ea578b7ea4ffa87bd5b8d398e6e2a
I20260925 01:50:13.739579 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 71a64863f0744f44943113d7c60806b7
I20260925 01:50:13.740343 13458 raft_consensus.cc:493] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.740480 13458 raft_consensus.cc:515] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.623157 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 695) took 8470 ms. Trace:
I20260925 01:50:13.740860 11953 rpcz_store.cc:276] 0925 01:50:05.152944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.159590 (+ 6646us) service_pool.cc:224] Handling call
0925 01:50:13.575114 (+8415524us) ts_tablet_manager.cc:1151] Deleting tablet c28c8f00a8634ef89e4773b62e095b74
0925 01:50:13.576183 (+ 1069us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.597644 (+ 21461us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.604590 (+ 6946us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.623134 (+ 18544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7576,"tablet-delete.queue_time_us":8183659}
I20260925 01:50:13.741110 13458 leader_election.cc:290] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.624857 13321 raft_consensus.cc:493] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.741351 13321 raft_consensus.cc:515] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:13.626710 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 856eae329c5b4929a6f26385d1ece0c3 (DEFAULT_TABLE table=default.Table_3339d70d2a3c4e8fbab219c2001f5430 [id=c1492e1cafdc450896aa8ba08c1739b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.742177 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 313ef1a795454be38e6ab617c3b21bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.742362 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e86bd9a65dd46f09d87ddd831552b59 with delete_type TABLET_DATA_DELETED (replaced by tablet 912663c9513847748864b8c2064714b6) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.742543 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.742653 11350 tablet_service.cc:1558] Processing DeleteTablet for tablet 71a64863f0744f44943113d7c60806b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.636085 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 75740fd25d274673b712d630962323ef (DEFAULT_TABLE table=default.Table_ad3a481c07244253b0af257ba857a247 [id=051dfa56a27a4655bac2a715a5ec0282]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.652798 11352 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b0d592dcd7a4a119befea22c35f5b2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.655237 11357 tablet_service.cc:1511] Processing CreateTablet for tablet 9539f4091dfe419f8be3ec159165e110 (DEFAULT_TABLE table=default.Table_451dfd6e05704c959db39bdf1cccc265 [id=83e12f80810f4901b42c42b59b02734e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.656631 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 48a2285922eb4c94bf0d7eadc41dd409 (DEFAULT_TABLE table=default.Table_4b0fbc53a7e8455499f24027a13045f5 [id=7a5fc27f7b844dd5a667ea56c84cd25d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.746708 13551 catalog_manager.cc:1623] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: acquiring CA information for follower catalog manager: success
I20260925 01:50:13.747113 11498 tablet_service.cc:1558] Processing DeleteTablet for tablet 71a64863f0744f44943113d7c60806b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.748080 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e86bd9a65dd46f09d87ddd831552b59 with delete_type TABLET_DATA_DELETED (replaced by tablet 912663c9513847748864b8c2064714b6) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.748390 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 313ef1a795454be38e6ab617c3b21bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:13.728891 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 56769.2us
W20260925 01:50:13.750385 11314 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:50:13.750524 11314 leader_election.cc:304] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.750756 13458 raft_consensus.cc:2749] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:13.753031 11314 leader_election.cc:343] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 98ffeb9d70374afdb72a728d7b211d33
I20260925 01:50:13.753144 11314 leader_election.cc:304] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:13.753544 11314 leader_election.cc:343] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: ae948bf42ae34a7ab72112d5f1f02585
I20260925 01:50:13.753625 11314 leader_election.cc:304] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.754287 13576 raft_consensus.cc:2749] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:13.754556 13576 raft_consensus.cc:2749] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:13.751332 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 73191f40cf084c3e8a3e9e605519dc8f (DEFAULT_TABLE table=default.Table_aea9aebcc6dd4d169ecab0e4c3dce453 [id=2ce1142f620d4a73a6469cc5be13fee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.759044 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73191f40cf084c3e8a3e9e605519dc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.765420 11492 tablet_service.cc:1511] Processing CreateTablet for tablet 114f2c6439314883bdc60871f0169e15 (DEFAULT_TABLE table=default.Table_ac24296ff95c4faaa1b79f2e134a175e [id=a334987333684b11bad0b212f017814e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.765933 11492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114f2c6439314883bdc60871f0169e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.767083 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 114f2c6439314883bdc60871f0169e15 (DEFAULT_TABLE table=default.Table_ac24296ff95c4faaa1b79f2e134a175e [id=a334987333684b11bad0b212f017814e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.767630 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a167a377d9cf4455b5a7e272ee4e791b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.769698 13321 leader_election.cc:290] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.769860 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 700) took 8555 ms. Trace:
I20260925 01:50:13.770085 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856eae329c5b4929a6f26385d1ece0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.770433 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73191f40cf084c3e8a3e9e605519dc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.769954 11953 rpcz_store.cc:276] 0925 01:50:05.214225 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.214278 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:13.769676 (+8555398us) ts_tablet_manager.cc:1151] Deleting tablet 9b75b12794fa4f4fa53156c212632cdc
0925 01:50:13.769686 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.769839 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8374920}
I20260925 01:50:13.770794 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 701) took 8553 ms. Trace:
I20260925 01:50:13.770862 11953 rpcz_store.cc:276] 0925 01:50:05.217294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.217519 (+ 225us) service_pool.cc:224] Handling call
0925 01:50:13.770688 (+8553169us) ts_tablet_manager.cc:1151] Deleting tablet 62eeb75b322e45a5bdbd63dbd4c6e582
0925 01:50:13.770697 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.770776 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8375752}
I20260925 01:50:13.771216 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 702) took 8553 ms. Trace:
I20260925 01:50:13.771277 11953 rpcz_store.cc:276] 0925 01:50:05.217382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.217695 (+ 313us) service_pool.cc:224] Handling call
0925 01:50:13.771060 (+8553365us) ts_tablet_manager.cc:1151] Deleting tablet ae05900043cb49d29f528fcbe4c8ada0
0925 01:50:13.771067 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.771202 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8376096}
I20260925 01:50:13.771612 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 703) took 8554 ms. Trace:
I20260925 01:50:13.771672 11953 rpcz_store.cc:276] 0925 01:50:05.217474 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.217790 (+ 316us) service_pool.cc:224] Handling call
0925 01:50:13.771460 (+8553670us) ts_tablet_manager.cc:1151] Deleting tablet b97f703869d4471cb940ef654203ec2b
0925 01:50:13.771469 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.771599 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8376427}
I20260925 01:50:13.771905 11953 tablet_replica.cc:333] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:13.772095 11953 raft_consensus.cc:2243] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:13.772228 11953 raft_consensus.cc:2272] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:13.772861 11953 ts_tablet_manager.cc:1916] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:13.628315 11342 tablet_service.cc:1511] Processing CreateTablet for tablet fe377fd17b8441b6a7feb807d1167850 (DEFAULT_TABLE table=default.Table_a2a3e2f46f664f189955e806cc8c0757 [id=26bb19b7508249b78301f00230bd0330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.774260 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe377fd17b8441b6a7feb807d1167850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.774652 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c28c8f00a8634ef89e4773b62e095b74 (table default.Table_6a8f6bbf5d5d430f89f28a60bf15e379 [id=bb36d144a12e4176974ca7119a4681c3]) successfully deleted
I20260925 01:50:13.775071 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114f2c6439314883bdc60871f0169e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.731133 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f117df272c342b6b4ea5e5a4d7fd137" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:13.746518 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e86bd9a65dd46f09d87ddd831552b59 with delete_type TABLET_DATA_DELETED (replaced by tablet 912663c9513847748864b8c2064714b6) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:13.777174 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9b75b12794fa4f4fa53156c212632cdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b75b12794fa4f4fa53156c212632cdc already in progress: creating tablet
W20260925 01:50:13.777305 11456 leader_election.cc:343] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:13.777566 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 62eeb75b322e45a5bdbd63dbd4c6e582 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62eeb75b322e45a5bdbd63dbd4c6e582 already in progress: creating tablet
W20260925 01:50:13.777833 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet ae05900043cb49d29f528fcbe4c8ada0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae05900043cb49d29f528fcbe4c8ada0 already in progress: creating tablet
I20260925 01:50:13.778116 11753 tablet_bootstrap.cc:492] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:13.778175 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b97f703869d4471cb940ef654203ec2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b97f703869d4471cb940ef654203ec2b already in progress: creating tablet
I20260925 01:50:13.778244 11753 ts_tablet_manager.cc:1403] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.000s
I20260925 01:50:13.778824 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c462a02004b44268c82176348aa9d6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.778872 11753 raft_consensus.cc:359] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.779024 11753 raft_consensus.cc:385] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.779066 11753 raft_consensus.cc:740] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.746945 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.783458 11490 tablet_service.cc:1511] Processing CreateTablet for tablet d6f1ff7274a64bcd909d3f84d2b37163 (DEFAULT_TABLE table=default.Table_25eae0a5cb4d4de28ef70586f0093354 [id=4cb92ef0acc343f481e88e52aade8769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.785562 11753 consensus_queue.cc:260] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.748638 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet 71a64863f0744f44943113d7c60806b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.748853 11218 tablet_service.cc:1558] Processing DeleteTablet for tablet 313ef1a795454be38e6ab617c3b21bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.786700 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 114f2c6439314883bdc60871f0169e15 (DEFAULT_TABLE table=default.Table_ac24296ff95c4faaa1b79f2e134a175e [id=a334987333684b11bad0b212f017814e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.786863 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75740fd25d274673b712d630962323ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.787025 11755 tablet_bootstrap.cc:492] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:13.787087 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 114f2c6439314883bdc60871f0169e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.787567 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9539f4091dfe419f8be3ec159165e110. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:13.790019 11314 consensus_peers.cc:597] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29f28e49791744428729279a79b6c9f1. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:13.790380 11314 leader_election.cc:343] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 0575861dd3d6437284cc183acb87af0a
I20260925 01:50:13.791692 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 136bed75fa2b478fbf4cdd96ff0c3c5a (DEFAULT_TABLE table=default.Table_8853eb2058fe466db58b85c80ecacda1 [id=ba1281b527064b1eae227b14877b2a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.792152 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136bed75fa2b478fbf4cdd96ff0c3c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.792955 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 136bed75fa2b478fbf4cdd96ff0c3c5a (DEFAULT_TABLE table=default.Table_8853eb2058fe466db58b85c80ecacda1 [id=ba1281b527064b1eae227b14877b2a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.795276 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3fbdac780e4dbea113d76aade89292 (DEFAULT_TABLE table=default.Table_c33214035c564fd88b2b0a1d079edd8e [id=e09cdd4e00db4e5fa86bb6188b559d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.795470 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fb9339ab8dcb4ecca41fef9e9552009e
I20260925 01:50:13.797173 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1cac299e4f8e4c9d90f244cd8719005a
I20260925 01:50:13.797672 11673 catalog_manager.cc:6934] ReplaceTablet: tablet 1cac299e4f8e4c9d90f244cd8719005a deleted and replaced by tablet dfc41da6d8be47818cc2f68cd2558c7a
W20260925 01:50:13.798359 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72b29eb581b14d3aa330c84811fbf261 consensus state has no leader
I20260925 01:50:13.798679 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3fbdac780e4dbea113d76aade89292 (DEFAULT_TABLE table=default.Table_c33214035c564fd88b2b0a1d079edd8e [id=e09cdd4e00db4e5fa86bb6188b559d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.799024 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3fbdac780e4dbea113d76aade89292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.801571 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cac299e4f8e4c9d90f244cd8719005a with delete_type TABLET_DATA_DELETED (replaced by tablet dfc41da6d8be47818cc2f68cd2558c7a) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:13.801891 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet fb9339ab8dcb4ecca41fef9e9552009e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.801937 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 98f691ddda664e5b8f2b166b9823493d (DEFAULT_TABLE table=default.Table_1d9e0df190b94930b265ce5f2de23d50 [id=65767adcdffc4db08b230b8c496c9221]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.802158 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cac299e4f8e4c9d90f244cd8719005a with delete_type TABLET_DATA_DELETED (replaced by tablet dfc41da6d8be47818cc2f68cd2558c7a) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.802327 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f691ddda664e5b8f2b166b9823493d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.802507 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet fb9339ab8dcb4ecca41fef9e9552009e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:52978
W20260925 01:50:13.802723 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a1510ec076a4483bc1e3c2eeb5b7b51 consensus state has no leader
I20260925 01:50:13.804087 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136bed75fa2b478fbf4cdd96ff0c3c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.804119 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 98f691ddda664e5b8f2b166b9823493d (DEFAULT_TABLE table=default.Table_1d9e0df190b94930b265ce5f2de23d50 [id=65767adcdffc4db08b230b8c496c9221]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.804513 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f691ddda664e5b8f2b166b9823493d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.804615 11753 ts_tablet_manager.cc:1434] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260925 01:50:13.804723 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3fbdac780e4dbea113d76aade89292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.805047 11753 tablet_bootstrap.cc:492] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:13.806145 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f1ff7274a64bcd909d3f84d2b37163. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:13.807410 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be38d1779e5e4593b797464631ac5cb9 consensus state has no leader
I20260925 01:50:13.807834 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4b49c482845141aaafc53df1990e3233"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.808439 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b49c482845141aaafc53df1990e3233 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.808725 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_bd05ebe158af4ec9bf154690b3008162" } new_table_name: "default.Table_4a7fe2ab31e64421bba536080e75b946" modify_external_catalogs: true
I20260925 01:50:13.265944 13051 rpcz_store.cc:276] 0925 01:50:05.249949 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.250004 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:11.834923 (+6584919us) raft_consensus.cc:1471] Updating replica for 262 ops
0925 01:50:12.307946 (+473023us) raft_consensus.cc:1534] Early marking committed up to index 0
0925 01:50:12.307960 (+ 14us) raft_consensus.cc:1539] Triggering prepare for 262 ops
0925 01:50:12.309103 (+ 1143us) write_op.cc:270] Start()
0925 01:50:12.309175 (+ 72us) write_op.cc:276] Timestamp: P: 1790300999227205 usec, L: 0
0925 01:50:12.397139 (+ 87964us) write_op.cc:270] Start()
0925 01:50:12.397211 (+ 72us) write_op.cc:276] Timestamp: P: 1790300999251314 usec, L: 0
0925 01:50:12.421977 (+ 24766us) write_op.cc:270] Start()
0925 01:50:12.422037 (+ 60us) write_op.cc:276] Timestamp: P: 1790300999254481 usec, L: 0
0925 01:50:12.422352 (+ 315us) write_op.cc:270] Start()
0925 01:50:12.422382 (+ 30us) write_op.cc:276] Timestamp: P: 1790300999257856 usec, L: 0
0925 01:50:12.422698 (+ 316us) write_op.cc:270] Start()
0925 01:50:12.422725 (+ 27us) write_op.cc:276] Timestamp: P: 1790300999261712 usec, L: 0
0925 01:50:12.422924 (+ 199us) write_op.cc:270] Start()
0925 01:50:12.422950 (+ 26us) write_op.cc:276] Timestamp: P: 1790300999264793 usec, L: 0
0925 01:50:12.423106 (+ 156us) write_op.cc:270] Start()
0925 01:50:12.423188 (+ 82us) write_op.cc:276] Timestamp: P: 1790300999273338 usec, L: 0
0925 01:50:12.423461 (+ 273us) write_op.cc:270] Start()
0925 01:50:12.423485 (+ 24us) write_op.cc:276] Timestamp: P: 1790300999276844 usec, L: 0
0925 01:50:12.423670 (+ 185us) write_op.cc:270] Start()
0925 01:50:12.423695 (+ 25us) write_op.cc:276] Timestamp: P: 1790300999279024 usec, L: 0
0925 01:50:12.423837 (+ 142us) write_op.cc:270] Start()
0925 01:50:12.423856 (+ 19us) write_op.cc:276] Timestamp: P: 1790300999279729 usec, L: 0
0925 01:50:12.424170 (+ 314us) write_op.cc:270] Start()
0925 01:50:12.424195 (+ 25us) write_op.cc:276] Timestamp: P: 1790300999315894 usec, L: 0
0925 01:50:12.424457 (+ 262us) write_op.cc:270] Start()
0925 01:50:12.424485 (+ 28us) write_op.cc:276] Timestamp: P: 1790300999368367 usec, L: 0
0925 01:50:12.454431 (+ 29946us) write_op.cc:270] Start()
0925 01:50:12.454526 (+ 95us) write_op.cc:276] Timestamp: P: 1790300999368933 usec, L: 0
0925 01:50:12.454900 (+ 374us) write_op.cc:270] Start()
0925 01:50:12.454993 (+ 93us) write_op.cc:276] Timestamp: P: 1790300999369433 usec, L: 0
0925 01:50:12.455141 (+ 148us) write_op.cc:270] Start()
0925 01:50:12.455159 (+ 18us) write_op.cc:276] Timestamp: P: 1790300999369990 usec, L: 0
0925 01:50:12.455342 (+ 183us) write_op.cc:270] Start()
0925 01:50:12.455359 (+ 17us) write_op.cc:276] Timestamp: P: 1790300999377614 usec, L: 0
0925 01:50:12.455740 (+ 381us) write_op.cc:270] Start()
0925 01:50:12.455780 (+ 40us) write_op.cc:276] Timestamp: P: 1790300999378240 usec, L: 0
0925 01:50:12.455941 (+ 161us) write_op.cc:270] Start()
0925 01:50:12.455960 (+ 19us) write_op.cc:276] Timestamp: P: 1790300999384459 usec, L: 0
0925 01:50:12.456232 (+ 272us) write_op.cc:270] Start()
0925 01:50:12.456254 (+ 22us) write_op.cc:276] Timestamp: P: 1790300999385047 usec, L: 0
0925 01:50:12.456401 (+ 147us) write_op.cc:270] Start()
0925 01:50:12.456421 (+ 20us) write_op.cc:276] Timestamp: P: 1790300999423909 usec, L: 0
0925 01:50:12.456645 (+ 224us) write_op.cc:270] Start()
0925 01:50:12.456664 (+ 19us) write_op.cc:276] Timestamp: P: 1790300999535624 usec, L: 0
0925 01:50:12.456814 (+ 150us) write_op.cc:270] Start()
0925 01:50:12.456851 (+ 37us) write_op.cc:276] Timestamp: P: 1790300999536420 usec, L: 0
0925 01:50:12.457008 (+ 157us) write_op.cc:270] Start()
0925 01:50:12.457028 (+ 20us) write_op.cc:276] Timestamp: P: 1790300999537225 usec, L: 0
0925 01:50:12.457265 (+ 237us) write_op.cc:270] Start()
0925 01:50:12.457284 (+ 19us) write_op.cc:276] Timestamp: P: 1790300999537802 usec, L: 0
0925 01:50:12.457542 (+ 258us) write_op.cc:270] Start()
0925 01:50:12.457563 (+ 21us) write_op.cc:276] Timestamp: P: 1790300999538481 usec, L: 0
0925 01:50:12.457699 (+ 136us) write_op.cc:270] Start()
0925 01:50:12.457749 (+ 50us) write_op.cc:276] Timestamp: P: 1790300999539213 usec, L: 0
0925 01:50:12.457929 (+ 180us) write_op.cc:270] Start()
0925 01:50:12.457956 (+ 27us) write_op.cc:276] Timestamp: P: 1790300999596630 usec, L: 0
0925 01:50:12.659006 (+201050us) write_op.cc:270] Start()
0925 01:50:12.659056 (+ 50us) write_op.cc:276] Timestamp: P: 1790300999607136 usec, L: 0
0925 01:50:12.788019 (+128963us) write_op.cc:270] Start()
0925 01:50:12.788058 (+ 39us) write_op.cc:276] Timestamp: P: 1790300999608819 usec, L: 0
0925 01:50:12.788783 (+ 725us) write_op.cc:270] Start()
0925 01:50:12.788815 (+ 32us) write_op.cc:276] Timestamp: P: 1790300999609841 usec, L: 0
0925 01:50:12.789405 (+ 590us) write_op.cc:270] Start()
0925 01:50:12.789433 (+ 28us) write_op.cc:276] Timestamp: P: 1790300999672019 usec, L: 0
0925 01:50:12.789981 (+ 548us) write_op.cc:270] Start()
0925 01:50:12.790011 (+ 30us) write_op.cc:276] Timestamp: P: 1790300999672852 usec, L: 0
0925 01:50:12.790586 (+ 575us) write_op.cc:270] Start()
0925 01:50:12.790610 (+ 24us) write_op.cc:276] Timestamp: P: 1790300999673548 usec, L: 0
0925 01:50:12.791122 (+ 512us) write_op.cc:270] Start()
0925 01:50:12.791145 (+ 23us) write_op.cc:276] Timestamp: P: 1790300999706236 usec, L: 0
0925 01:50:12.820274 (+ 29129us) write_op.cc:270] Start()
0925 01:50:12.820311 (+ 37us) write_op.cc:276] Timestamp: P: 1790300999706946 usec, L: 0
0925 01:50:12.821034 (+ 723us) write_op.cc:270] Start()
0925 01:50:12.821060 (+ 26us) write_op.cc:276] Timestamp: P: 1790300999707537 usec, L: 0
0925 01:50:12.821219 (+ 159us) write_op.cc:270] Start()
0925 01:50:12.821261 (+ 42us) write_op.cc:276] Timestamp: P: 1790300999708169 usec, L: 0
0925 01:50:12.821418 (+ 157us) write_op.cc:270] Start()
0925 01:50:12.821459 (+ 41us) write_op.cc:276] Timestamp: P: 1790300999708824 usec, L: 0
0925 01:50:12.821602 (+ 143us) write_op.cc:270] Start()
0925 01:50:12.821622 (+ 20us) write_op.cc:276] Timestamp: P: 1790300999709492 usec, L: 0
0925 01:50:12.821759 (+ 137us) write_op.cc:270] Start()
0925 01:50:12.821778 (+ 19us) write_op.cc:276] Timestamp: P: 1790300999861537 usec, L: 0
0925 01:50:12.821950 (+ 172us) write_op.cc:270] Start()
0925 01:50:12.821985 (+ 35us) write_op.cc:276] Timestamp: P: 1790300999864046 usec, L: 0
0925 01:50:12.822180 (+ 195us) write_op.cc:270] Start()
0925 01:50:12.822202 (+ 22us) write_op.cc:276] Timestamp: P: 1790300999864966 usec, L: 0
0925 01:50:12.822329 (+ 127us) write_op.cc:270] Start()
0925 01:50:12.822346 (+ 17us) write_op.cc:276] Timestamp: P: 1790300999874139 usec, L: 0
0925 01:50:12.822467 (+ 121us) write_op.cc:270] Start()
0925 01:50:12.822484 (+ 17us) write_op.cc:276] Timestamp: P: 1790300999880484 usec, L: 0
0925 01:50:12.822617 (+ 133us) write_op.cc:270] Start()
0925 01:50:12.822637 (+ 20us) write_op.cc:276] Timestamp: P: 1790300999898824 usec, L: 0
0925 01:50:12.822765 (+ 128us) write_op.cc:270] Start()
0925 01:50:12.822783 (+ 18us) write_op.cc:276] Timestamp: P: 1790300999899426 usec, L: 0
0925 01:50:12.822900 (+ 117us) write_op.cc:270] Start()
0925 01:50:12.822917 (+ 17us) write_op.cc:276] Timestamp: P: 1790300999909668 usec, L: 0
0925 01:50:12.823046 (+ 129us) write_op.cc:270] Start()
0925 01:50:12.823064 (+ 18us) write_op.cc:276] Timestamp: P: 1790300999914459 usec, L: 0
0925 01:50:12.823235 (+ 171us) write_op.cc:270] Start()
0925 01:50:12.823254 (+ 19us) write_op.cc:276] Timestamp: P: 1790300999925132 usec, L: 0
0925 01:50:12.823367 (+ 113us) write_op.cc:270] Start()
0925 01:50:12.823391 (+ 24us) write_op.cc:276] Timestamp: P: 1790300999936009 usec, L: 0
0925 01:50:12.850715 (+ 27324us) write_op.cc:270] Start()
0925 01:50:12.851904 (+ 1189us) write_op.cc:276] Timestamp: P: 1790300999950671 usec, L: 0
0925 01:50:12.861910 (+ 10006us) write_op.cc:270] Start()
0925 01:50:12.862730 (+ 820us) write_op.cc:276] Timestamp: P: 1790300999951689 usec, L: 0
0925 01:50:12.886740 (+ 24010us) write_op.cc:270] Start()
0925 01:50:12.887644 (+ 904us) write_op.cc:276] Timestamp: P: 1790300999952671 usec, L: 0
0925 01:50:12.914339 (+ 26695us) write_op.cc:270] Start()
0925 01:50:12.914388 (+ 49us) write_op.cc:276] Timestamp: P: 1790301000001828 usec, L: 0
0925 01:50:12.914622 (+ 234us) write_op.cc:270] Start()
0925 01:50:12.914723 (+ 101us) write_op.cc:276] Timestamp: P: 1790301000009949 usec, L: 0
0925 01:50:12.914896 (+ 173us) write_op.cc:270] Start()
0925 01:50:12.914918 (+ 22us) write_op.cc:276] Timestamp: P: 1790301000023574 usec, L: 0
0925 01:50:12.915060 (+ 142us) write_op.cc:270] Start()
0925 01:50:12.915080 (+ 20us) write_op.cc:276] Timestamp: P: 1790301000024786 usec, L: 0
0925 01:50:12.915214 (+ 134us) write_op.cc:270] Start()
0925 01:50:12.915233 (+ 19us) write_op.cc:276] Timestamp: P: 1790301000025821 usec, L: 0
0925 01:50:12.915361 (+ 128us) write_op.cc:270] Start()
0925 01:50:12.915382 (+ 21us) write_op.cc:276] Timestamp: P: 1790301000026838 usec, L: 0
0925 01:50:12.915532 (+ 150us) write_op.cc:270] Start()
0925 01:50:12.915580 (+ 48us) write_op.cc:276] Timestamp: P: 1790301000092386 usec, L: 0
0925 01:50:12.915737 (+ 157us) write_op.cc:270] Start()
0925 01:50:12.915758 (+ 21us) write_op.cc:276] Timestamp: P: 1790301000100716 usec, L: 0
0925 01:50:12.915911 (+ 153us) write_op.cc:270] Start()
0925 01:50:12.915931 (+ 20us) write_op.cc:276] Timestamp: P: 1790301000112061 usec, L: 0
0925 01:50:12.916092 (+ 161us) write_op.cc:270] Start()
0925 01:50:12.916117 (+ 25us) write_op.cc:276] Timestamp: P: 1790301000148850 usec, L: 0
0925 01:50:12.916278 (+ 161us) write_op.cc:270] Start()
0925 01:50:12.916299 (+ 21us) write_op.cc:276] Timestamp: P: 1790301000195537 usec, L: 0
0925 01:50:12.916478 (+ 179us) write_op.cc:270] Start()
0925 01:50:12.916497 (+ 19us) write_op.cc:276] Timestamp: P: 1790301000201627 usec, L: 0
0925 01:50:12.916637 (+ 140us) write_op.cc:270] Start()
0925 01:50:12.916654 (+ 17us) write_op.cc:276] Timestamp: P: 1790301000211520 usec, L: 0
0925 01:50:12.916788 (+ 134us) write_op.cc:270] Start()
0925 01:50:12.916804 (+ 16us) write_op.cc:276] Timestamp: P: 1790301000279442 usec, L: 0
0925 01:50:12.916930 (+ 126us) write_op.cc:270] Start()
0925 01:50:12.916948 (+ 18us) write_op.cc:276] Timestamp: P: 1790301000287815 usec, L: 0
0925 01:50:12.917072 (+ 124us) write_op.cc:270] Start()
0925 01:50:12.917089 (+ 17us) write_op.cc:276] Timestamp: P: 1790301000373421 usec, L: 0
0925 01:50:12.917191 (+ 102us) write_op.cc:270] Start()
0925 01:50:12.917205 (+ 14us) write_op.cc:276] Timestamp: P: 1790301000374684 usec, L: 0
0925 01:50:12.917338 (+ 133us) write_op.cc:270] Start()
0925 01:50:12.917353 (+ 15us) write_op.cc:276] Timestamp: P: 1790301000375283 usec, L: 0
0925 01:50:12.917459 (+ 106us) write_op.cc:270] Start()
0925 01:50:12.917474 (+ 15us) write_op.cc:276] Timestamp: P: 1790301000375813 usec, L: 0
0925 01:50:12.917600 (+ 126us) write_op.cc:270] Start()
0925 01:50:12.917616 (+ 16us) write_op.cc:276] Timestamp: P: 1790301000376351 usec, L: 0
0925 01:50:12.917709 (+ 93us) write_op.cc:270] Start()
0925 01:50:12.917723 (+ 14us) write_op.cc:276] Timestamp: P: 1790301000573864 usec, L: 0
0925 01:50:12.917852 (+ 129us) write_op.cc:270] Start()
0925 01:50:12.917867 (+ 15us) write_op.cc:276] Timestamp: P: 1790301000575548 usec, L: 0
0925 01:50:12.917977 (+ 110us) write_op.cc:270] Start()
0925 01:50:12.917993 (+ 16us) write_op.cc:276] Timestamp: P: 1790301000576579 usec, L: 0
0925 01:50:12.976846 (+ 58853us) write_op.cc:270] Start()
0925 01:50:12.976918 (+ 72us) write_op.cc:276] Timestamp: P: 1790301000577509 usec, L: 0
0925 01:50:12.977170 (+ 252us) write_op.cc:270] Start()
0925 01:50:12.977196 (+ 26us) write_op.cc:276] Timestamp: P: 1790301000578664 usec, L: 0
0925 01:50:12.977421 (+ 225us) write_op.cc:270] Start()
0925 01:50:12.977486 (+ 65us) write_op.cc:276] Timestamp: P: 1790301000610621 usec, L: 0
0925 01:50:12.977692 (+ 206us) write_op.cc:270] Start()
0925 01:50:12.977714 (+ 22us) write_op.cc:276] Timestamp: P: 1790301000615159 usec, L: 0
0925 01:50:12.977907 (+ 193us) write_op.cc:270] Start()
0925 01:50:12.977930 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000615867 usec, L: 0
0925 01:50:12.978112 (+ 182us) write_op.cc:270] Start()
0925 01:50:12.978132 (+ 20us) write_op.cc:276] Timestamp: P: 1790301000616612 usec, L: 0
0925 01:50:12.978296 (+ 164us) write_op.cc:270] Start()
0925 01:50:12.978320 (+ 24us) write_op.cc:276] Timestamp: P: 1790301000617310 usec, L: 0
0925 01:50:12.978466 (+ 146us) write_op.cc:270] Start()
0925 01:50:12.978489 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000626560 usec, L: 0
0925 01:50:12.978690 (+ 201us) write_op.cc:270] Start()
0925 01:50:12.978711 (+ 21us) write_op.cc:276] Timestamp: P: 1790301000670750 usec, L: 0
0925 01:50:12.978862 (+ 151us) write_op.cc:270] Start()
0925 01:50:12.978885 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000671476 usec, L: 0
0925 01:50:12.979061 (+ 176us) write_op.cc:270] Start()
0925 01:50:12.979085 (+ 24us) write_op.cc:276] Timestamp: P: 1790301000672131 usec, L: 0
0925 01:50:12.979227 (+ 142us) write_op.cc:270] Start()
0925 01:50:12.979250 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000672715 usec, L: 0
0925 01:50:12.979404 (+ 154us) write_op.cc:270] Start()
0925 01:50:12.979429 (+ 25us) write_op.cc:276] Timestamp: P: 1790301000674439 usec, L: 0
0925 01:50:12.979591 (+ 162us) write_op.cc:270] Start()
0925 01:50:12.979614 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000679281 usec, L: 0
0925 01:50:12.979793 (+ 179us) write_op.cc:270] Start()
0925 01:50:12.979812 (+ 19us) write_op.cc:276] Timestamp: P: 1790301000683380 usec, L: 0
0925 01:50:12.979956 (+ 144us) write_op.cc:270] Start()
0925 01:50:12.979980 (+ 24us) write_op.cc:276] Timestamp: P: 1790301000696171 usec, L: 0
0925 01:50:13.008216 (+ 28236us) write_op.cc:270] Start()
0925 01:50:13.008259 (+ 43us) write_op.cc:276] Timestamp: P: 1790301000698260 usec, L: 0
0925 01:50:13.008469 (+ 210us) write_op.cc:270] Start()
0925 01:50:13.008498 (+ 29us) write_op.cc:276] Timestamp: P: 1790301000698895 usec, L: 0
0925 01:50:13.008694 (+ 196us) write_op.cc:270] Start()
0925 01:50:13.008717 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000699473 usec, L: 0
0925 01:50:13.008913 (+ 196us) write_op.cc:270] Start()
0925 01:50:13.008940 (+ 27us) write_op.cc:276] Timestamp: P: 1790301000711862 usec, L: 0
0925 01:50:13.009105 (+ 165us) write_op.cc:270] Start()
0925 01:50:13.009126 (+ 21us) write_op.cc:276] Timestamp: P: 1790301000712503 usec, L: 0
0925 01:50:13.009262 (+ 136us) write_op.cc:270] Start()
0925 01:50:13.009282 (+ 20us) write_op.cc:276] Timestamp: P: 1790301000823748 usec, L: 0
0925 01:50:13.009493 (+ 211us) write_op.cc:270] Start()
0925 01:50:13.009541 (+ 48us) write_op.cc:276] Timestamp: P: 1790301000825028 usec, L: 0
0925 01:50:13.009729 (+ 188us) write_op.cc:270] Start()
0925 01:50:13.009752 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000827602 usec, L: 0
0925 01:50:13.009916 (+ 164us) write_op.cc:270] Start()
0925 01:50:13.009937 (+ 21us) write_op.cc:276] Timestamp: P: 1790301000830566 usec, L: 0
0925 01:50:13.010117 (+ 180us) write_op.cc:270] Start()
0925 01:50:13.010139 (+ 22us) write_op.cc:276] Timestamp: P: 1790301000892157 usec, L: 0
0925 01:50:13.010283 (+ 144us) write_op.cc:270] Start()
0925 01:50:13.010305 (+ 22us) write_op.cc:276] Timestamp: P: 1790301000916524 usec, L: 0
0925 01:50:13.010436 (+ 131us) write_op.cc:270] Start()
0925 01:50:13.010459 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000927509 usec, L: 0
0925 01:50:13.018639 (+ 8180us) write_op.cc:270] Start()
0925 01:50:13.018676 (+ 37us) write_op.cc:276] Timestamp: P: 1790301000929804 usec, L: 0
0925 01:50:13.019334 (+ 658us) write_op.cc:270] Start()
0925 01:50:13.019363 (+ 29us) write_op.cc:276] Timestamp: P: 1790301000994004 usec, L: 0
0925 01:50:13.019591 (+ 228us) write_op.cc:270] Start()
0925 01:50:13.019614 (+ 23us) write_op.cc:276] Timestamp: P: 1790301000996483 usec, L: 0
0925 01:50:13.019765 (+ 151us) write_op.cc:270] Start()
0925 01:50:13.019785 (+ 20us) write_op.cc:276] Timestamp: P: 1790301000998879 usec, L: 0
0925 01:50:13.019909 (+ 124us) write_op.cc:270] Start()
0925 01:50:13.019927 (+ 18us) write_op.cc:276] Timestamp: P: 1790301001005737 usec, L: 0
0925 01:50:13.020058 (+ 131us) write_op.cc:270] Start()
0925 01:50:13.020076 (+ 18us) write_op.cc:276] Timestamp: P: 1790301001008102 usec, L: 0
0925 01:50:13.020227 (+ 151us) write_op.cc:270] Start()
0925 01:50:13.020257 (+ 30us) write_op.cc:276] Timestamp: P: 1790301001041258 usec, L: 0
0925 01:50:13.020395 (+ 138us) write_op.cc:270] Start()
0925 01:50:13.020415 (+ 20us) write_op.cc:276] Timestamp: P: 1790301001044251 usec, L: 0
0925 01:50:13.020595 (+ 180us) write_op.cc:270] Start()
0925 01:50:13.020618 (+ 23us) write_op.cc:276] Timestamp: P: 1790301001048502 usec, L: 0
0925 01:50:13.020802 (+ 184us) write_op.cc:270] Start()
0925 01:50:13.020825 (+ 23us) write_op.cc:276] Timestamp: P: 1790301001147558 usec, L: 0
0925 01:50:13.021036 (+ 211us) write_op.cc:270] Start()
0925 01:50:13.021061 (+ 25us) write_op.cc:276] Timestamp: P: 1790301001148418 usec, L: 0
0925 01:50:13.021217 (+ 156us) write_op.cc:270] Start()
0925 01:50:13.021236 (+ 19us) write_op.cc:276] Timestamp: P: 1790301001149033 usec, L: 0
0925 01:50:13.021375 (+ 139us) write_op.cc:270] Start()
0925 01:50:13.021397 (+ 22us) write_op.cc:276] Timestamp: P: 1790301001149689 usec, L: 0
0925 01:50:13.021570 (+ 173us) write_op.cc:270] Start()
0925 01:50:13.021589 (+ 19us) write_op.cc:276] Timestamp: P: 1790301001161665 usec, L: 0
0925 01:50:13.021725 (+ 136us) write_op.cc:270] Start()
0925 01:50:13.021746 (+ 21us) write_op.cc:276] Timestamp: P: 1790301001168083 usec, L: 0
0925 01:50:13.021879 (+ 133us) write_op.cc:270] Start()
0925 01:50:13.021901 (+ 22us) write_op.cc:276] Timestamp: P: 1790301001168755 usec, L: 0
0925 01:50:13.022043 (+ 142us) write_op.cc:270] Start()
0925 01:50:13.022092 (+ 49us) write_op.cc:276] Timestamp: P: 1790301001228985 usec, L: 0
0925 01:50:13.022239 (+ 147us) write_op.cc:270] Start()
0925 01:50:13.022258 (+ 19us) write_op.cc:276] Timestamp: P: 1790301001247807 usec, L: 0
0925 01:50:13.022395 (+ 137us) write_op.cc:270] Start()
0925 01:50:13.022420 (+ 25us) write_op.cc:276] Timestamp: P: 1790301001290781 usec, L: 0
0925 01:50:13.030978 (+ 8558us) write_op.cc:270] Start()
0925 01:50:13.031024 (+ 46us) write_op.cc:276] Timestamp: P: 1790301001291545 usec, L: 0
0925 01:50:13.031240 (+ 216us) write_op.cc:270] Start()
0925 01:50:13.031264 (+ 24us) write_op.cc:276] Timestamp: P: 1790301001292299 usec, L: 0
0925 01:50:13.031480 (+ 216us) write_op.cc:270] Start()
0925 01:50:13.031500 (+ 20us) write_op.cc:276] Timestamp: P: 1790301001361162 usec, L: 0
0925 01:50:13.031662 (+ 162us) write_op.cc:270] Start()
0925 01:50:13.031682 (+ 20us) write_op.cc:276] Timestamp: P: 1790301001386615 usec, L: 0
0925 01:50:13.031841 (+ 159us) write_op.cc:270] Start()
0925 01:50:13.031861 (+ 20us) write_op.cc:276] Timestamp: P: 1790301001743625 usec, L: 0
0925 01:50:13.032032 (+ 171us) write_op.cc:270] Start()
0925 01:50:13.032055 (+ 23us) write_op.cc:276] Timestamp: P: 1790301001770459 usec, L: 0
0925 01:50:13.032209 (+ 154us) write_op.cc:270] Start()
0925 01:50:13.032232 (+ 23us) write_op.cc:276] Timestamp: P: 1790301001815950 usec, L: 0
0925 01:50:13.032387 (+ 155us) write_op.cc:270] Start()
0925 01:50:13.032430 (+ 43us) write_op.cc:276] Timestamp: P: 1790301001821764 usec, L: 0
0925 01:50:13.032593 (+ 163us) write_op.cc:270] Start()
0925 01:50:13.032616 (+ 23us) write_op.cc:276] Timestamp: P: 1790301001840292 usec, L: 0
0925 01:50:13.032751 (+ 135us) write_op.cc:270] Start()
0925 01:50:13.032770 (+ 19us) write_op.cc:276] Timestamp: P: 1790301001851954 usec, L: 0
0925 01:50:13.032911 (+ 141us) write_op.cc:270] Start()
0925 01:50:13.032932 (+ 21us) write_op.cc:276] Timestamp: P: 1790301001866641 usec, L: 0
0925 01:50:13.033140 (+ 208us) write_op.cc:270] Start()
0925 01:50:13.037852 (+ 4712us) write_op.cc:276] Timestamp: P: 1790301001888776 usec, L: 0
0925 01:50:13.038098 (+ 246us) write_op.cc:270] Start()
0925 01:50:13.038125 (+ 27us) write_op.cc:276] Timestamp: P: 1790301001908011 usec, L: 0
0925 01:50:13.038286 (+ 161us) write_op.cc:270] Start()
0925 01:50:13.038307 (+ 21us) write_op.cc:276] Timestamp: P: 1790301001919724 usec, L: 0
0925 01:50:13.038443 (+ 136us) write_op.cc:270] Start()
0925 01:50:13.038463 (+ 20us) write_op.cc:276] Timestamp: P: 1790301001948139 usec, L: 0
0925 01:50:13.038629 (+ 166us) write_op.cc:270] Start()
0925 01:50:13.038648 (+ 19us) write_op.cc:276] Timestamp: P: 1790301001968765 usec, L: 0
0925 01:50:13.038812 (+ 164us) write_op.cc:270] Start()
0925 01:50:13.038837 (+ 25us) write_op.cc:276] Timestamp: P: 1790301001975546 usec, L: 0
0925 01:50:13.038995 (+ 158us) write_op.cc:270] Start()
0925 01:50:13.039016 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002004346 usec, L: 0
0925 01:50:13.039162 (+ 146us) write_op.cc:270] Start()
0925 01:50:13.039185 (+ 23us) write_op.cc:276] Timestamp: P: 1790301002027584 usec, L: 0
0925 01:50:13.039334 (+ 149us) write_op.cc:270] Start()
0925 01:50:13.039355 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002032265 usec, L: 0
0925 01:50:13.039573 (+ 218us) write_op.cc:270] Start()
0925 01:50:13.039599 (+ 26us) write_op.cc:276] Timestamp: P: 1790301002035153 usec, L: 0
0925 01:50:13.039760 (+ 161us) write_op.cc:270] Start()
0925 01:50:13.039781 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002047057 usec, L: 0
0925 01:50:13.039915 (+ 134us) write_op.cc:270] Start()
0925 01:50:13.039937 (+ 22us) write_op.cc:276] Timestamp: P: 1790301002053464 usec, L: 0
0925 01:50:13.040093 (+ 156us) write_op.cc:270] Start()
0925 01:50:13.040119 (+ 26us) write_op.cc:276] Timestamp: P: 1790301002058112 usec, L: 0
0925 01:50:13.040307 (+ 188us) write_op.cc:270] Start()
0925 01:50:13.040331 (+ 24us) write_op.cc:276] Timestamp: P: 1790301002120973 usec, L: 0
0925 01:50:13.040474 (+ 143us) write_op.cc:270] Start()
0925 01:50:13.040494 (+ 20us) write_op.cc:276] Timestamp: P: 1790301002122195 usec, L: 0
0925 01:50:13.040672 (+ 178us) write_op.cc:270] Start()
0925 01:50:13.040694 (+ 22us) write_op.cc:276] Timestamp: P: 1790301002123483 usec, L: 0
0925 01:50:13.046498 (+ 5804us) write_op.cc:270] Start()
0925 01:50:13.046536 (+ 38us) write_op.cc:276] Timestamp: P: 1790301002125176 usec, L: 0
0925 01:50:13.046727 (+ 191us) write_op.cc:270] Start()
0925 01:50:13.046754 (+ 27us) write_op.cc:276] Timestamp: P: 1790301002127821 usec, L: 0
0925 01:50:13.046934 (+ 180us) write_op.cc:270] Start()
0925 01:50:13.046959 (+ 25us) write_op.cc:276] Timestamp: P: 1790301002134003 usec, L: 0
0925 01:50:13.047100 (+ 141us) write_op.cc:270] Start()
0925 01:50:13.047118 (+ 18us) write_op.cc:276] Timestamp: P: 1790301002137163 usec, L: 0
0925 01:50:13.047241 (+ 123us) write_op.cc:270] Start()
0925 01:50:13.047262 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002244206 usec, L: 0
0925 01:50:13.047409 (+ 147us) write_op.cc:270] Start()
0925 01:50:13.047430 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002245937 usec, L: 0
0925 01:50:13.047591 (+ 161us) write_op.cc:270] Start()
0925 01:50:13.047615 (+ 24us) write_op.cc:276] Timestamp: P: 1790301002248637 usec, L: 0
0925 01:50:13.047754 (+ 139us) write_op.cc:270] Start()
0925 01:50:13.047773 (+ 19us) write_op.cc:276] Timestamp: P: 1790301002250336 usec, L: 0
0925 01:50:13.047924 (+ 151us) write_op.cc:270] Start()
0925 01:50:13.047946 (+ 22us) write_op.cc:276] Timestamp: P: 1790301002251958 usec, L: 0
0925 01:50:13.048110 (+ 164us) write_op.cc:270] Start()
0925 01:50:13.048129 (+ 19us) write_op.cc:276] Timestamp: P: 1790301002253225 usec, L: 0
0925 01:50:13.048273 (+ 144us) write_op.cc:270] Start()
0925 01:50:13.048291 (+ 18us) write_op.cc:276] Timestamp: P: 1790301002254169 usec, L: 0
0925 01:50:13.048419 (+ 128us) write_op.cc:270] Start()
0925 01:50:13.048438 (+ 19us) write_op.cc:276] Timestamp: P: 1790301002255030 usec, L: 0
0925 01:50:13.048577 (+ 139us) write_op.cc:270] Start()
0925 01:50:13.048597 (+ 20us) write_op.cc:276] Timestamp: P: 1790301002280881 usec, L: 0
0925 01:50:13.048729 (+ 132us) write_op.cc:270] Start()
0925 01:50:13.048745 (+ 16us) write_op.cc:276] Timestamp: P: 1790301002290241 usec, L: 0
0925 01:50:13.048874 (+ 129us) write_op.cc:270] Start()
0925 01:50:13.048892 (+ 18us) write_op.cc:276] Timestamp: P: 1790301002537772 usec, L: 0
0925 01:50:13.049055 (+ 163us) write_op.cc:270] Start()
0925 01:50:13.049079 (+ 24us) write_op.cc:276] Timestamp: P: 1790301002541145 usec, L: 0
0925 01:50:13.049235 (+ 156us) write_op.cc:270] Start()
0925 01:50:13.049343 (+ 108us) write_op.cc:276] Timestamp: P: 1790301002541846 usec, L: 0
0925 01:50:13.049536 (+ 193us) write_op.cc:270] Start()
0925 01:50:13.049561 (+ 25us) write_op.cc:276] Timestamp: P: 1790301002543156 usec, L: 0
0925 01:50:13.049723 (+ 162us) write_op.cc:270] Start()
0925 01:50:13.049742 (+ 19us) write_op.cc:276] Timestamp: P: 1790301002549880 usec, L: 0
0925 01:50:13.049878 (+ 136us) write_op.cc:270] Start()
0925 01:50:13.049901 (+ 23us) write_op.cc:276] Timestamp: P: 1790301002550733 usec, L: 0
0925 01:50:13.050044 (+ 143us) write_op.cc:270] Start()
0925 01:50:13.050094 (+ 50us) write_op.cc:276] Timestamp: P: 1790301002551281 usec, L: 0
0925 01:50:13.050257 (+ 163us) write_op.cc:270] Start()
0925 01:50:13.050275 (+ 18us) write_op.cc:276] Timestamp: P: 1790301002560370 usec, L: 0
0925 01:50:13.050398 (+ 123us) write_op.cc:270] Start()
0925 01:50:13.050414 (+ 16us) write_op.cc:276] Timestamp: P: 1790301002606490 usec, L: 0
0925 01:50:13.050554 (+ 140us) write_op.cc:270] Start()
0925 01:50:13.050575 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002607264 usec, L: 0
0925 01:50:13.050702 (+ 127us) write_op.cc:270] Start()
0925 01:50:13.050723 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002607823 usec, L: 0
0925 01:50:13.050875 (+ 152us) write_op.cc:270] Start()
0925 01:50:13.050892 (+ 17us) write_op.cc:276] Timestamp: P: 1790301002614557 usec, L: 0
0925 01:50:13.051059 (+ 167us) write_op.cc:270] Start()
0925 01:50:13.051081 (+ 22us) write_op.cc:276] Timestamp: P: 1790301002696760 usec, L: 0
0925 01:50:13.051228 (+ 147us) write_op.cc:270] Start()
0925 01:50:13.051246 (+ 18us) write_op.cc:276] Timestamp: P: 1790301002749164 usec, L: 0
0925 01:50:13.051396 (+ 150us) write_op.cc:270] Start()
0925 01:50:13.051419 (+ 23us) write_op.cc:276] Timestamp: P: 1790301002749853 usec, L: 0
0925 01:50:13.051567 (+ 148us) write_op.cc:270] Start()
0925 01:50:13.051585 (+ 18us) write_op.cc:276] Timestamp: P: 1790301002769827 usec, L: 0
0925 01:50:13.051732 (+ 147us) write_op.cc:270] Start()
0925 01:50:13.051754 (+ 22us) write_op.cc:276] Timestamp: P: 1790301002778428 usec, L: 0
0925 01:50:13.051881 (+ 127us) write_op.cc:270] Start()
0925 01:50:13.051902 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002779062 usec, L: 0
0925 01:50:13.052026 (+ 124us) write_op.cc:270] Start()
0925 01:50:13.052048 (+ 22us) write_op.cc:276] Timestamp: P: 1790301002863830 usec, L: 0
0925 01:50:13.052183 (+ 135us) write_op.cc:270] Start()
0925 01:50:13.052202 (+ 19us) write_op.cc:276] Timestamp: P: 1790301002865041 usec, L: 0
0925 01:50:13.052353 (+ 151us) write_op.cc:270] Start()
0925 01:50:13.052376 (+ 23us) write_op.cc:276] Timestamp: P: 1790301002865833 usec, L: 0
0925 01:50:13.052541 (+ 165us) write_op.cc:270] Start()
0925 01:50:13.052562 (+ 21us) write_op.cc:276] Timestamp: P: 1790301002866421 usec, L: 0
0925 01:50:13.052730 (+ 168us) write_op.cc:270] Start()
0925 01:50:13.052755 (+ 25us) write_op.cc:276] Timestamp: P: 1790301002927540 usec, L: 0
0925 01:50:13.052933 (+ 178us) write_op.cc:270] Start()
0925 01:50:13.052957 (+ 24us) write_op.cc:276] Timestamp: P: 1790301002931854 usec, L: 0
0925 01:50:13.079983 (+ 27026us) write_op.cc:270] Start()
0925 01:50:13.080036 (+ 53us) write_op.cc:276] Timestamp: P: 1790301002972691 usec, L: 0
0925 01:50:13.081116 (+ 1080us) write_op.cc:270] Start()
0925 01:50:13.081152 (+ 36us) write_op.cc:276] Timestamp: P: 1790301002997688 usec, L: 0
0925 01:50:13.081338 (+ 186us) write_op.cc:270] Start()
0925 01:50:13.081360 (+ 22us) write_op.cc:276] Timestamp: P: 1790301003015908 usec, L: 0
0925 01:50:13.081532 (+ 172us) write_op.cc:270] Start()
0925 01:50:13.081553 (+ 21us) write_op.cc:276] Timestamp: P: 1790301003028256 usec, L: 0
0925 01:50:13.081717 (+ 164us) write_op.cc:270] Start()
0925 01:50:13.081742 (+ 25us) write_op.cc:276] Timestamp: P: 1790301003041960 usec, L: 0
0925 01:50:13.081899 (+ 157us) write_op.cc:270] Start()
0925 01:50:13.081919 (+ 20us) write_op.cc:276] Timestamp: P: 1790301003057243 usec, L: 0
0925 01:50:13.082120 (+ 201us) write_op.cc:270] Start()
0925 01:50:13.082146 (+ 26us) write_op.cc:276] Timestamp: P: 1790301003064463 usec, L: 0
0925 01:50:13.082295 (+ 149us) write_op.cc:270] Start()
0925 01:50:13.082315 (+ 20us) write_op.cc:276] Timestamp: P: 1790301003065352 usec, L: 0
0925 01:50:13.082465 (+ 150us) write_op.cc:270] Start()
0925 01:50:13.082488 (+ 23us) write_op.cc:276] Timestamp: P: 1790301
I20260925 01:50:13.810246 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_78376eb26eea43d3b1f015290026d136"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.810364 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_6b9a2b88205a4886a870605fa4258a5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:13.810679 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 7d896cd03c7a4170b22e0a4a82c06e96 (DEFAULT_TABLE table=default.Table_dab99fe1964147d8a4b38b82f7a6217f [id=3309c4e7b74d4fcb83395f224302cfeb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:13.810782 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b9a2b88205a4886a870605fa4258a5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.811077 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d896cd03c7a4170b22e0a4a82c06e96. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:13.810803 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78376eb26eea43d3b1f015290026d136 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.815311 11754 tablet_bootstrap.cc:492] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.815438 11754 ts_tablet_manager.cc:1403] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.162s user 0.005s sys 0.001s
I20260925 01:50:13.816116 11754 raft_consensus.cc:359] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.816282 11754 raft_consensus.cc:385] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.816326 11754 raft_consensus.cc:740] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.816372 11218 tablet_service.cc:1511] Processing CreateTablet for tablet d6f1ff7274a64bcd909d3f84d2b37163 (DEFAULT_TABLE table=default.Table_25eae0a5cb4d4de28ef70586f0093354 [id=4cb92ef0acc343f481e88e52aade8769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.816726 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f1ff7274a64bcd909d3f84d2b37163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.816567 11754 consensus_queue.cc:260] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.817189 13551 catalog_manager.cc:1651] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260925 01:50:13.817490 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f48f8686b328486f968b63c037efe02e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.818030 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f48f8686b328486f968b63c037efe02e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.823786 11754 ts_tablet_manager.cc:1434] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 01:50:13.814013 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_0d83bc4068b545a7afe9a4498e2c8f87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.826728 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d83bc4068b545a7afe9a4498e2c8f87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:13.831651 11457 leader_election.cc:343] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.831794 11457 leader_election.cc:304] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.831833 11754 tablet_bootstrap.cc:492] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.832063 13411 raft_consensus.cc:2749] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:13.834403 11754 tablet_bootstrap.cc:654] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.834357 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:13.839277 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 7d896cd03c7a4170b22e0a4a82c06e96 (DEFAULT_TABLE table=default.Table_dab99fe1964147d8a4b38b82f7a6217f [id=3309c4e7b74d4fcb83395f224302cfeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.841632 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 1e262aa230df47df89eed90cef3ab3e0 (DEFAULT_TABLE table=default.Table_43670b6626f54ad98b4b1540fa2d09bf [id=b632104d6faf4e2a9a14fcc4e6d5863c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.841668 11205 tablet_service.cc:1511] Processing CreateTablet for tablet a02464db4c3b4f408e4b26018f121121 (DEFAULT_TABLE table=default.Table_f23b8482c3ce4904a2a54bad0536a288 [id=a9eaca16691b4511908b7291080c1935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.843221 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 2a65e06aba3640e2b42d05fb325c6171 (DEFAULT_TABLE table=default.Table_1d8dce29493342b78a7966e35b2ffa82 [id=9ef58e207e2f4a03a32bd31019717338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.844254 11221 tablet_service.cc:1511] Processing CreateTablet for tablet cabb4f9eb185456889acadaa624e66bb (DEFAULT_TABLE table=default.Table_1fb84c7800674a8d9fc0d70cd6e57beb [id=509c3101c0ee42c48f33549a58f20d70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.845314 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 1c09318926bf40aca077b59b8837a4cc (DEFAULT_TABLE table=default.Table_137ed1759a8941a2a663204df88796b7 [id=2518d154741b4726b0ee70d86b466db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.846207 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 23f7e6b28e0944b89a662b40e0da4379 (DEFAULT_TABLE table=default.Table_17dfbf84b0154c4692c3d29c06514c83 [id=4b5b76c2c9f04f039037a80e08721b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.846858 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f7e6b28e0944b89a662b40e0da4379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.847769 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.850631 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e262aa230df47df89eed90cef3ab3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.856370 11350 tablet_service.cc:1511] Processing CreateTablet for tablet d6f1ff7274a64bcd909d3f84d2b37163 (DEFAULT_TABLE table=default.Table_25eae0a5cb4d4de28ef70586f0093354 [id=4cb92ef0acc343f481e88e52aade8769]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.858325 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c09318926bf40aca077b59b8837a4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.864663 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabb4f9eb185456889acadaa624e66bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.868153 11754 tablet_bootstrap.cc:492] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:13.870882 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 136bed75fa2b478fbf4cdd96ff0c3c5a (DEFAULT_TABLE table=default.Table_8853eb2058fe466db58b85c80ecacda1 [id=ba1281b527064b1eae227b14877b2a8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.871275 11754 ts_tablet_manager.cc:1403] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260925 01:50:13.872042 11754 raft_consensus.cc:359] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.872197 11754 raft_consensus.cc:385] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:13.872247 11754 raft_consensus.cc:740] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:13.870296 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a65e06aba3640e2b42d05fb325c6171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.872999 11754 consensus_queue.cc:260] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.877162 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02464db4c3b4f408e4b26018f121121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.879305 11754 ts_tablet_manager.cc:1434] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260925 01:50:13.880690 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_42510f9b2fb7457cb365f2539885131e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.881297 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42510f9b2fb7457cb365f2539885131e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.885555 11754 tablet_bootstrap.cc:492] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:13.886461 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1ce201094f214585996cc8cce5f9010d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:13.887087 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ce201094f214585996cc8cce5f9010d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:13.887982 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_9f6df51cac0f4c3b9111cab561c1ecc5" } new_table_name: "default.Table_bb66c0a95d8241b292c7b0952b5ee75c" modify_external_catalogs: true
I20260925 01:50:13.892091 11210 tablet_service.cc:1511] Processing CreateTablet for tablet fc0f8574c84046bd81c859826b3e8566 (DEFAULT_TABLE table=default.Table_5cead8ca50414983bbaca4096eb3ee97 [id=7d25d613c5b24f6ebe91178d36e10d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.892557 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0f8574c84046bd81c859826b3e8566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.892788 11754 tablet_bootstrap.cc:654] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.894800 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba0b2716f5a4dc0b946a992fac76e09 (DEFAULT_TABLE table=default.Table_b8374f14bfc94d20955c84e90f3f6695 [id=ebc6aff6a2164942a7cc7ae22d9f8714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.895133 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba0b2716f5a4dc0b946a992fac76e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.896700 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 9513d1d55fe846f5b1a2b7d315209002 (table default.Table_76c89167538945999999e21b0ddaba59 [id=fc884308e078422c86ce1d6f7b0af92e]). Expected version 2 got 0
I20260925 01:50:13.897025 11679 catalog_manager.cc:5838] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:13.892140 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae7e91450eb4d67b70560d854e7d74c (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.898329 11217 tablet_service.cc:1511] Processing CreateTablet for tablet e27fb4110158412895dc802655e5d507 (DEFAULT_TABLE table=default.Table_11388be1a8f34e8fa41e64a79b062b29 [id=5da8dfb5758a49ce9ce2ae770b9b3a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.898487 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae7e91450eb4d67b70560d854e7d74c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.898660 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27fb4110158412895dc802655e5d507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.898658 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
I20260925 01:50:13.902959 11354 tablet_service.cc:1558] Processing DeleteTablet for tablet fb9339ab8dcb4ecca41fef9e9552009e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.902995 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3fbdac780e4dbea113d76aade89292 (DEFAULT_TABLE table=default.Table_c33214035c564fd88b2b0a1d079edd8e [id=e09cdd4e00db4e5fa86bb6188b559d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.903673 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 2a65e06aba3640e2b42d05fb325c6171 (DEFAULT_TABLE table=default.Table_1d8dce29493342b78a7966e35b2ffa82 [id=9ef58e207e2f4a03a32bd31019717338]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.903859 13209 raft_consensus.cc:493] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.903858 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 1e262aa230df47df89eed90cef3ab3e0 (DEFAULT_TABLE table=default.Table_43670b6626f54ad98b4b1540fa2d09bf [id=b632104d6faf4e2a9a14fcc4e6d5863c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.904032 11356 tablet_service.cc:1511] Processing CreateTablet for tablet cabb4f9eb185456889acadaa624e66bb (DEFAULT_TABLE table=default.Table_1fb84c7800674a8d9fc0d70cd6e57beb [id=509c3101c0ee42c48f33549a58f20d70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.904000 13209 raft_consensus.cc:515] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.904822 13209 leader_election.cc:290] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.905165 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 98f691ddda664e5b8f2b166b9823493d (DEFAULT_TABLE table=default.Table_1d9e0df190b94930b265ce5f2de23d50 [id=65767adcdffc4db08b230b8c496c9221]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.905515 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 7d896cd03c7a4170b22e0a4a82c06e96 (DEFAULT_TABLE table=default.Table_dab99fe1964147d8a4b38b82f7a6217f [id=3309c4e7b74d4fcb83395f224302cfeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.905572 13321 raft_consensus.cc:493] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.905673 13321 raft_consensus.cc:515] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:13.906304 13321 leader_election.cc:290] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:13.907943 11348 tablet_service.cc:1511] Processing CreateTablet for tablet 1c09318926bf40aca077b59b8837a4cc (DEFAULT_TABLE table=default.Table_137ed1759a8941a2a663204df88796b7 [id=2518d154741b4726b0ee70d86b466db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.908033 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b6bde824d74acfaaffc23a0b05db8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.908883 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a2285922eb4c94bf0d7eadc41dd409. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:13.909178 11177 leader_election.cc:343] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.910384 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f1ff7274a64bcd909d3f84d2b37163. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.910686 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 136bed75fa2b478fbf4cdd96ff0c3c5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.911075 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3fbdac780e4dbea113d76aade89292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.912256 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a65e06aba3640e2b42d05fb325c6171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.912892 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e262aa230df47df89eed90cef3ab3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.914145 11753 tablet_bootstrap.cc:654] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.915017 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f691ddda664e5b8f2b166b9823493d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.916002 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d896cd03c7a4170b22e0a4a82c06e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.918814 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 2a65e06aba3640e2b42d05fb325c6171 (DEFAULT_TABLE table=default.Table_1d8dce29493342b78a7966e35b2ffa82 [id=9ef58e207e2f4a03a32bd31019717338]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:13.832737 11457 leader_election.cc:343] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.919456 11457 leader_election.cc:304] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.919852 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba0b2716f5a4dc0b946a992fac76e09 (DEFAULT_TABLE table=default.Table_b8374f14bfc94d20955c84e90f3f6695 [id=ebc6aff6a2164942a7cc7ae22d9f8714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.920840 11496 tablet_service.cc:1511] Processing CreateTablet for tablet a02464db4c3b4f408e4b26018f121121 (DEFAULT_TABLE table=default.Table_f23b8482c3ce4904a2a54bad0536a288 [id=a9eaca16691b4511908b7291080c1935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.921372 13209 raft_consensus.cc:493] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.921535 13209 raft_consensus.cc:515] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.922237 13209 leader_election.cc:290] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.925794 11502 tablet_service.cc:1511] Processing CreateTablet for tablet e27fb4110158412895dc802655e5d507 (DEFAULT_TABLE table=default.Table_11388be1a8f34e8fa41e64a79b062b29 [id=5da8dfb5758a49ce9ce2ae770b9b3a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.925846 11489 tablet_service.cc:1511] Processing CreateTablet for tablet fc0f8574c84046bd81c859826b3e8566 (DEFAULT_TABLE table=default.Table_5cead8ca50414983bbaca4096eb3ee97 [id=7d25d613c5b24f6ebe91178d36e10d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.926014 11500 tablet_service.cc:1511] Processing CreateTablet for tablet cabb4f9eb185456889acadaa624e66bb (DEFAULT_TABLE table=default.Table_1fb84c7800674a8d9fc0d70cd6e57beb [id=509c3101c0ee42c48f33549a58f20d70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.925812 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a65e06aba3640e2b42d05fb325c6171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.927145 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba0b2716f5a4dc0b946a992fac76e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.929387 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 1c09318926bf40aca077b59b8837a4cc (DEFAULT_TABLE table=default.Table_137ed1759a8941a2a663204df88796b7 [id=2518d154741b4726b0ee70d86b466db5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.937741 13209 raft_consensus.cc:493] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.937988 13209 raft_consensus.cc:515] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.939862 13209 leader_election.cc:290] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.946529 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabb4f9eb185456889acadaa624e66bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.946796 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cac299e4f8e4c9d90f244cd8719005a with delete_type TABLET_DATA_DELETED (replaced by tablet dfc41da6d8be47818cc2f68cd2558c7a) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:13.947845 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae7e91450eb4d67b70560d854e7d74c (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.948073 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 4ba0b2716f5a4dc0b946a992fac76e09 (DEFAULT_TABLE table=default.Table_b8374f14bfc94d20955c84e90f3f6695 [id=ebc6aff6a2164942a7cc7ae22d9f8714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.947844 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 23f7e6b28e0944b89a662b40e0da4379 (DEFAULT_TABLE table=default.Table_17dfbf84b0154c4692c3d29c06514c83 [id=4b5b76c2c9f04f039037a80e08721b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.950608 13209 raft_consensus.cc:493] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.950835 13209 raft_consensus.cc:515] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.951589 13209 leader_election.cc:290] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.956058 13356 ts_tablet_manager.cc:1929] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:13.956102 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet 75014fc54fc7481f83da07e1d96c4370 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:13.956322 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae7e91450eb4d67b70560d854e7d74c (DEFAULT_TABLE table=default.Table_77a2a3706c294f3bb05ed00c40145a6d [id=6e5a9c1398df4914a763528be24f87ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.956568 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 1e262aa230df47df89eed90cef3ab3e0 (DEFAULT_TABLE table=default.Table_43670b6626f54ad98b4b1540fa2d09bf [id=b632104d6faf4e2a9a14fcc4e6d5863c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.956708 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 23f7e6b28e0944b89a662b40e0da4379 (DEFAULT_TABLE table=default.Table_17dfbf84b0154c4692c3d29c06514c83 [id=4b5b76c2c9f04f039037a80e08721b21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.956843 13525 raft_consensus.cc:493] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:50:13.917368 11314 leader_election.cc:343] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 0575861dd3d6437284cc183acb87af0a
I20260925 01:50:13.961782 11314 leader_election.cc:304] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:13.962035 13321 raft_consensus.cc:2749] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:13.962349 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 44996.5us
I20260925 01:50:13.963940 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c09318926bf40aca077b59b8837a4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.965490 13576 raft_consensus.cc:493] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:13.965991 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f19bccf3c5540cb828ec7bfc89a1c17" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.966562 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9513d1d55fe846f5b1a2b7d315209002" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.967144 11345 tablet_service.cc:1511] Processing CreateTablet for tablet e27fb4110158412895dc802655e5d507 (DEFAULT_TABLE table=default.Table_11388be1a8f34e8fa41e64a79b062b29 [id=5da8dfb5758a49ce9ce2ae770b9b3a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.967487 11354 tablet_service.cc:1511] Processing CreateTablet for tablet a02464db4c3b4f408e4b26018f121121 (DEFAULT_TABLE table=default.Table_f23b8482c3ce4904a2a54bad0536a288 [id=a9eaca16691b4511908b7291080c1935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.975884 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f7e6b28e0944b89a662b40e0da4379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.976150 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae7e91450eb4d67b70560d854e7d74c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.984117 11946 ts_tablet_manager.cc:1929] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:13.984079 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4a51356880486a928181ee701f74d0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:13.984200 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ba0b2716f5a4dc0b946a992fac76e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.984448 11946 log.cc:1199] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/329a5af9fb654d4c894e1cf4fd636c13
I20260925 01:50:13.984542 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02464db4c3b4f408e4b26018f121121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.984880 11946 ts_tablet_manager.cc:1950] T 329a5af9fb654d4c894e1cf4fd636c13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:13.985633 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27fb4110158412895dc802655e5d507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.986557 11344 tablet_service.cc:1511] Processing CreateTablet for tablet fc0f8574c84046bd81c859826b3e8566 (DEFAULT_TABLE table=default.Table_5cead8ca50414983bbaca4096eb3ee97 [id=7d25d613c5b24f6ebe91178d36e10d42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:13.986901 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0f8574c84046bd81c859826b3e8566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:13.992022 13525 raft_consensus.cc:515] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:13.992370 11755 tablet_bootstrap.cc:654] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.992686 13525 leader_election.cc:290] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:13.992817 13525 raft_consensus.cc:2749] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.001991 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27fb4110158412895dc802655e5d507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.002956 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0f8574c84046bd81c859826b3e8566. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:13.966619 11177 leader_election.cc:343] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:14.004524 11177 leader_election.cc:343] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:13.986666 11754 tablet_bootstrap.cc:492] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.004631 13356 log.cc:1199] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b97f703869d4471cb940ef654203ec2b
I20260925 01:50:14.005055 11754 ts_tablet_manager.cc:1403] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.120s user 0.010s sys 0.005s
I20260925 01:50:14.005887 11754 raft_consensus.cc:359] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.006083 11754 raft_consensus.cc:385] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.006138 11754 raft_consensus.cc:740] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.006331 11754 consensus_queue.cc:260] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.006805 11754 ts_tablet_manager.cc:1434] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:14.007125 11754 tablet_bootstrap.cc:492] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.009121 11754 tablet_bootstrap.cc:654] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.008955 13356 ts_tablet_manager.cc:1950] T b97f703869d4471cb940ef654203ec2b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:14.013404 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c09318926bf40aca077b59b8837a4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.013664 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f7e6b28e0944b89a662b40e0da4379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.018152 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e262aa230df47df89eed90cef3ab3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.018492 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cabb4f9eb185456889acadaa624e66bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.022439 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae7e91450eb4d67b70560d854e7d74c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.022739 13533 raft_consensus.cc:493] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.022881 13533 raft_consensus.cc:515] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:14.023501 13533 leader_election.cc:290] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.025910 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d896cd03c7a4170b22e0a4a82c06e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.029254 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 950) took 3469 ms. Trace:
I20260925 01:50:14.034219 13356 rpcz_store.cc:276] 0925 01:50:10.560037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.560103 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:13.623423 (+3063320us) ts_tablet_manager.cc:1151] Deleting tablet b97f703869d4471cb940ef654203ec2b
0925 01:50:13.623436 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.760713 (+137277us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.955971 (+195258us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.029225 (+ 73254us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3062985}
I20260925 01:50:14.035235 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b97f703869d4471cb940ef654203ec2b (table default.Table_508d50254458453d8ce5ae125aa65da5 [id=e9edf18c4d10412cb249878f4a94e7d3]) successfully deleted
I20260925 01:50:14.035907 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 951) took 3452 ms. Trace:
I20260925 01:50:14.037895 13356 rpcz_store.cc:276] 0925 01:50:10.583557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.583617 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:14.035757 (+3452140us) ts_tablet_manager.cc:1151] Deleting tablet dcbe8d08a1ff4c97a2f9a40d706f4281
0925 01:50:14.035769 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.035887 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3398079}
W20260925 01:50:14.038872 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcbe8d08a1ff4c97a2f9a40d706f4281 already in progress: creating tablet
I20260925 01:50:14.038980 11754 tablet_bootstrap.cc:492] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.039111 11754 ts_tablet_manager.cc:1403] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.000s
I20260925 01:50:14.039484 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 972) took 2805 ms. Trace:
I20260925 01:50:14.039556 13356 rpcz_store.cc:276] 0925 01:50:11.233995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.234118 (+ 123us) service_pool.cc:224] Handling call
0925 01:50:14.039340 (+2805222us) ts_tablet_manager.cc:1151] Deleting tablet 681356bc659f4ca990cd2ffc0c10b533
0925 01:50:14.039356 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.039467 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2804997}
W20260925 01:50:14.040015 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 681356bc659f4ca990cd2ffc0c10b533 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 681356bc659f4ca990cd2ffc0c10b533 already in progress: creating tablet
I20260925 01:50:14.039942 11754 raft_consensus.cc:359] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.040122 11754 raft_consensus.cc:385] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.040170 11754 raft_consensus.cc:740] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.040403 11754 consensus_queue.cc:260] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.041004 11754 ts_tablet_manager.cc:1434] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:14.041304 11754 tablet_bootstrap.cc:492] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.042604 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a02464db4c3b4f408e4b26018f121121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.043087 11754 tablet_bootstrap.cc:654] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:13.965611 13576 raft_consensus.cc:515] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:14.052594 13576 leader_election.cc:290] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:14.053098 11314 leader_election.cc:343] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: fbd4b231f89a48e59e5eb3cf3976385a
W20260925 01:50:14.053673 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 220928us
I20260925 01:50:14.056159 13584 raft_consensus.cc:493] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.056295 13584 raft_consensus.cc:515] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.057547 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6b97d37704f4a0d88457d124bb4f259" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:50:14.059027 11177 leader_election.cc:343] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:14.059130 11457 leader_election.cc:343] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.059223 11457 leader_election.cc:304] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.059340 11378 raft_consensus.cc:3060] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:14.059587 11457 leader_election.cc:343] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.059690 11457 leader_election.cc:304] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.061816 11953 ts_tablet_manager.cc:1929] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:14.061945 11953 log.cc:1199] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/dfde700aff8049f4b10c46059da6907f
I20260925 01:50:14.064213 13536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } } }
I20260925 01:50:14.064433 13536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5 [sys.catalog]: This master's current role is: LEADER
I20260925 01:50:14.063174 11367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f117df272c342b6b4ea5e5a4d7fd137" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.067804 11754 tablet_bootstrap.cc:492] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.067961 11754 ts_tablet_manager.cc:1403] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.001s
I20260925 01:50:14.068704 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2f7ef888846ec9667916ba47084db" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.068805 11754 raft_consensus.cc:359] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.068969 11754 raft_consensus.cc:385] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.069022 11754 raft_consensus.cc:740] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.069218 11754 consensus_queue.cc:260] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:14.069406 11177 leader_election.cc:343] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.069813 11754 ts_tablet_manager.cc:1434] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260925 01:50:14.070165 11177 consensus_peers.cc:597] T 60411b0feafe4fef9c4fdc364163f1df P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260925 01:50:14.070183 11754 tablet_bootstrap.cc:492] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.072118 11754 tablet_bootstrap.cc:654] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.041009 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 974) took 2806 ms. Trace:
I20260925 01:50:14.073709 13356 rpcz_store.cc:276] 0925 01:50:11.234240 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.234359 (+ 119us) service_pool.cc:224] Handling call
0925 01:50:14.040897 (+2806538us) ts_tablet_manager.cc:1151] Deleting tablet dc00e20861c54760ac8409c54abd1795
0925 01:50:14.040906 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.040995 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2806366}
I20260925 01:50:14.074456 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 975) took 2840 ms. Trace:
W20260925 01:50:14.074424 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet dc00e20861c54760ac8409c54abd1795 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc00e20861c54760ac8409c54abd1795 already in progress: creating tablet
I20260925 01:50:14.074532 13356 rpcz_store.cc:276] 0925 01:50:11.234316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.234651 (+ 335us) service_pool.cc:224] Handling call
0925 01:50:14.074319 (+2839668us) ts_tablet_manager.cc:1151] Deleting tablet 61c1181b38a247e79bd7a6355950881e
0925 01:50:14.074332 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.074435 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2839519}
W20260925 01:50:14.074915 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 61c1181b38a247e79bd7a6355950881e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61c1181b38a247e79bd7a6355950881e already in progress: creating tablet
I20260925 01:50:14.075166 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 976) took 2840 ms. Trace:
I20260925 01:50:14.075258 13356 rpcz_store.cc:276] 0925 01:50:11.235018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.235062 (+ 44us) service_pool.cc:224] Handling call
0925 01:50:14.074913 (+2839851us) ts_tablet_manager.cc:1151] Deleting tablet dceeedf3471d45508f025e7a4c7f73f2
0925 01:50:14.074922 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.075148 (+ 226us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2839705}
W20260925 01:50:14.075771 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet dceeedf3471d45508f025e7a4c7f73f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dceeedf3471d45508f025e7a4c7f73f2 already in progress: creating tablet
I20260925 01:50:14.075856 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 973) took 2841 ms. Trace:
I20260925 01:50:14.075923 13356 rpcz_store.cc:276] 0925 01:50:11.234155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.235346 (+ 1191us) service_pool.cc:224] Handling call
0925 01:50:14.075742 (+2840396us) ts_tablet_manager.cc:1151] Deleting tablet 03232387650b450c97c41701b306ac77
0925 01:50:14.075756 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.075839 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2840213}
I20260925 01:50:14.076409 13356 tablet_replica.cc:333] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
W20260925 01:50:14.076401 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 03232387650b450c97c41701b306ac77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03232387650b450c97c41701b306ac77 already in progress: creating tablet
I20260925 01:50:14.076618 13356 raft_consensus.cc:2243] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:14.076995 13356 pending_rounds.cc:70] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:14.077078 13356 pending_rounds.cc:77] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072945044406272 op_type: NO_OP noop_request { }
I20260925 01:50:14.077203 13356 raft_consensus.cc:2889] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:14.077311 13356 raft_consensus.cc:2272] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.078156 13356 ts_tablet_manager.cc:1916] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.089864 11754 tablet_bootstrap.cc:492] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.090416 11754 ts_tablet_manager.cc:1403] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260925 01:50:14.091323 11754 raft_consensus.cc:359] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.091585 11754 raft_consensus.cc:385] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.091696 11754 raft_consensus.cc:740] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.092056 11754 consensus_queue.cc:260] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.092967 11754 ts_tablet_manager.cc:1434] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:14.094894 11754 tablet_bootstrap.cc:492] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
W20260925 01:50:14.101480 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet c4a069c2d1ee4475817dc26becc3ebb6 (table default.Table_c3edb1c0f4574f5680329efd13e9a3cb [id=bf059f47d27842bb9b375e7e38df29c4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c4a069c2d1ee4475817dc26becc3ebb6 consensus state has no leader
W20260925 01:50:14.109817 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet afa1558aea804bfc910fe699335eda24 consensus state has no leader
I20260925 01:50:14.112088 11754 tablet_bootstrap.cc:654] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.115316 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_b428af9da57849c5a79628f9d4d41b86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:14.115316 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8bd16ceb58bf4be1b639f910b08ff42c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.116022 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b428af9da57849c5a79628f9d4d41b86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:14.116043 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bd16ceb58bf4be1b639f910b08ff42c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.117439 13356 ts_tablet_manager.cc:1929] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:14.123564 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4a4a414c1da142179c47230a40b1945d" } modify_external_catalogs: true
I20260925 01:50:14.123831 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4a4a414c1da142179c47230a40b1945d" } modify_external_catalogs: true
I20260925 01:50:14.138933 13584 leader_election.cc:290] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.139317 13584 raft_consensus.cc:2749] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.139492 13584 raft_consensus.cc:2749] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.141053 11953 ts_tablet_manager.cc:1950] T dfde700aff8049f4b10c46059da6907f P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:14.141502 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 710) took 8823 ms. Trace:
I20260925 01:50:14.141645 11953 rpcz_store.cc:276] 0925 01:50:05.318515 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.318574 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:13.771857 (+8453283us) ts_tablet_manager.cc:1151] Deleting tablet dfde700aff8049f4b10c46059da6907f
0925 01:50:13.771864 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.912050 (+140186us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.061760 (+149710us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.141488 (+ 79728us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8365549}
I20260925 01:50:14.144034 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet dfde700aff8049f4b10c46059da6907f (table default.Table_32aa0edcb40b42d39d7a738c77b857fb [id=1ee74b5ac91243c9b7f65e894bbbb7a8]) successfully deleted
I20260925 01:50:14.145047 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3ecdc7c64ae449629e81d8bb5f1257e3" } modify_external_catalogs: true
I20260925 01:50:14.145332 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3ecdc7c64ae449629e81d8bb5f1257e3" } modify_external_catalogs: true
I20260925 01:50:14.146095 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3adbf2cf7ef74941a8667f2eb134df79" } modify_external_catalogs: true
I20260925 01:50:14.146257 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3adbf2cf7ef74941a8667f2eb134df79" } modify_external_catalogs: true
I20260925 01:50:14.146911 13584 raft_consensus.cc:493] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.147063 13584 raft_consensus.cc:515] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.147765 13584 leader_election.cc:290] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:14.151499 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d07df8063b2e4971a12af229585cfe44 consensus state has no leader
I20260925 01:50:14.124593 11754 tablet_bootstrap.cc:492] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
W20260925 01:50:14.129920 11177 consensus_peers.cc:597] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:14.158337 11754 ts_tablet_manager.cc:1403] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.002s
I20260925 01:50:14.159132 11754 raft_consensus.cc:359] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.159382 11754 raft_consensus.cc:385] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.159487 11754 raft_consensus.cc:740] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.159781 11754 consensus_queue.cc:260] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.160547 11754 ts_tablet_manager.cc:1434] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:14.160967 11754 tablet_bootstrap.cc:492] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.158178 13356 log.cc:1199] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/31ffb404d93a4436ba9e624b45650fe1
I20260925 01:50:14.162426 13356 ts_tablet_manager.cc:1950] T 31ffb404d93a4436ba9e624b45650fe1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:14.163066 11754 tablet_bootstrap.cc:654] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.163305 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 986) took 2745 ms. Trace:
I20260925 01:50:14.163473 13356 rpcz_store.cc:276] 0925 01:50:11.418309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.418363 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:14.076355 (+2657992us) ts_tablet_manager.cc:1151] Deleting tablet 31ffb404d93a4436ba9e624b45650fe1
0925 01:50:14.076365 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.114311 (+ 37946us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.117380 (+ 3069us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.163285 (+ 45905us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2657758}
I20260925 01:50:14.164077 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 31ffb404d93a4436ba9e624b45650fe1 (table default.Table_d7b8d87cdc614126a5b456bfaef70491 [id=a26d8b5cd5b94f7392cd13e13ca79d80]) successfully deleted
I20260925 01:50:14.164173 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 979) took 2858 ms. Trace:
I20260925 01:50:14.164235 13356 rpcz_store.cc:276] 0925 01:50:11.305834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.327815 (+ 21981us) service_pool.cc:224] Handling call
0925 01:50:14.164035 (+2836220us) ts_tablet_manager.cc:1151] Deleting tablet 1b4f58554cb84a08a3fdf14cb279ca56
0925 01:50:14.164048 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.164158 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2700739}
W20260925 01:50:14.164692 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1b4f58554cb84a08a3fdf14cb279ca56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b4f58554cb84a08a3fdf14cb279ca56 already in progress: creating tablet
I20260925 01:50:14.165066 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 977) took 2864 ms. Trace:
I20260925 01:50:14.165132 13356 rpcz_store.cc:276] 0925 01:50:11.300202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.328223 (+ 28021us) service_pool.cc:224] Handling call
0925 01:50:14.164953 (+2836730us) ts_tablet_manager.cc:1151] Deleting tablet e5bc61637d944b60ba9e703e9894174c
0925 01:50:14.164962 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.165050 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2700833}
W20260925 01:50:14.165881 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e5bc61637d944b60ba9e703e9894174c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5bc61637d944b60ba9e703e9894174c already in progress: creating tablet
I20260925 01:50:14.166312 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 992) took 2258 ms. Trace:
I20260925 01:50:14.166424 13356 rpcz_store.cc:276] 0925 01:50:11.908271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.928140 (+ 19869us) service_pool.cc:224] Handling call
0925 01:50:14.166217 (+2238077us) ts_tablet_manager.cc:1151] Deleting tablet f30fbaa9db5144debf9cc5124c9bf9bd
0925 01:50:14.166227 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.166297 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2237794}
W20260925 01:50:14.167065 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet f30fbaa9db5144debf9cc5124c9bf9bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f30fbaa9db5144debf9cc5124c9bf9bd already in progress: creating tablet
I20260925 01:50:14.167436 13356 tablet_replica.cc:333] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:14.167673 13356 raft_consensus.cc:2243] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:14.168051 13356 raft_consensus.cc:2272] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.170861 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b6bde824d74acfaaffc23a0b05db8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.171051 11519 raft_consensus.cc:2468] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:14.172173 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 112583us
I20260925 01:50:14.173276 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 969) took 2085 ms. Trace:
I20260925 01:50:14.173444 11946 rpcz_store.cc:276] 0925 01:50:12.087565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.087624 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:13.680981 (+1593357us) ts_tablet_manager.cc:1151] Deleting tablet 329a5af9fb654d4c894e1cf4fd636c13
0925 01:50:13.680990 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:13.851563 (+170573us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:13.984058 (+132495us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.173259 (+189201us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593154}
I20260925 01:50:14.173851 13356 ts_tablet_manager.cc:1916] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.190220 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b92054aaa704c7ebd6b075c30db2616 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.195319 11755 tablet_bootstrap.cc:492] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:14.197425 11755 ts_tablet_manager.cc:1403] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.410s user 0.006s sys 0.021s
I20260925 01:50:14.199803 11755 raft_consensus.cc:359] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.200260 13452 raft_consensus.cc:493] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.200642 13452 raft_consensus.cc:515] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.201200 13452 leader_election.cc:290] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:14.201647 11375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3702f09e45a14c80af716d642d30cdfa" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.201927 11373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9663d7f4008e4ee0a3ba4373258242eb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.201998 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75014fc54fc7481f83da07e1d96c4370" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.202399 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 712) took 8691 ms. Trace:
I20260925 01:50:14.202503 11953 rpcz_store.cc:276] 0925 01:50:05.510832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.510888 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:14.142042 (+8631154us) ts_tablet_manager.cc:1151] Deleting tablet 7ad519d103e644e1b78ce540d623cbcb
0925 01:50:14.142051 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.202382 (+ 60331us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8630889}
W20260925 01:50:14.203179 11177 consensus_peers.cc:597] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:14.203923 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 7ad519d103e644e1b78ce540d623cbcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7ad519d103e644e1b78ce540d623cbcb already in progress: creating tablet
I20260925 01:50:14.204386 11755 raft_consensus.cc:385] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.204598 11755 raft_consensus.cc:740] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.204917 11755 consensus_queue.cc:260] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.200459 11314 leader_election.cc:304] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.207230 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e9d27af68a134e74b9ab639ff0ebd044" } modify_external_catalogs: true
I20260925 01:50:14.207525 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e9d27af68a134e74b9ab639ff0ebd044" } modify_external_catalogs: true
W20260925 01:50:14.207737 11314 leader_election.cc:343] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: fbd4b231f89a48e59e5eb3cf3976385a
I20260925 01:50:14.208045 13356 ts_tablet_manager.cc:1929] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:14.208186 13356 log.cc:1199] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/e95fb28febd94a26ba9682fb9a462872
I20260925 01:50:14.208122 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_ada1f063f511450c9c742f4b0fb7be82" } new_table_name: "default.Table_626703e74bc441ad8109ad342cd5626e" modify_external_catalogs: true
I20260925 01:50:14.208640 13356 ts_tablet_manager.cc:1950] T e95fb28febd94a26ba9682fb9a462872 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:14.208773 11314 leader_election.cc:304] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.209656 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 993) took 2202 ms. Trace:
I20260925 01:50:14.209740 13356 rpcz_store.cc:276] 0925 01:50:12.007210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.007265 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:14.167372 (+2160107us) ts_tablet_manager.cc:1151] Deleting tablet e95fb28febd94a26ba9682fb9a462872
0925 01:50:14.167383 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.188829 (+ 21446us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.205154 (+ 16325us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.209638 (+ 4484us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2116733}
I20260925 01:50:14.210249 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a9bdcb0034c84520a7d9881bc8927159" } new_table_name: "default.Table_0eea1e3736e342b5923d2977ea9fdd74" modify_external_catalogs: true
I20260925 01:50:14.210458 13576 raft_consensus.cc:2749] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.208633 11755 ts_tablet_manager.cc:1434] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260925 01:50:14.210258 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]) successfully deleted
I20260925 01:50:14.212293 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7c51401ee2a840ee9ba64ed31002528d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:14.212577 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_8853eb2058fe466db58b85c80ecacda1" } new_table_name: "default.Table_b2e836fe8ceb4b0a8bcd39f04a0d6829" modify_external_catalogs: true
W20260925 01:50:14.213129 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c51401ee2a840ee9ba64ed31002528d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.214233 11671 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1d8dce29493342b78a7966e35b2ffa82" } modify_external_catalogs: true
I20260925 01:50:14.214475 11671 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1d8dce29493342b78a7966e35b2ffa82" } modify_external_catalogs: true
W20260925 01:50:14.215555 11314 leader_election.cc:343] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: a07f37b8469a497ba3fe504cb21105d2
W20260925 01:50:14.217547 11314 leader_election.cc:343] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 04f412cbebe04a629070aecf2753287c
I20260925 01:50:14.215888 11754 tablet_bootstrap.cc:492] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.218658 11754 ts_tablet_manager.cc:1403] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.058s user 0.007s sys 0.003s
I20260925 01:50:14.219782 11754 raft_consensus.cc:359] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.219964 11754 raft_consensus.cc:385] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:14.220000 11314 leader_election.cc:343] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: d253f8b1e4ac41388a885178f2ed0f40
I20260925 01:50:14.220034 11754 raft_consensus.cc:740] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.220327 11754 consensus_queue.cc:260] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.221487 11754 ts_tablet_manager.cc:1434] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:14.221783 11754 tablet_bootstrap.cc:492] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.223091 13356 tablet_replica.cc:333] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:14.223315 13356 raft_consensus.cc:2243] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:14.223665 13356 pending_rounds.cc:70] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:14.223724 13356 pending_rounds.cc:77] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072943313068032 op_type: NO_OP noop_request { }
I20260925 01:50:14.223809 13356 raft_consensus.cc:2889] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:14.223891 13356 raft_consensus.cc:2272] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.225455 13209 raft_consensus.cc:493] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.225594 13209 raft_consensus.cc:515] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.226280 13209 leader_election.cc:290] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.173929 11946 tablet_replica.cc:333] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:14.229547 11946 raft_consensus.cc:2243] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:14.229740 11946 raft_consensus.cc:2272] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.232524 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3ba459a81845699435c2e44f5c9f19" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.233671 11177 leader_election.cc:343] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.242424 13356 ts_tablet_manager.cc:1916] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:14.244202 11177 consensus_peers.cc:597] T 6a9ccd099cba4b92909bb17c45dfce8a P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260925 01:50:14.246177 11754 tablet_bootstrap.cc:654] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.256047 11755 tablet_bootstrap.cc:492] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:14.236196 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 713) took 8723 ms. Trace:
I20260925 01:50:14.256964 11953 rpcz_store.cc:276] 0925 01:50:05.512317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.512364 (+ 47us) service_pool.cc:224] Handling call
0925 01:50:14.202765 (+8690401us) ts_tablet_manager.cc:1151] Deleting tablet 41c58f974b1c4334852b7e17b4da7867
0925 01:50:14.231695 (+ 28930us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.236175 (+ 4480us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8690237}
I20260925 01:50:14.257385 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 714) took 8742 ms. Trace:
I20260925 01:50:14.257465 11953 rpcz_store.cc:276] 0925 01:50:05.514480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.514531 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:14.257253 (+8742722us) ts_tablet_manager.cc:1151] Deleting tablet b0e27b81d39240efa5136ed668822d35
0925 01:50:14.257262 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.257367 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8742555}
W20260925 01:50:14.257728 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 41c58f974b1c4334852b7e17b4da7867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41c58f974b1c4334852b7e17b4da7867 already in progress: creating tablet
I20260925 01:50:14.257836 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 715) took 8738 ms. Trace:
I20260925 01:50:14.257905 11953 rpcz_store.cc:276] 0925 01:50:05.519489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.519538 (+ 49us) service_pool.cc:224] Handling call
0925 01:50:14.257742 (+8738204us) ts_tablet_manager.cc:1151] Deleting tablet 38603da7b4b14ce5835646c330b1f0ce
0925 01:50:14.257750 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.257821 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8738029}
I20260925 01:50:14.258237 11953 tablet_replica.cc:333] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:14.258423 11953 raft_consensus.cc:2243] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
W20260925 01:50:14.258515 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b0e27b81d39240efa5136ed668822d35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0e27b81d39240efa5136ed668822d35 already in progress: creating tablet
I20260925 01:50:14.258733 11953 raft_consensus.cc:2272] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:14.258786 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 38603da7b4b14ce5835646c330b1f0ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38603da7b4b14ce5835646c330b1f0ce already in progress: creating tablet
I20260925 01:50:14.259298 11953 ts_tablet_manager.cc:1916] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.259719 11755 tablet_bootstrap.cc:654] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:14.263533 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63f96f2643dc4de29f8609a657102b80 consensus state has no leader
I20260925 01:50:14.264025 11672 master_service.cc:960] ReplaceTablet: received request to replace tablet b948d000f8314491b02244bdce37ba33 from {username='slave'} at 127.0.0.1:60372
W20260925 01:50:14.266515 11457 leader_election.cc:343] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.266779 11457 leader_election.cc:304] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.267306 13591 raft_consensus.cc:2749] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:14.268705 11457 leader_election.cc:343] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.269764 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9513d1d55fe846f5b1a2b7d315209002" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.269869 11755 tablet_bootstrap.cc:492] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:14.269939 11519 raft_consensus.cc:2468] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:14.269999 11755 ts_tablet_manager.cc:1403] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.001s
I20260925 01:50:14.270525 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4a51356880486a928181ee701f74d0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.270715 11519 raft_consensus.cc:2468] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:14.270669 11755 raft_consensus.cc:359] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.270830 11755 raft_consensus.cc:385] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.270874 11755 raft_consensus.cc:740] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.272490 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2f7ef888846ec9667916ba47084db" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.272680 11519 raft_consensus.cc:2468] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:14.274482 11754 tablet_bootstrap.cc:492] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.274659 11754 ts_tablet_manager.cc:1403] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.053s user 0.009s sys 0.001s
I20260925 01:50:14.274695 11755 consensus_queue.cc:260] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.275694 11755 ts_tablet_manager.cc:1434] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260925 01:50:14.276057 11754 raft_consensus.cc:359] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.276268 11754 raft_consensus.cc:385] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.276327 11754 raft_consensus.cc:740] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.276629 11754 consensus_queue.cc:260] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.277380 11754 ts_tablet_manager.cc:1434] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260925 01:50:14.278573 11754 tablet_bootstrap.cc:492] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.279193 11946 ts_tablet_manager.cc:1916] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.280694 11754 tablet_bootstrap.cc:654] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.288895 11755 tablet_bootstrap.cc:492] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:14.290894 13356 ts_tablet_manager.cc:1929] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:14.291100 13356 log.cc:1199] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/3d398851fb194c61a0a3b2c60c7a5e8b
I20260925 01:50:14.291713 13356 ts_tablet_manager.cc:1950] T 3d398851fb194c61a0a3b2c60c7a5e8b P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:14.292860 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 994) took 2261 ms. Trace:
I20260925 01:50:14.292972 13356 rpcz_store.cc:276] 0925 01:50:12.031809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.037040 (+ 5231us) service_pool.cc:224] Handling call
0925 01:50:14.223024 (+2185984us) ts_tablet_manager.cc:1151] Deleting tablet 3d398851fb194c61a0a3b2c60c7a5e8b
0925 01:50:14.223035 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.246305 (+ 23270us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.290809 (+ 44504us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.292830 (+ 2021us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2171801}
I20260925 01:50:14.293442 13356 tablet_replica.cc:333] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:14.293629 13356 raft_consensus.cc:2243] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:14.293833 13356 raft_consensus.cc:2272] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.293881 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet 2957cbd4669749b381f59d1e301a692d from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:14.295113 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 3d398851fb194c61a0a3b2c60c7a5e8b (table default.Table_4ef3129ce4d545c0a2dae74dbc7798f0 [id=13bb30253d2c46e8aadf3c0065334d43]) successfully deleted
I20260925 01:50:14.296214 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e9c35a7dc406446a80d02846b353e385"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.297013 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9c35a7dc406446a80d02846b353e385 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:14.301044 11677 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 136bed75fa2b478fbf4cdd96ff0c3c5a consensus state has no leader
I20260925 01:50:14.303050 13209 raft_consensus.cc:493] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.303197 13209 raft_consensus.cc:515] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.303962 13209 leader_election.cc:290] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.304704 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b92054aaa704c7ebd6b075c30db2616" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.305320 11177 leader_election.cc:343] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.306164 11755 tablet_bootstrap.cc:654] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.317090 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_e151170fc7c54353aef81e4be2335941" } new_table_name: "default.Table_dccc00ae74c648bfaa87224b565039f5" modify_external_catalogs: true
I20260925 01:50:14.321835 11754 tablet_bootstrap.cc:492] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.322028 11754 ts_tablet_manager.cc:1403] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.002s
I20260925 01:50:14.322795 11754 raft_consensus.cc:359] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.322979 11754 raft_consensus.cc:385] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.323032 11754 raft_consensus.cc:740] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.328863 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 4c420ce9a8b1472ca0b8d524a27de87f (DEFAULT_TABLE table=default.Table_b06bd286d49842a79c6e999d9a4a3cf2 [id=3013ec95478e41bf8e2e49a6c1238cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.329355 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c420ce9a8b1472ca0b8d524a27de87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.329581 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 4c420ce9a8b1472ca0b8d524a27de87f (DEFAULT_TABLE table=default.Table_b06bd286d49842a79c6e999d9a4a3cf2 [id=3013ec95478e41bf8e2e49a6c1238cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.329999 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c420ce9a8b1472ca0b8d524a27de87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.332268 13209 raft_consensus.cc:493] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.332428 13209 raft_consensus.cc:515] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.332670 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 9c4f1e725fe84552943563aa95687842 (table default.Table_d10a845bf44e48a091bfd078a1a436d7 [id=564bdd9ee3404040b32798c6890aff6e]). Expected version 3 got 0
I20260925 01:50:14.333074 11679 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e7b6bde824d74acfaaffc23a0b05db8b (table default.Table_c0c2a440fcfd4cdc8f97e52a83a31318 [id=2a9ff32ac39e45a898876d49c1332249]). Expected version 1 got 0
I20260925 01:50:14.333151 13209 leader_election.cc:290] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.333809 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0749a0ae58df4ff8b74a86f072332fad" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.334414 11177 leader_election.cc:343] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.334843 11209 tablet_service.cc:1511] Processing CreateTablet for tablet 906885205de348d488b8e84f9b7244bd (DEFAULT_TABLE table=default.Table_8c48bf855090436ba60e5d1c81c2370f [id=d246cf2a93774bfcb1d91e62818046a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.335215 11209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906885205de348d488b8e84f9b7244bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.338151 11203 tablet_service.cc:1511] Processing CreateTablet for tablet 456833aeb015498e93079e934381da51 (DEFAULT_TABLE table=default.Table_c87a25d7403a414e8fe5bad44e1cf16c [id=f005313328b346f68f4dd9e999b38fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.338498 11203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456833aeb015498e93079e934381da51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.338500 13356 ts_tablet_manager.cc:1916] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.342326 11217 tablet_service.cc:1511] Processing CreateTablet for tablet c64209f204b7439fb98f0e21221fd7b2 (DEFAULT_TABLE table=default.Table_ecbfb77555fc49d1a642966c2a8093bc [id=e4a1230d7f2e417e8065b1d892248f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.342666 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64209f204b7439fb98f0e21221fd7b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.343976 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 5a20f47a17954e56b07814830a478263 (DEFAULT_TABLE table=default.Table_656244678e8846349b09949a289a987b [id=1b624ed2e41e45e1ac44a9fa8cce99b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.344326 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a20f47a17954e56b07814830a478263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.323284 11754 consensus_queue.cc:260] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.345992 11754 ts_tablet_manager.cc:1434] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.024s user 0.001s sys 0.000s
I20260925 01:50:14.346292 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 113d7ccee4e349e19d3948e09d2c533d with delete_type TABLET_DATA_DELETED (replaced by tablet daf6b1408d094086a79488d64dc62c75) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.346494 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a37a6deaeb24c99824b62fbb2d603b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.346608 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 0feae471bcea4ddb8bc61cd1f9b6fedc (DEFAULT_TABLE table=default.Table_3b0c24ce448a44b5a1f5576908672b20 [id=31dc1a4ebbbc493496cd7baf940b89d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.346673 11204 tablet_service.cc:1558] Processing DeleteTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.346918 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feae471bcea4ddb8bc61cd1f9b6fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.347362 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb8766ae7554a40bcd7cda284f869f6 (DEFAULT_TABLE table=default.Table_2a085030ab794dc8b1c4c57165ac244b [id=e4511a32722940018a905308ece85f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.346324 11754 tablet_bootstrap.cc:492] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.347666 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb8766ae7554a40bcd7cda284f869f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.349293 11754 tablet_bootstrap.cc:654] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.350319 11218 tablet_service.cc:1511] Processing CreateTablet for tablet 90371eaf696043ae973b8caa387398cf (DEFAULT_TABLE table=default.Table_3971153031a6480ca07158be22e8b9db [id=1b290f05277b4a15893c10128594259e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.350646 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90371eaf696043ae973b8caa387398cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.346933 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet e40083a885974e3595ec2fb5b16d4a5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.354166 11204 tablet_service.cc:1511] Processing CreateTablet for tablet 188c06c728f74f5eb60406f387f2df82 (DEFAULT_TABLE table=default.Table_3e5bfe5c108041978d6f6cbf9e1f2b27 [id=4cdb97efe37d47d4ba1b4b3d941390ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.354548 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188c06c728f74f5eb60406f387f2df82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.356935 11213 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb474285590475684f892259e3e9202 (DEFAULT_TABLE table=default.Table_e11534843fc644449b4f55ebcbcbaf39 [id=f09517d086984a89b2970c17a59387f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.357278 11213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb474285590475684f892259e3e9202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.357473 11754 tablet_bootstrap.cc:492] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.357633 11754 ts_tablet_manager.cc:1403] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260925 01:50:14.358412 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 265e893faeed4e8c84071035e105c935 (DEFAULT_TABLE table=default.Table_52e6c161d59b404ca75a22cc9f043b7f [id=c4ddbbf8b0f14cc692df112dbed98ce4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.358788 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265e893faeed4e8c84071035e105c935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.358651 11754 raft_consensus.cc:359] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.358919 11754 raft_consensus.cc:385] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.359030 11754 raft_consensus.cc:740] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.359323 11754 consensus_queue.cc:260] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.361908 11205 tablet_service.cc:1511] Processing CreateTablet for tablet d77dac40ea344d78829e7a59b7f6dec4 (DEFAULT_TABLE table=default.Table_99845f420c274423ac97431b16de7342 [id=ec0d4226fdaf434da3e0c2edabda8310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.362334 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77dac40ea344d78829e7a59b7f6dec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.362437 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 305b9ec841ca41ee98fee6503a5207f7 (DEFAULT_TABLE table=default.Table_a5de1a12493e459a962b2fd1dadda16e [id=e4c27ba0cc274088987ca9d880a6a88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.362829 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b9ec841ca41ee98fee6503a5207f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.367472 13356 ts_tablet_manager.cc:1929] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260925 01:50:14.367594 13356 log.cc:1199] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/29f28e49791744428729279a79b6c9f1
I20260925 01:50:14.367559 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 906885205de348d488b8e84f9b7244bd (DEFAULT_TABLE table=default.Table_8c48bf855090436ba60e5d1c81c2370f [id=d246cf2a93774bfcb1d91e62818046a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.367970 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906885205de348d488b8e84f9b7244bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.368021 13356 ts_tablet_manager.cc:1950] T 29f28e49791744428729279a79b6c9f1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:14.369141 11754 ts_tablet_manager.cc:1434] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260925 01:50:14.369628 11754 tablet_bootstrap.cc:492] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.370352 11348 tablet_service.cc:1511] Processing CreateTablet for tablet c64209f204b7439fb98f0e21221fd7b2 (DEFAULT_TABLE table=default.Table_ecbfb77555fc49d1a642966c2a8093bc [id=e4a1230d7f2e417e8065b1d892248f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.370700 11348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64209f204b7439fb98f0e21221fd7b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.371366 11210 tablet_service.cc:1511] Processing CreateTablet for tablet 912663c9513847748864b8c2064714b6 (DEFAULT_TABLE table=default.Table_d3b5e1eb785749939261859f4fb504a9 [id=fa9b155147cd48e2b56817bdceeb357d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.371713 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912663c9513847748864b8c2064714b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.374352 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 456833aeb015498e93079e934381da51 (DEFAULT_TABLE table=default.Table_c87a25d7403a414e8fe5bad44e1cf16c [id=f005313328b346f68f4dd9e999b38fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.374703 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456833aeb015498e93079e934381da51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.374784 11754 tablet_bootstrap.cc:654] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.375572 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5d6ca05ed4c34a6eb0d256874587bbdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.376210 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d6ca05ed4c34a6eb0d256874587bbdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.378338 11350 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb8766ae7554a40bcd7cda284f869f6 (DEFAULT_TABLE table=default.Table_2a085030ab794dc8b1c4c57165ac244b [id=e4511a32722940018a905308ece85f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.378715 11350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb8766ae7554a40bcd7cda284f869f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.379182 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_984614b000d54d07bed18722acbd3ea8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.379673 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_984614b000d54d07bed18722acbd3ea8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.381875 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 83c69194c062411db10113b63f6be92c (DEFAULT_TABLE table=default.Table_eb0cc83e98e14a84b8ca8fcb5011b6c4 [id=19fb0a39f8044cf4841c83d1ebbf7e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.382370 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c69194c062411db10113b63f6be92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.382685 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 0f61d60575694922936ae6e111f3257d (DEFAULT_TABLE table=default.Table_64d02d043b714fe1849b322e84285581 [id=c9e15f23990a4722b6a7614e015e134b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.383024 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f61d60575694922936ae6e111f3257d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.385504 11754 tablet_bootstrap.cc:492] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.385669 11754 ts_tablet_manager.cc:1403] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260925 01:50:14.386449 11354 tablet_service.cc:1511] Processing CreateTablet for tablet 90371eaf696043ae973b8caa387398cf (DEFAULT_TABLE table=default.Table_3971153031a6480ca07158be22e8b9db [id=1b290f05277b4a15893c10128594259e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.386826 11354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90371eaf696043ae973b8caa387398cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.392860 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 84649414f2874c8fac5066acc9f54e85 (DEFAULT_TABLE table=default.Table_e446bd8217484efab9bc956d45907276 [id=0b280dd904324f4bab9034c74d0eda12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.393297 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84649414f2874c8fac5066acc9f54e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.394392 11754 raft_consensus.cc:359] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.394871 11754 raft_consensus.cc:385] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.394970 11754 raft_consensus.cc:740] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.395236 11754 consensus_queue.cc:260] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.397342 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 6532e1b338554cfa87084e4be84584df (DEFAULT_TABLE table=default.Table_02ce0d6160ed4598b09804acbfe785a1 [id=e67527f649b1465b93e8f7a743dcacbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.397488 11211 tablet_service.cc:1511] Processing CreateTablet for tablet f093df623d384a41b466758e99284f3e (DEFAULT_TABLE table=default.Table_83cb911831d14ec1a87189952a773203 [id=6d2a03b0b54f40aebaac877c5a1b7ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.397759 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6532e1b338554cfa87084e4be84584df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:14.398197 11177 consensus_peers.cc:597] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:14.398780 11754 ts_tablet_manager.cc:1434] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260925 01:50:14.399111 11754 tablet_bootstrap.cc:492] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.397979 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 7977c81925034298ae3ed0568ff688c1 (DEFAULT_TABLE table=default.Table_28d5478034e044e8b29c2fed007c3dc8 [id=6b9d4f8809c548118808cea95f9484db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.399348 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0b0ce45b63c44b46a26a84dbc1eff4dc
I20260925 01:50:14.399544 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7977c81925034298ae3ed0568ff688c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.401000 11754 tablet_bootstrap.cc:654] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.382422 11210 tablet_service.cc:1511] Processing CreateTablet for tablet dfc41da6d8be47818cc2f68cd2558c7a (DEFAULT_TABLE table=default.Table_4735603a234e494e8530cb2f9745858c [id=9f3c01bf46474e3cba73aed29d40d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.411126 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 0f61d60575694922936ae6e111f3257d (DEFAULT_TABLE table=default.Table_64d02d043b714fe1849b322e84285581 [id=c9e15f23990a4722b6a7614e015e134b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.411599 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f61d60575694922936ae6e111f3257d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.411544 11351 tablet_service.cc:1511] Processing CreateTablet for tablet 5a20f47a17954e56b07814830a478263 (DEFAULT_TABLE table=default.Table_656244678e8846349b09949a289a987b [id=1b624ed2e41e45e1ac44a9fa8cce99b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.411845 11351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a20f47a17954e56b07814830a478263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.412319 11358 tablet_service.cc:1511] Processing CreateTablet for tablet d77dac40ea344d78829e7a59b7f6dec4 (DEFAULT_TABLE table=default.Table_99845f420c274423ac97431b16de7342 [id=ec0d4226fdaf434da3e0c2edabda8310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.412659 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77dac40ea344d78829e7a59b7f6dec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.414335 11344 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb474285590475684f892259e3e9202 (DEFAULT_TABLE table=default.Table_e11534843fc644449b4f55ebcbcbaf39 [id=f09517d086984a89b2970c17a59387f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.414641 11344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb474285590475684f892259e3e9202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.415580 13209 raft_consensus.cc:493] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.416605 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 912663c9513847748864b8c2064714b6 (DEFAULT_TABLE table=default.Table_d3b5e1eb785749939261859f4fb504a9 [id=fa9b155147cd48e2b56817bdceeb357d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.417069 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912663c9513847748864b8c2064714b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.417155 11211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f093df623d384a41b466758e99284f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.418041 11343 tablet_service.cc:1511] Processing CreateTablet for tablet 0feae471bcea4ddb8bc61cd1f9b6fedc (DEFAULT_TABLE table=default.Table_3b0c24ce448a44b5a1f5576908672b20 [id=31dc1a4ebbbc493496cd7baf940b89d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.418012 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 687ee40ebf87456a831b49f540ea8497 (DEFAULT_TABLE table=default.Table_1f4098d245d74165bbb7902a63b56907 [id=b204aed109ab4119958014aed11291db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.418282 11357 tablet_service.cc:1511] Processing CreateTablet for tablet dfc41da6d8be47818cc2f68cd2558c7a (DEFAULT_TABLE table=default.Table_4735603a234e494e8530cb2f9745858c [id=9f3c01bf46474e3cba73aed29d40d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.418370 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feae471bcea4ddb8bc61cd1f9b6fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.418614 11357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc41da6d8be47818cc2f68cd2558c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.418809 11356 tablet_service.cc:1511] Processing CreateTablet for tablet 265e893faeed4e8c84071035e105c935 (DEFAULT_TABLE table=default.Table_52e6c161d59b404ca75a22cc9f043b7f [id=c4ddbbf8b0f14cc692df112dbed98ce4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.419147 11356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265e893faeed4e8c84071035e105c935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.422086 11347 tablet_service.cc:1511] Processing CreateTablet for tablet 84649414f2874c8fac5066acc9f54e85 (DEFAULT_TABLE table=default.Table_e446bd8217484efab9bc956d45907276 [id=0b280dd904324f4bab9034c74d0eda12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.422122 13209 raft_consensus.cc:515] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.422294 11345 tablet_service.cc:1511] Processing CreateTablet for tablet 188c06c728f74f5eb60406f387f2df82 (DEFAULT_TABLE table=default.Table_3e5bfe5c108041978d6f6cbf9e1f2b27 [id=4cdb97efe37d47d4ba1b4b3d941390ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.422398 11347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84649414f2874c8fac5066acc9f54e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.422591 11345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188c06c728f74f5eb60406f387f2df82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.423099 13209 leader_election.cc:290] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.423065 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 83c69194c062411db10113b63f6be92c (DEFAULT_TABLE table=default.Table_eb0cc83e98e14a84b8ca8fcb5011b6c4 [id=19fb0a39f8044cf4841c83d1ebbf7e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.423381 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c69194c062411db10113b63f6be92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.423735 11367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a37a6deaeb24c99824b62fbb2d603b1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.424350 11177 leader_election.cc:343] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.426172 11341 tablet_service.cc:1511] Processing CreateTablet for tablet 305b9ec841ca41ee98fee6503a5207f7 (DEFAULT_TABLE table=default.Table_a5de1a12493e459a962b2fd1dadda16e [id=e4c27ba0cc274088987ca9d880a6a88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.426515 11341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b9ec841ca41ee98fee6503a5207f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.429705 11352 tablet_service.cc:1511] Processing CreateTablet for tablet 7977c81925034298ae3ed0568ff688c1 (DEFAULT_TABLE table=default.Table_28d5478034e044e8b29c2fed007c3dc8 [id=6b9d4f8809c548118808cea95f9484db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.430037 11352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7977c81925034298ae3ed0568ff688c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.430101 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687ee40ebf87456a831b49f540ea8497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.433583 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 687ee40ebf87456a831b49f540ea8497 (DEFAULT_TABLE table=default.Table_1f4098d245d74165bbb7902a63b56907 [id=b204aed109ab4119958014aed11291db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.433908 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687ee40ebf87456a831b49f540ea8497. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:14.437067 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f818ae2139047f28958cefaa26ade65 consensus state has no leader
I20260925 01:50:14.437275 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc41da6d8be47818cc2f68cd2558c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.441357 13458 raft_consensus.cc:493] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.441479 13458 raft_consensus.cc:515] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.442044 13458 leader_election.cc:290] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:14.442627 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 995) took 2388 ms. Trace:
I20260925 01:50:14.442744 13356 rpcz_store.cc:276] 0925 01:50:12.053937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.054473 (+ 536us) service_pool.cc:224] Handling call
0925 01:50:14.293360 (+2238887us) ts_tablet_manager.cc:1151] Deleting tablet 29f28e49791744428729279a79b6c9f1
0925 01:50:14.293375 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.364498 (+ 71123us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.367401 (+ 2903us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.442580 (+ 75179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57274,"tablet-delete.queue_time_us":2234506}
I20260925 01:50:14.443200 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 991) took 2543 ms. Trace:
I20260925 01:50:14.443288 13356 rpcz_store.cc:276] 0925 01:50:11.899853 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.064798 (+164945us) service_pool.cc:224] Handling call
0925 01:50:14.443036 (+2378238us) ts_tablet_manager.cc:1151] Deleting tablet b81a0f0e096f4bdaaedb2122c3487079
0925 01:50:14.443051 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.443156 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2353105}
I20260925 01:50:14.443640 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 997) took 2351 ms. Trace:
I20260925 01:50:14.443740 13356 rpcz_store.cc:276] 0925 01:50:12.092492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.092583 (+ 91us) service_pool.cc:224] Handling call
0925 01:50:14.443492 (+2350909us) ts_tablet_manager.cc:1151] Deleting tablet 6091ed7d816a46958a6de343fe682292
0925 01:50:14.443502 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.443596 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2350661}
I20260925 01:50:14.444075 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 998) took 1887 ms. Trace:
I20260925 01:50:14.444168 13356 rpcz_store.cc:276] 0925 01:50:12.556486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.558950 (+ 2464us) service_pool.cc:224] Handling call
0925 01:50:14.443943 (+1884993us) ts_tablet_manager.cc:1151] Deleting tablet 1cd17f1ecead409ab7b54c2120476a3b
0925 01:50:14.443954 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.444034 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1749804}
W20260925 01:50:14.444244 11314 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:14.444491 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1003) took 1864 ms. Trace:
I20260925 01:50:14.444638 13356 rpcz_store.cc:276] 0925 01:50:12.580213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.587180 (+ 6967us) service_pool.cc:224] Handling call
0925 01:50:14.444373 (+1857193us) ts_tablet_manager.cc:1151] Deleting tablet d28dc51fc345487ba74c56b9b8f1ad42
0925 01:50:14.444382 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.444456 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1740837}
I20260925 01:50:14.444903 13356 tablet_replica.cc:333] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:14.445114 13356 raft_consensus.cc:2243] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:14.445376 13356 pending_rounds.cc:70] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:14.445436 13356 pending_rounds.cc:77] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072946010140672 op_type: NO_OP noop_request { }
I20260925 01:50:14.445554 13356 raft_consensus.cc:2889] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:14.450734 11211 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.451323 11212 tablet_service.cc:1511] Processing CreateTablet for tablet 819be577c39145ff9faf33d90f10e21f (DEFAULT_TABLE table=default.Table_7b39199d7fc14264aa8010c7000a80fe [id=558ac5672a3e4790b7a7b24752b044e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.451521 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_c4b146df79f340bf9b1dc7663cdbbcaf [id=f8317c3550b14fe3abf468ea0d755b88]) successfully deleted
I20260925 01:50:14.451737 11212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819be577c39145ff9faf33d90f10e21f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:14.451814 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet b81a0f0e096f4bdaaedb2122c3487079 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b81a0f0e096f4bdaaedb2122c3487079 already in progress: creating tablet
W20260925 01:50:14.452033 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 6091ed7d816a46958a6de343fe682292 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6091ed7d816a46958a6de343fe682292 already in progress: creating tablet
W20260925 01:50:14.452292 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 1cd17f1ecead409ab7b54c2120476a3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd17f1ecead409ab7b54c2120476a3b already in progress: creating tablet
W20260925 01:50:14.452497 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d28dc51fc345487ba74c56b9b8f1ad42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d28dc51fc345487ba74c56b9b8f1ad42 already in progress: creating tablet
I20260925 01:50:14.454185 13209 raft_consensus.cc:493] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 01:50:14.269287 11457 leader_election.cc:343] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.454344 13209 raft_consensus.cc:515] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:14.454509 11457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 185203us
W20260925 01:50:14.454780 11457 leader_election.cc:343] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.454967 13209 leader_election.cc:290] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.455623 11367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728157ec17ed4df5a4a8559df6c1ac78" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.456208 11177 leader_election.cc:343] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.458581 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_02d89a08fe85499db7ac1e181e841745"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.459383 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02d89a08fe85499db7ac1e181e841745 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.461421 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfd4164dd544549b2263804e028efea (DEFAULT_TABLE table=default.Table_117c3527619d4f8091a562c31100c670 [id=64cd75ce2f5f46e2bfdf8dc3069f4f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.461848 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfd4164dd544549b2263804e028efea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.463476 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c0235a98cfd84c9280854f416f571e0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.464066 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0235a98cfd84c9280854f416f571e0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.468585 13209 raft_consensus.cc:493] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.468756 13209 raft_consensus.cc:515] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.469385 13209 leader_election.cc:290] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.470017 11367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f1e725fe84552943563aa95687842" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.470628 11177 leader_election.cc:343] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.474375 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1f97bbad6b7348caaed4d745343b811c
I20260925 01:50:14.477782 11680 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 341dca6f396449daadcaf8bbb77ed04b (table default.Table_500b95f7b4bf49b7bc5fb405085bcc85 [id=fffcb55426084429ade6e3c4daa22722]). Expected version 2 got 0
I20260925 01:50:14.480561 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_1047bf49907148c081b8098ab2ded503"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.481555 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1047bf49907148c081b8098ab2ded503 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.445677 13356 raft_consensus.cc:2272] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.482956 13356 ts_tablet_manager.cc:1916] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.490108 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b92054aaa704c7ebd6b075c30db2616" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.490337 11522 raft_consensus.cc:2468] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:14.491171 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfd4164dd544549b2263804e028efea (DEFAULT_TABLE table=default.Table_117c3527619d4f8091a562c31100c670 [id=64cd75ce2f5f46e2bfdf8dc3069f4f9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.491590 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfd4164dd544549b2263804e028efea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.492364 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f97bbad6b7348caaed4d745343b811c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.492575 11214 tablet_service.cc:1558] Processing DeleteTablet for tablet 33967e5e11524b78bb86ce7a3e2e16ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.492736 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 7347b31f782c4508b004c7523dc11dbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.492930 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e28aeabdf724784b8ed27535ea0701b with delete_type TABLET_DATA_DELETED (replaced by tablet dceeedf3471d45508f025e7a4c7f73f2) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.492858 11753 tablet_bootstrap.cc:492] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:14.493086 11753 ts_tablet_manager.cc:1403] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.688s user 0.015s sys 0.001s
I20260925 01:50:14.493094 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet bd594870fa6a4ba190a18a48d821d72c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:14.493562 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 6532e1b338554cfa87084e4be84584df (DEFAULT_TABLE table=default.Table_02ce0d6160ed4598b09804acbfe785a1 [id=e67527f649b1465b93e8f7a743dcacbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.493670 11753 raft_consensus.cc:359] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.493809 11753 raft_consensus.cc:385] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.493850 11753 raft_consensus.cc:740] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.493903 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6532e1b338554cfa87084e4be84584df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:14.495074 11456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.002s sys 0.011s
W20260925 01:50:14.495232 11456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s user 0.002s sys 0.011s
W20260925 01:50:14.495498 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 575177us
I20260925 01:50:14.496263 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9663d7f4008e4ee0a3ba4373258242eb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:14.497881 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3702f09e45a14c80af716d642d30cdfa" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:14.498669 11342 tablet_service.cc:1511] Processing CreateTablet for tablet f093df623d384a41b466758e99284f3e (DEFAULT_TABLE table=default.Table_83cb911831d14ec1a87189952a773203 [id=6d2a03b0b54f40aebaac877c5a1b7ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.499028 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f093df623d384a41b466758e99284f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.502334 11349 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:14.502740 11349 tablet_service.cc:1511] Processing CreateTablet for tablet 819be577c39145ff9faf33d90f10e21f (DEFAULT_TABLE table=default.Table_7b39199d7fc14264aa8010c7000a80fe [id=558ac5672a3e4790b7a7b24752b044e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.503165 11349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819be577c39145ff9faf33d90f10e21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.507551 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0749a0ae58df4ff8b74a86f072332fad" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.512825 11343 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f97bbad6b7348caaed4d745343b811c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:14.519308 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a37a6deaeb24c99824b62fbb2d603b1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.519548 11522 raft_consensus.cc:2468] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:14.523572 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 3d867e7f58554c1196e837346b0b37d3
I20260925 01:50:14.525367 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 6f2f5603ea23446c9db47fd78d0c7854
I20260925 01:50:14.526113 11674 master_service.cc:960] ReplaceTablet: received request to replace tablet 0258eac5971842878c62326952115490 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:14.526468 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 2a65e06aba3640e2b42d05fb325c6171
I20260925 01:50:14.529028 13612 tablet.cc:1751] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:14.532086 11672 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet b948d000f8314491b02244bdce37ba33
I20260925 01:50:14.532542 11672 catalog_manager.cc:6934] ReplaceTablet: tablet b948d000f8314491b02244bdce37ba33 deleted and replaced by tablet 1dcb755b54004ffdbd9aac6594b4d26f
I20260925 01:50:14.541570 13452 raft_consensus.cc:2749] T e6b97d37704f4a0d88457d124bb4f259 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.545369 11356 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d867e7f58554c1196e837346b0b37d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:14.547287 13452 raft_consensus.cc:493] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.547416 13452 raft_consensus.cc:515] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.548003 13452 leader_election.cc:290] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:14.548303 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728157ec17ed4df5a4a8559df6c1ac78" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.548494 11522 raft_consensus.cc:2468] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:14.548949 11314 leader_election.cc:343] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 15376374d9f2401fb9bb83d2f0acf7b3
I20260925 01:50:14.549183 11347 tablet_service.cc:1558] Processing DeleteTablet for tablet b948d000f8314491b02244bdce37ba33 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dcb755b54004ffdbd9aac6594b4d26f) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:14.549328 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f1e725fe84552943563aa95687842" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.549474 11519 raft_consensus.cc:2468] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:14.550300 11357 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a65e06aba3640e2b42d05fb325c6171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:14.550521 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2f5603ea23446c9db47fd78d0c7854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:14.553160 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75014fc54fc7481f83da07e1d96c4370" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:14.573596 13356 ts_tablet_manager.cc:1929] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:14.573827 13356 log.cc:1199] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/9771b89303094974902c4ad1f1c8608e
I20260925 01:50:14.574409 13356 ts_tablet_manager.cc:1950] T 9771b89303094974902c4ad1f1c8608e P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:14.577576 11755 tablet_bootstrap.cc:492] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:14.577862 11755 ts_tablet_manager.cc:1403] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.290s user 0.011s sys 0.035s
I20260925 01:50:14.578714 11755 raft_consensus.cc:359] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.578976 11755 raft_consensus.cc:385] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.579088 11755 raft_consensus.cc:740] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.579437 11755 consensus_queue.cc:260] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.582540 11755 ts_tablet_manager.cc:1434] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260925 01:50:14.586372 11755 tablet_bootstrap.cc:492] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:50:14.589327 11177 consensus_peers.cc:597] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:14.574162 11753 consensus_queue.cc:260] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.595000 11753 ts_tablet_manager.cc:1434] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.102s user 0.002s sys 0.000s
I20260925 01:50:14.595439 11753 tablet_bootstrap.cc:492] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:14.597505 11753 tablet_bootstrap.cc:654] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.606722 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 4c420ce9a8b1472ca0b8d524a27de87f (DEFAULT_TABLE table=default.Table_b06bd286d49842a79c6e999d9a4a3cf2 [id=3013ec95478e41bf8e2e49a6c1238cf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.607414 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c420ce9a8b1472ca0b8d524a27de87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.623234 13611 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:50:14.623490 13611 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:50:14.624559 13611 leader_election.cc:290] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:50:14.625641 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1433 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:50:14.627118 12396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1433 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:50:14.627840 12952 leader_election.cc:304] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:50:14.628362 13611 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 01:50:14.629562 11176 leader_election.cc:304] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:14.645457 11755 tablet_bootstrap.cc:654] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:14.647482 11314 leader_election.cc:343] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 04f412cbebe04a629070aecf2753287c
I20260925 01:50:14.647624 11314 leader_election.cc:304] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.647858 13458 raft_consensus.cc:2749] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:14.648139 11314 leader_election.cc:343] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: a07f37b8469a497ba3fe504cb21105d2
I20260925 01:50:14.648231 11314 leader_election.cc:304] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.648438 13576 raft_consensus.cc:2749] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:14.648680 11314 leader_election.cc:343] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: d253f8b1e4ac41388a885178f2ed0f40
I20260925 01:50:14.648820 11314 leader_election.cc:304] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.651733 13612 tablet.cc:1751] T 9feb00f881ed4518a32e08d170080a46 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:14.653254 13458 raft_consensus.cc:2749] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:14.653344 11314 leader_election.cc:343] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:14.653496 11314 leader_election.cc:304] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.653739 13458 raft_consensus.cc:2749] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 01:50:14.654014 11314 leader_election.cc:343] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 15376374d9f2401fb9bb83d2f0acf7b3
I20260925 01:50:14.654160 11314 leader_election.cc:304] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.654417 13321 raft_consensus.cc:2749] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.661696 13452 raft_consensus.cc:493] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.661844 13452 raft_consensus.cc:515] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.662289 11755 tablet_bootstrap.cc:492] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:14.662456 11755 ts_tablet_manager.cc:1403] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.004s
I20260925 01:50:14.662657 13452 leader_election.cc:290] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:14.663115 11755 raft_consensus.cc:359] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.663336 11755 raft_consensus.cc:385] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.663435 11755 raft_consensus.cc:740] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.663645 11755 consensus_queue.cc:260] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.664167 11755 ts_tablet_manager.cc:1434] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260925 01:50:14.664628 11314 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:14.670861 13525 raft_consensus.cc:493] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.671022 13525 raft_consensus.cc:515] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.671576 13525 leader_election.cc:290] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.678323 13420 raft_consensus.cc:493] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.678520 13420 raft_consensus.cc:515] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.679163 13420 leader_election.cc:290] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.679451 13209 raft_consensus.cc:2804] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:14.679598 13209 raft_consensus.cc:493] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:14.679711 13209 raft_consensus.cc:3060] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:14.684242 11176 consensus_peers.cc:597] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5048a0fca2e64ffa9f19000f48a4c090. This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:14.688814 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 54278.4us
W20260925 01:50:14.689158 11176 leader_election.cc:343] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 4f19bccf3c5540cb828ec7bfc89a1c17
I20260925 01:50:14.689312 11176 leader_election.cc:304] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:14.692613 13420 raft_consensus.cc:2749] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.693591 13209 raft_consensus.cc:515] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.698427 11755 tablet_bootstrap.cc:492] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:14.700276 11755 tablet_bootstrap.cc:654] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.701311 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b6bde824d74acfaaffc23a0b05db8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:14.707545 11177 leader_election.cc:343] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.702162 13209 leader_election.cc:290] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.715237 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33967e5e11524b78bb86ce7a3e2e16ad" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.718945 11177 leader_election.cc:343] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.726577 11755 tablet_bootstrap.cc:492] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:14.726740 11755 ts_tablet_manager.cc:1403] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.001s
I20260925 01:50:14.726709 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 906885205de348d488b8e84f9b7244bd (DEFAULT_TABLE table=default.Table_8c48bf855090436ba60e5d1c81c2370f [id=d246cf2a93774bfcb1d91e62818046a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.727209 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906885205de348d488b8e84f9b7244bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.727505 11755 raft_consensus.cc:359] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.727686 11755 raft_consensus.cc:385] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.727743 11755 raft_consensus.cc:740] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.727964 11755 consensus_queue.cc:260] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.728493 11755 ts_tablet_manager.cc:1434] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260925 01:50:14.729494 11667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.253:42889, user_credentials={real_user=slave}} blocked reactor thread for 108257us
I20260925 01:50:14.730999 11755 tablet_bootstrap.cc:492] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:14.732895 11755 tablet_bootstrap.cc:654] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.734984 11754 tablet_bootstrap.cc:492] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:14.735152 11754 ts_tablet_manager.cc:1403] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.336s user 0.007s sys 0.051s
I20260925 01:50:14.735922 11754 raft_consensus.cc:359] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.736107 11754 raft_consensus.cc:385] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.736171 11754 raft_consensus.cc:740] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.736384 11754 consensus_queue.cc:260] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.736904 11754 ts_tablet_manager.cc:1434] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:14.739264 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1007) took 2148 ms. Trace:
I20260925 01:50:14.739385 13356 rpcz_store.cc:276] 0925 01:50:12.590615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.594319 (+ 3704us) service_pool.cc:224] Handling call
0925 01:50:14.444838 (+1850519us) ts_tablet_manager.cc:1151] Deleting tablet 9771b89303094974902c4ad1f1c8608e
0925 01:50:14.444846 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.515347 (+ 70501us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.573491 (+ 58144us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.739200 (+165709us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1741179}
I20260925 01:50:14.739913 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1009) took 2137 ms. Trace:
W20260925 01:50:14.739984 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 62171.1us
I20260925 01:50:14.739995 13356 rpcz_store.cc:276] 0925 01:50:12.602282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.602339 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:14.739765 (+2137426us) ts_tablet_manager.cc:1151] Deleting tablet e1480131c1e74536b5f3fa54764dc4f3
0925 01:50:14.739779 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.739900 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2035974}
I20260925 01:50:14.740370 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1011) took 2115 ms. Trace:
I20260925 01:50:14.740464 13356 rpcz_store.cc:276] 0925 01:50:12.624506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.624573 (+ 67us) service_pool.cc:224] Handling call
0925 01:50:14.740231 (+2115658us) ts_tablet_manager.cc:1151] Deleting tablet fdc26312580742a8a01b897e551a3a3d
0925 01:50:14.740244 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.740349 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2036329}
I20260925 01:50:14.741648 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1006) took 2151 ms. Trace:
I20260925 01:50:14.741744 13356 rpcz_store.cc:276] 0925 01:50:12.590513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.594162 (+ 3649us) service_pool.cc:224] Handling call
0925 01:50:14.741257 (+2147095us) ts_tablet_manager.cc:1151] Deleting tablet a8d3b4ec14d5457eb0d0d364904e755d
0925 01:50:14.741546 (+ 289us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.741630 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2035069}
I20260925 01:50:14.742203 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1019) took 2012 ms. Trace:
I20260925 01:50:14.742297 13356 rpcz_store.cc:276] 0925 01:50:12.729689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.729752 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:14.742016 (+2012264us) ts_tablet_manager.cc:1151] Deleting tablet 03487a3fa9574fd583d9c95d0624203c
0925 01:50:14.742029 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.742182 (+ 153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2012065}
I20260925 01:50:14.742589 13356 tablet_replica.cc:333] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:14.742828 13356 raft_consensus.cc:2243] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:14.743001 13356 raft_consensus.cc:2272] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.744060 13356 ts_tablet_manager.cc:1916] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.750913 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 329a5af9fb654d4c894e1cf4fd636c13 (table default.Table_0edb84dafd8f46f6856de68ddb449886 [id=ea287d157483442c87bc629e0b7df82f]) successfully deleted
I20260925 01:50:14.751216 13586 raft_consensus.cc:493] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.751432 13586 raft_consensus.cc:515] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.752143 13586 leader_election.cc:290] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.755103 13209 raft_consensus.cc:493] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.755255 13209 raft_consensus.cc:515] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.756819 13209 leader_election.cc:290] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.757134 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40083a885974e3595ec2fb5b16d4a5d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.757706 11177 leader_election.cc:343] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.769088 13209 raft_consensus.cc:493] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.769270 13209 raft_consensus.cc:515] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.780242 13209 leader_election.cc:290] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.780485 11754 tablet_bootstrap.cc:492] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:14.781240 11488 tablet_service.cc:1511] Processing CreateTablet for tablet c64209f204b7439fb98f0e21221fd7b2 (DEFAULT_TABLE table=default.Table_ecbfb77555fc49d1a642966c2a8093bc [id=e4a1230d7f2e417e8065b1d892248f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.781713 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64209f204b7439fb98f0e21221fd7b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.783506 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113d7ccee4e349e19d3948e09d2c533d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.794759 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb8766ae7554a40bcd7cda284f869f6 (DEFAULT_TABLE table=default.Table_2a085030ab794dc8b1c4c57165ac244b [id=e4511a32722940018a905308ece85f34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.794963 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 5a20f47a17954e56b07814830a478263 (DEFAULT_TABLE table=default.Table_656244678e8846349b09949a289a987b [id=1b624ed2e41e45e1ac44a9fa8cce99b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.795207 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb8766ae7554a40bcd7cda284f869f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.795431 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a20f47a17954e56b07814830a478263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.795720 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 90371eaf696043ae973b8caa387398cf (DEFAULT_TABLE table=default.Table_3971153031a6480ca07158be22e8b9db [id=1b290f05277b4a15893c10128594259e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.796077 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90371eaf696043ae973b8caa387398cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.802441 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 456833aeb015498e93079e934381da51 (DEFAULT_TABLE table=default.Table_c87a25d7403a414e8fe5bad44e1cf16c [id=f005313328b346f68f4dd9e999b38fbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.803009 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 456833aeb015498e93079e934381da51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.808725 13356 ts_tablet_manager.cc:1929] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:14.808959 13356 log.cc:1199] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/b4e5d28d466741a0a085a4f9938fffd1
I20260925 01:50:14.809403 13356 ts_tablet_manager.cc:1950] T b4e5d28d466741a0a085a4f9938fffd1 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:14.810712 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc152df745b46fb84aec1c9fa017ba5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.812534 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23dc2ece3d624baa8d5d45ec6b67c6f6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.813287 11457 consensus_peers.cc:597] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260925 01:50:14.815460 11457 leader_election.cc:343] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:14.816586 11457 leader_election.cc:343] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.818154 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 188c06c728f74f5eb60406f387f2df82 (DEFAULT_TABLE table=default.Table_3e5bfe5c108041978d6f6cbf9e1f2b27 [id=4cdb97efe37d47d4ba1b4b3d941390ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.818342 11485 tablet_service.cc:1511] Processing CreateTablet for tablet 265e893faeed4e8c84071035e105c935 (DEFAULT_TABLE table=default.Table_52e6c161d59b404ca75a22cc9f043b7f [id=c4ddbbf8b0f14cc692df112dbed98ce4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.818684 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188c06c728f74f5eb60406f387f2df82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.821882 11485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265e893faeed4e8c84071035e105c935. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.822746 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 305b9ec841ca41ee98fee6503a5207f7 (DEFAULT_TABLE table=default.Table_a5de1a12493e459a962b2fd1dadda16e [id=e4c27ba0cc274088987ca9d880a6a88f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.823199 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305b9ec841ca41ee98fee6503a5207f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.826438 11495 tablet_service.cc:1511] Processing CreateTablet for tablet d77dac40ea344d78829e7a59b7f6dec4 (DEFAULT_TABLE table=default.Table_99845f420c274423ac97431b16de7342 [id=ec0d4226fdaf434da3e0c2edabda8310]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.826799 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77dac40ea344d78829e7a59b7f6dec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.830379 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 912663c9513847748864b8c2064714b6 (DEFAULT_TABLE table=default.Table_d3b5e1eb785749939261859f4fb504a9 [id=fa9b155147cd48e2b56817bdceeb357d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.830715 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 912663c9513847748864b8c2064714b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.833078 13452 raft_consensus.cc:493] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.833241 13452 raft_consensus.cc:515] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.833977 13452 leader_election.cc:290] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:14.837661 13452 raft_consensus.cc:493] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.837796 13452 raft_consensus.cc:515] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.838366 13452 leader_election.cc:290] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:14.838886 11498 tablet_service.cc:1511] Processing CreateTablet for tablet 0feae471bcea4ddb8bc61cd1f9b6fedc (DEFAULT_TABLE table=default.Table_3b0c24ce448a44b5a1f5576908672b20 [id=31dc1a4ebbbc493496cd7baf940b89d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.839288 11498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0feae471bcea4ddb8bc61cd1f9b6fedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.840983 13452 raft_consensus.cc:493] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.841161 13452 raft_consensus.cc:515] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.841802 13452 leader_election.cc:290] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:14.845546 11501 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb474285590475684f892259e3e9202 (DEFAULT_TABLE table=default.Table_e11534843fc644449b4f55ebcbcbaf39 [id=f09517d086984a89b2970c17a59387f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.845988 11946 ts_tablet_manager.cc:1929] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:14.845988 11501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb474285590475684f892259e3e9202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.846191 11946 log.cc:1199] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/0749a0ae58df4ff8b74a86f072332fad
I20260925 01:50:14.846526 11946 ts_tablet_manager.cc:1950] T 0749a0ae58df4ff8b74a86f072332fad P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:14.847333 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 970) took 2755 ms. Trace:
I20260925 01:50:14.847462 11946 rpcz_store.cc:276] 0925 01:50:12.091715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.091764 (+ 49us) service_pool.cc:224] Handling call
0925 01:50:14.173887 (+2082123us) ts_tablet_manager.cc:1151] Deleting tablet 0749a0ae58df4ff8b74a86f072332fad
0925 01:50:14.173895 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.571772 (+397877us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.845935 (+274163us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.847311 (+ 1376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2081953}
I20260925 01:50:14.856174 11953 ts_tablet_manager.cc:1929] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:14.856375 11953 log.cc:1199] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/770ebdbd355142ba86fd9eb8eaa844f4
I20260925 01:50:14.856870 11953 ts_tablet_manager.cc:1950] T 770ebdbd355142ba86fd9eb8eaa844f4 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:14.864472 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a3b1ed8c6faa4759b7d68e4bf1c60e90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.784415 11177 leader_election.cc:343] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.873176 11236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:14.874046 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3b1ed8c6faa4759b7d68e4bf1c60e90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.877743 11676 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4ce55b42ce4e4e239d303411e27c68dd" } new_table_name: "default.Table_d18eeb5db182469f863ea7a60d1abc7b" modify_external_catalogs: true
I20260925 01:50:14.879077 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_5b7699461f464ddaa5c53e91987897d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:14.879191 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_63fed474bfa9411dacb25f0b59128617" } new_table_name: "default.Table_f57f1f8c2e2c44758e48fec681055857" modify_external_catalogs: true
W20260925 01:50:14.879709 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b7699461f464ddaa5c53e91987897d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.879763 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_14ac769c63984e88b1fb5a08c19d5d39" } new_table_name: "default.Table_6a2502f7f78c4f05840c9202928f9c85" modify_external_catalogs: true
I20260925 01:50:14.881052 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_02b8ee20c5a444adb0a04e5d84832388"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:14.882331 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_5db64fc4070a45f0adc4c8234951e1bf" } new_table_name: "default.Table_de000ba4ea5a41d4a139b9c75e308212" modify_external_catalogs: true
I20260925 01:50:14.882717 11239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23dc2ece3d624baa8d5d45ec6b67c6f6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:14.883163 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]). Expected version 2 got 0
I20260925 01:50:14.883502 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc152df745b46fb84aec1c9fa017ba5" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:14.870204 11177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.194:35027, user_credentials={real_user=slave}} blocked reactor thread for 85807.6us
I20260925 01:50:14.885842 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1022) took 2051 ms. Trace:
I20260925 01:50:14.885924 13356 rpcz_store.cc:276] 0925 01:50:12.834896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.834951 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:14.742533 (+1907582us) ts_tablet_manager.cc:1151] Deleting tablet b4e5d28d466741a0a085a4f9938fffd1
0925 01:50:14.742545 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.752294 (+ 9749us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.808657 (+ 56363us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.885822 (+ 77165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40,"tablet-delete.queue_time_us":1903554}
I20260925 01:50:14.886291 13356 tablet_replica.cc:333] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:14.886497 13356 raft_consensus.cc:2243] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:14.886632 13356 raft_consensus.cc:2272] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.886523 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_9eb8e584d86641148b7287cd8bf0ccdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:14.887107 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eb8e584d86641148b7287cd8bf0ccdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.887235 13356 ts_tablet_manager.cc:1916] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.889359 13615 tablet.cc:1751] T 9feb00f881ed4518a32e08d170080a46 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:14.857566 11499 tablet_service.cc:1511] Processing CreateTablet for tablet 83c69194c062411db10113b63f6be92c (DEFAULT_TABLE table=default.Table_eb0cc83e98e14a84b8ca8fcb5011b6c4 [id=19fb0a39f8044cf4841c83d1ebbf7e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.892053 11499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c69194c062411db10113b63f6be92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.892053 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:14.857841 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 0f61d60575694922936ae6e111f3257d (DEFAULT_TABLE table=default.Table_64d02d043b714fe1849b322e84285581 [id=c9e15f23990a4722b6a7614e015e134b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.897002 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f61d60575694922936ae6e111f3257d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.897208 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_dac2652a538c4e93a7587d1b9d268fdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:14.897652 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fd4295340ebf4ad28e0eb3568a272fcd" } modify_external_catalogs: true
W20260925 01:50:14.897799 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dac2652a538c4e93a7587d1b9d268fdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.897830 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_fd4295340ebf4ad28e0eb3568a272fcd" } modify_external_catalogs: true
W20260925 01:50:14.898008 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02b8ee20c5a444adb0a04e5d84832388 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.857883 11500 tablet_service.cc:1511] Processing CreateTablet for tablet 7977c81925034298ae3ed0568ff688c1 (DEFAULT_TABLE table=default.Table_28d5478034e044e8b29c2fed007c3dc8 [id=6b9d4f8809c548118808cea95f9484db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.902655 11500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7977c81925034298ae3ed0568ff688c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:14.903877 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80cd9735bf634871b7157443d0cfac37 consensus state has no leader
W20260925 01:50:14.904127 11676 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47e533afa7f147339393cc952bc1a16a consensus state has no leader
I20260925 01:50:14.904390 11676 master_service.cc:960] ReplaceTablet: received request to replace tablet 43298d3575c34e6090b8f0767ec6918e from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:14.904311 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_d10a845bf44e48a091bfd078a1a436d7" } new_table_name: "default.Table_aa03f8da712d43a9b1605c6fbc896171" modify_external_catalogs: true
I20260925 01:50:14.857566 11486 tablet_service.cc:1511] Processing CreateTablet for tablet 84649414f2874c8fac5066acc9f54e85 (DEFAULT_TABLE table=default.Table_e446bd8217484efab9bc956d45907276 [id=0b280dd904324f4bab9034c74d0eda12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.858451 11502 tablet_service.cc:1511] Processing CreateTablet for tablet 687ee40ebf87456a831b49f540ea8497 (DEFAULT_TABLE table=default.Table_1f4098d245d74165bbb7902a63b56907 [id=b204aed109ab4119958014aed11291db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.906384 11486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84649414f2874c8fac5066acc9f54e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.858959 11494 tablet_service.cc:1511] Processing CreateTablet for tablet 6532e1b338554cfa87084e4be84584df (DEFAULT_TABLE table=default.Table_02ce0d6160ed4598b09804acbfe785a1 [id=e67527f649b1465b93e8f7a743dcacbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.859273 11491 tablet_service.cc:1511] Processing CreateTablet for tablet f093df623d384a41b466758e99284f3e (DEFAULT_TABLE table=default.Table_83cb911831d14ec1a87189952a773203 [id=6d2a03b0b54f40aebaac877c5a1b7ad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.906764 11502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687ee40ebf87456a831b49f540ea8497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.906965 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f093df623d384a41b466758e99284f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.859338 11493 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfd4164dd544549b2263804e028efea (DEFAULT_TABLE table=default.Table_117c3527619d4f8091a562c31100c670 [id=64cd75ce2f5f46e2bfdf8dc3069f4f9f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:14.907037 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf01b7f0ae6044988f543e1c4a50849d consensus state has no leader
I20260925 01:50:14.907387 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_be5cbec8322f47fda428924e891c53cc" } modify_external_catalogs: true
I20260925 01:50:14.907590 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_be5cbec8322f47fda428924e891c53cc" } modify_external_catalogs: true
I20260925 01:50:14.909430 11493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfd4164dd544549b2263804e028efea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.859436 11492 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:14.910298 11494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6532e1b338554cfa87084e4be84584df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.859835 11484 tablet_service.cc:1511] Processing CreateTablet for tablet 819be577c39145ff9faf33d90f10e21f (DEFAULT_TABLE table=default.Table_7b39199d7fc14264aa8010c7000a80fe [id=558ac5672a3e4790b7a7b24752b044e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.911760 11484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819be577c39145ff9faf33d90f10e21f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:14.917378 13209 raft_consensus.cc:493] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.917527 13209 raft_consensus.cc:515] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.918239 13209 leader_election.cc:290] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.921141 11678 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_139172e2d0ec420c8c2484e90f7a160b" } modify_external_catalogs: true
I20260925 01:50:14.921372 11678 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_139172e2d0ec420c8c2484e90f7a160b" } modify_external_catalogs: true
I20260925 01:50:14.920674 11675 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_024ab99d505f4f6eaed9ebd195ac0ffd" } modify_external_catalogs: true
I20260925 01:50:14.923329 11675 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_024ab99d505f4f6eaed9ebd195ac0ffd" } modify_external_catalogs: true
I20260925 01:50:14.929781 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 971) took 2831 ms. Trace:
I20260925 01:50:14.929980 11946 rpcz_store.cc:276] 0925 01:50:12.098376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.098432 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:14.891834 (+2793402us) ts_tablet_manager.cc:1151] Deleting tablet 6091ed7d816a46958a6de343fe682292
0925 01:50:14.929667 (+ 37833us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.929764 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2793204}
I20260925 01:50:14.930577 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 972) took 2373 ms. Trace:
I20260925 01:50:14.930745 11946 rpcz_store.cc:276] 0925 01:50:12.556681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.556744 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:14.930455 (+2373711us) ts_tablet_manager.cc:1151] Deleting tablet 1cd17f1ecead409ab7b54c2120476a3b
0925 01:50:14.930466 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.930561 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2373475}
I20260925 01:50:14.864549 11755 tablet_bootstrap.cc:492] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:14.938261 11755 ts_tablet_manager.cc:1403] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.207s user 0.019s sys 0.014s
I20260925 01:50:14.938970 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 719) took 9276 ms. Trace:
I20260925 01:50:14.939047 11755 raft_consensus.cc:359] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.939234 11755 raft_consensus.cc:385] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.939283 11755 raft_consensus.cc:740] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.886106 11378 raft_consensus.cc:3060] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:14.939500 11755 consensus_queue.cc:260] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.939980 11755 ts_tablet_manager.cc:1434] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:14.940253 11755 tablet_bootstrap.cc:492] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:14.886824 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 15376374d9f2401fb9bb83d2f0acf7b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:50 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:14.918915 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e28aeabdf724784b8ed27535ea0701b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:14.945011 11177 leader_election.cc:343] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.945114 11755 tablet_bootstrap.cc:654] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.945840 11176 leader_election.cc:304] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:14.946245 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 256509us
W20260925 01:50:14.951042 11456 leader_election.cc:343] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.951191 11456 leader_election.cc:304] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.951475 13586 raft_consensus.cc:2749] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.951120 13209 raft_consensus.cc:2804] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:14.951603 13209 raft_consensus.cc:493] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:14.951691 13209 raft_consensus.cc:3060] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:14.951696 11456 leader_election.cc:343] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.951972 11456 leader_election.cc:304] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.952220 13586 raft_consensus.cc:2749] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:14.952701 11456 leader_election.cc:343] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.952805 11456 leader_election.cc:304] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.953027 13586 raft_consensus.cc:2749] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.954360 11176 leader_election.cc:304] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:14.939056 11953 rpcz_store.cc:276] 0925 01:50:05.662722 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.662850 (+ 128us) service_pool.cc:224] Handling call
0925 01:50:14.258197 (+8595347us) ts_tablet_manager.cc:1151] Deleting tablet 770ebdbd355142ba86fd9eb8eaa844f4
0925 01:50:14.258205 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.793334 (+535129us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.856092 (+ 62758us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:14.938946 (+ 82854us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8595142}
I20260925 01:50:14.956583 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 722) took 9271 ms. Trace:
I20260925 01:50:14.957414 11953 rpcz_store.cc:276] 0925 01:50:05.684781 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.686895 (+ 2114us) service_pool.cc:224] Handling call
0925 01:50:14.956449 (+9269554us) ts_tablet_manager.cc:1151] Deleting tablet f1e89d9f87104c768839104c80614f5e
0925 01:50:14.956460 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.956564 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9269319}
I20260925 01:50:14.958250 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 770ebdbd355142ba86fd9eb8eaa844f4 (table default.Table_740c58ebe5d44423a2bc68ccede38272 [id=c7a072c4ed954c00a63e1e95a7806219]) successfully deleted
W20260925 01:50:14.958792 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f1e89d9f87104c768839104c80614f5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1e89d9f87104c768839104c80614f5e already in progress: creating tablet
I20260925 01:50:14.960904 11755 tablet_bootstrap.cc:492] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:14.961045 11755 ts_tablet_manager.cc:1403] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.005s
I20260925 01:50:14.961871 11755 raft_consensus.cc:359] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:14.962037 11755 raft_consensus.cc:385] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.962141 11755 raft_consensus.cc:740] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.962406 11755 consensus_queue.cc:260] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:14.962882 11755 ts_tablet_manager.cc:1434] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:14.966316 11953 tablet_replica.cc:333] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:14.966529 11953 raft_consensus.cc:2243] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:14.966679 11953 raft_consensus.cc:2272] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:14.967229 11953 ts_tablet_manager.cc:1916] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.970090 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 976) took 2351 ms. Trace:
I20260925 01:50:14.970260 11946 rpcz_store.cc:276] 0925 01:50:12.579579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.580023 (+ 444us) service_pool.cc:224] Handling call
0925 01:50:14.931065 (+2351042us) ts_tablet_manager.cc:1151] Deleting tablet d28dc51fc345487ba74c56b9b8f1ad42
0925 01:50:14.931075 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.931146 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2350865}
I20260925 01:50:14.970393 11755 tablet_bootstrap.cc:492] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
W20260925 01:50:14.929294 11314 leader_election.cc:343] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:14.970603 11314 leader_election.cc:304] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.970993 13452 raft_consensus.cc:2749] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:14.971058 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 979) took 2380 ms. Trace:
I20260925 01:50:14.971140 11946 rpcz_store.cc:276] 0925 01:50:12.590298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.590355 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:14.970904 (+2380549us) ts_tablet_manager.cc:1151] Deleting tablet a8d3b4ec14d5457eb0d0d364904e755d
0925 01:50:14.970919 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.971036 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2380316}
W20260925 01:50:14.971470 11314 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: d3150980bb72435886486156aa98d342
I20260925 01:50:14.971515 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 981) took 2368 ms. Trace:
I20260925 01:50:14.971653 11946 rpcz_store.cc:276] 0925 01:50:12.602633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.606178 (+ 3545us) service_pool.cc:224] Handling call
0925 01:50:14.971408 (+2365230us) ts_tablet_manager.cc:1151] Deleting tablet e1480131c1e74536b5f3fa54764dc4f3
0925 01:50:14.971419 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.971501 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2365050}
I20260925 01:50:14.971985 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 983) took 2347 ms. Trace:
I20260925 01:50:14.972111 11946 rpcz_store.cc:276] 0925 01:50:12.624505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.624979 (+ 474us) service_pool.cc:224] Handling call
0925 01:50:14.971894 (+2346915us) ts_tablet_manager.cc:1151] Deleting tablet fdc26312580742a8a01b897e551a3a3d
0925 01:50:14.971902 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.971972 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2346749}
I20260925 01:50:14.972231 11755 tablet_bootstrap.cc:654] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.972463 11946 tablet_replica.cc:333] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:14.972761 11946 raft_consensus.cc:2243] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:14.972842 11314 consensus_peers.cc:597] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29f28e49791744428729279a79b6c9f1. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:14.973071 11946 raft_consensus.cc:2272] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:14.973110 11314 leader_election.cc:343] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: d3150980bb72435886486156aa98d342
I20260925 01:50:14.973235 11314 leader_election.cc:304] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:14.973690 13420 raft_consensus.cc:2804] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:14.973794 13420 raft_consensus.cc:493] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:14.973872 13420 raft_consensus.cc:3060] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:14.974016 11946 ts_tablet_manager.cc:1916] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:14.976738 13420 raft_consensus.cc:515] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.977569 13420 leader_election.cc:290] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.961120 13209 raft_consensus.cc:515] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.978374 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4a51356880486a928181ee701f74d0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:14.978365 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c8099602485b40e2af198824f853c448" } modify_external_catalogs: true
I20260925 01:50:14.978593 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_c8099602485b40e2af198824f853c448" } modify_external_catalogs: true
I20260925 01:50:14.978885 13209 leader_election.cc:290] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:14.978991 11177 leader_election.cc:343] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.966147 13533 raft_consensus.cc:493] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.979161 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d5b337fd8b9e4144a43f8e4e2fdcd47f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:14.979228 13533 raft_consensus.cc:515] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.979586 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9513d1d55fe846f5b1a2b7d315209002" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:14.979803 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5b337fd8b9e4144a43f8e4e2fdcd47f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:14.979857 13533 leader_election.cc:290] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:14.980273 11177 leader_election.cc:343] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.980715 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:14.980666 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341dca6f396449daadcaf8bbb77ed04b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:14.981065 11677 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
W20260925 01:50:14.981297 11177 leader_election.cc:343] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:14.982554 11754 tablet_bootstrap.cc:654] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:14.862634 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d867e7f58554c1196e837346b0b37d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:14.863615 11753 tablet_bootstrap.cc:492] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:14.864029 13411 raft_consensus.cc:493] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:14.986843 11753 ts_tablet_manager.cc:1403] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.391s user 0.004s sys 0.000s
I20260925 01:50:14.987578 11753 raft_consensus.cc:359] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.987740 11753 raft_consensus.cc:385] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:14.987798 11753 raft_consensus.cc:740] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:14.988013 11753 consensus_queue.cc:260] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.988502 11753 ts_tablet_manager.cc:1434] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:14.988827 11753 tablet_bootstrap.cc:492] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:14.983925 11176 leader_election.cc:304] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:14.989362 13533 raft_consensus.cc:2804] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:14.989444 13533 raft_consensus.cc:493] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:14.989506 13533 raft_consensus.cc:3060] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:14.994153 13452 raft_consensus.cc:2749] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:14.986837 13411 raft_consensus.cc:515] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:14.996906 13411 leader_election.cc:290] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.999604 11753 tablet_bootstrap.cc:654] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.000734 11755 tablet_bootstrap.cc:492] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:15.000886 11755 ts_tablet_manager.cc:1403] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.001s
W20260925 01:50:15.001308 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c4f1e725fe84552943563aa95687842 consensus state has no leader
I20260925 01:50:15.001768 11755 raft_consensus.cc:359] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.001937 11755 raft_consensus.cc:385] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.001989 11755 raft_consensus.cc:740] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.002875 11755 consensus_queue.cc:260] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.003425 11755 ts_tablet_manager.cc:1434] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:15.003772 11755 tablet_bootstrap.cc:492] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:15.006891 11953 ts_tablet_manager.cc:1929] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:14.866782 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2f5603ea23446c9db47fd78d0c7854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.007822 11953 log.cc:1199] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/fbd4b231f89a48e59e5eb3cf3976385a
I20260925 01:50:15.008191 11677 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_0eea1e3736e342b5923d2977ea9fdd74 [id=372975f12d544860a00670c2763bbbb4] alter complete (version 4)
I20260925 01:50:15.007717 11755 tablet_bootstrap.cc:654] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.008263 11953 ts_tablet_manager.cc:1950] T fbd4b231f89a48e59e5eb3cf3976385a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:50:15.010120 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 56676.9us
I20260925 01:50:15.010421 13586 raft_consensus.cc:493] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.010555 13586 raft_consensus.cc:515] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.011168 13586 leader_election.cc:290] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:14.875736 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f97bbad6b7348caaed4d745343b811c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.014988 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 728) took 9099 ms. Trace:
I20260925 01:50:14.876307 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a65e06aba3640e2b42d05fb325c6171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.017963 11953 rpcz_store.cc:276] 0925 01:50:05.915324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.915377 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:14.958167 (+9042790us) ts_tablet_manager.cc:1151] Deleting tablet fbd4b231f89a48e59e5eb3cf3976385a
0925 01:50:14.966267 (+ 8100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.992986 (+ 26719us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.006831 (+ 13845us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.014965 (+ 8134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9042601}
I20260925 01:50:14.876818 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet b948d000f8314491b02244bdce37ba33 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dcb755b54004ffdbd9aac6594b4d26f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:14.885360 11490 tablet_service.cc:1511] Processing CreateTablet for tablet dfc41da6d8be47818cc2f68cd2558c7a (DEFAULT_TABLE table=default.Table_4735603a234e494e8530cb2f9745858c [id=9f3c01bf46474e3cba73aed29d40d458]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:14.889147 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60411b0feafe4fef9c4fdc364163f1df" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:14.889940 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9ccd099cba4b92909bb17c45dfce8a" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.018803 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet fbd4b231f89a48e59e5eb3cf3976385a (table default.Table_35c4ed0e87a84f229968365f06717746 [id=b28ab41a090b4b4ba73898ff85d54d07]) successfully deleted
I20260925 01:50:15.019044 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc41da6d8be47818cc2f68cd2558c7a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.017724 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 44610.2us
I20260925 01:50:15.020769 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982b2a3dcdcb44bd8ad8562f30c38f13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:15.021169 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef093a4a1134407ba94207137ce3e81" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:15.022533 11314 leader_election.cc:304] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.023224 11342 tablet_service.cc:1511] Processing CreateTablet for tablet ab95e0ab94e04a38a6c3c52fdd97d72a (DEFAULT_TABLE table=default.Table_b428af9da57849c5a79628f9d4d41b86 [id=4c229b9935494212ab644fa81c774bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.022547 11358 tablet_service.cc:1511] Processing CreateTablet for tablet dfa298826f7b40499614197464aad93d (DEFAULT_TABLE table=default.Table_7c51401ee2a840ee9ba64ed31002528d [id=2b16a911821d4324b959f51b5e9ae19f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.023618 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab95e0ab94e04a38a6c3c52fdd97d72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.023806 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa298826f7b40499614197464aad93d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.027029 11457 leader_election.cc:343] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:15.027204 11457 leader_election.cc:343] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.027172 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 60ef530e59ae46a4b41898e7544f434d (DEFAULT_TABLE table=default.Table_8bd16ceb58bf4be1b639f910b08ff42c [id=ba8b8e8a2ab5426597cf9ad5e56305a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.027511 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ef530e59ae46a4b41898e7544f434d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.029093 11456 leader_election.cc:343] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.029186 11456 leader_election.cc:304] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.030318 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 542b261cb0f24d218b67cee8aab8e7c5 (DEFAULT_TABLE table=default.Table_f48f8686b328486f968b63c037efe02e [id=9ae4cb9d756d40be8967d370c59dab15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.030637 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542b261cb0f24d218b67cee8aab8e7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.030730 13411 raft_consensus.cc:2749] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:15.031740 11456 leader_election.cc:343] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.031833 11456 leader_election.cc:304] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.032413 13411 raft_consensus.cc:2749] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.033694 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 95585d2cdfda48b29106213379f7903f (DEFAULT_TABLE table=default.Table_6b9a2b88205a4886a870605fa4258a5d [id=d10578fb1e994404b7819bbc2932805e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.034003 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95585d2cdfda48b29106213379f7903f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.037104 11176 leader_election.cc:343] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 0e3ba459a81845699435c2e44f5c9f19
I20260925 01:50:15.037227 11176 leader_election.cc:304] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.037451 13209 raft_consensus.cc:2749] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.037904 13209 consensus_queue.cc:1048] T e9462215644a41ccb2f269f64e35392a P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:15.038308 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 52e12e7edeaf44b9aa6349d63713d6fa (DEFAULT_TABLE table=default.Table_4b49c482845141aaafc53df1990e3233 [id=c78f75ccfd0f4181a30d9f3fb77ef1bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.038578 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 0749a0ae58df4ff8b74a86f072332fad (table default.Table_232e67b3ae3d4a90837f84f8df8b7482 [id=2f63b14356454c6d851e30c358c79191]) successfully deleted
I20260925 01:50:15.038655 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e12e7edeaf44b9aa6349d63713d6fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.038650 11176 consensus_peers.cc:597] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 329a5af9fb654d4c894e1cf4fd636c13. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:15.038933 11176 leader_election.cc:304] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.040340 13533 raft_consensus.cc:515] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.041232 11754 tablet_bootstrap.cc:492] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:15.041353 11754 ts_tablet_manager.cc:1403] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.261s user 0.003s sys 0.001s
I20260925 01:50:15.041356 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2f7ef888846ec9667916ba47084db" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:15.041863 11177 leader_election.cc:343] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.042105 13533 leader_election.cc:290] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.042646 11753 tablet_bootstrap.cc:492] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:15.042764 11753 ts_tablet_manager.cc:1403] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.054s user 0.006s sys 0.001s
I20260925 01:50:15.043368 11753 raft_consensus.cc:359] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.043522 11753 raft_consensus.cc:385] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.043572 11753 raft_consensus.cc:740] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.043591 13356 ts_tablet_manager.cc:1929] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.043682 13356 log.cc:1199] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/8afcf8f6d0e24472a3190059df032698
I20260925 01:50:15.043790 11753 consensus_queue.cc:260] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.043975 13356 ts_tablet_manager.cc:1950] T 8afcf8f6d0e24472a3190059df032698 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:15.044236 11753 ts_tablet_manager.cc:1434] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260925 01:50:15.044545 11753 tablet_bootstrap.cc:492] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:15.045965 11753 tablet_bootstrap.cc:654] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.046428 13209 raft_consensus.cc:2804] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.046509 13209 raft_consensus.cc:493] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:15.046612 13209 raft_consensus.cc:3060] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.049638 13209 raft_consensus.cc:515] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.050823 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b92054aaa704c7ebd6b075c30db2616" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:15.051810 11177 leader_election.cc:343] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.052383 11754 raft_consensus.cc:359] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.052561 11754 raft_consensus.cc:385] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.052621 11754 raft_consensus.cc:740] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.052856 11754 consensus_queue.cc:260] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.053496 11754 ts_tablet_manager.cc:1434] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260925 01:50:15.053901 11754 tablet_bootstrap.cc:492] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:15.055419 11754 tablet_bootstrap.cc:654] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.061525 13209 leader_election.cc:290] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:15.062288 11176 leader_election.cc:343] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Illegal state: Tablet not RUNNING: STOPPED
I20260925 01:50:15.062481 11176 leader_election.cc:304] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.062775 13420 consensus_queue.cc:1048] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:15.063051 11671 master_service.cc:960] ReplaceTablet: received request to replace tablet e6b97d37704f4a0d88457d124bb4f259 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:15.063191 13420 raft_consensus.cc:2749] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.068149 11176 leader_election.cc:304] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.068665 11176 leader_election.cc:304] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:15.068771 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 6091ed7d816a46958a6de343fe682292 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6091ed7d816a46958a6de343fe682292 already in progress: creating tablet
W20260925 01:50:15.069339 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1cd17f1ecead409ab7b54c2120476a3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd17f1ecead409ab7b54c2120476a3b already in progress: creating tablet
W20260925 01:50:15.070214 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d28dc51fc345487ba74c56b9b8f1ad42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d28dc51fc345487ba74c56b9b8f1ad42 already in progress: creating tablet
W20260925 01:50:15.070892 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a8d3b4ec14d5457eb0d0d364904e755d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8d3b4ec14d5457eb0d0d364904e755d already in progress: creating tablet
W20260925 01:50:15.071393 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e1480131c1e74536b5f3fa54764dc4f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1480131c1e74536b5f3fa54764dc4f3 already in progress: creating tablet
W20260925 01:50:15.071923 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet fdc26312580742a8a01b897e551a3a3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc26312580742a8a01b897e551a3a3d already in progress: creating tablet
I20260925 01:50:15.075132 11496 tablet_service.cc:1511] Processing CreateTablet for tablet ab95e0ab94e04a38a6c3c52fdd97d72a (DEFAULT_TABLE table=default.Table_b428af9da57849c5a79628f9d4d41b86 [id=4c229b9935494212ab644fa81c774bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.075350 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 95585d2cdfda48b29106213379f7903f (DEFAULT_TABLE table=default.Table_6b9a2b88205a4886a870605fa4258a5d [id=d10578fb1e994404b7819bbc2932805e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.075567 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab95e0ab94e04a38a6c3c52fdd97d72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.075783 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95585d2cdfda48b29106213379f7903f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.076596 11497 tablet_service.cc:1511] Processing CreateTablet for tablet 60ef530e59ae46a4b41898e7544f434d (DEFAULT_TABLE table=default.Table_8bd16ceb58bf4be1b639f910b08ff42c [id=ba8b8e8a2ab5426597cf9ad5e56305a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.077339 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ef530e59ae46a4b41898e7544f434d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.080466 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 542b261cb0f24d218b67cee8aab8e7c5 (DEFAULT_TABLE table=default.Table_f48f8686b328486f968b63c037efe02e [id=9ae4cb9d756d40be8967d370c59dab15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.080832 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542b261cb0f24d218b67cee8aab8e7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.082401 11495 tablet_service.cc:1511] Processing CreateTablet for tablet dfa298826f7b40499614197464aad93d (DEFAULT_TABLE table=default.Table_7c51401ee2a840ee9ba64ed31002528d [id=2b16a911821d4324b959f51b5e9ae19f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.082614 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 982b2a3dcdcb44bd8ad8562f30c38f13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.083012 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ef093a4a1134407ba94207137ce3e81 with delete_type TABLET_DATA_DELETED (replaced by tablet f8ffc45058774a878d4b802400feecb7) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.083222 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 148f74b071c6420f8c78278c0cb37738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:15.083671 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 61153.4us
I20260925 01:50:15.083981 11314 leader_election.cc:304] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.084260 13452 raft_consensus.cc:2749] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.085122 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 727) took 9183 ms. Trace:
I20260925 01:50:15.085883 11953 rpcz_store.cc:276] 0925 01:50:05.901876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.918278 (+ 16402us) service_pool.cc:224] Handling call
0925 01:50:15.084981 (+9166703us) ts_tablet_manager.cc:1151] Deleting tablet d6b0a7ae71724ba385371d3b772b067c
0925 01:50:15.084993 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.085102 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9166440}
W20260925 01:50:15.086973 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d6b0a7ae71724ba385371d3b772b067c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d6b0a7ae71724ba385371d3b772b067c already in progress: creating tablet
I20260925 01:50:15.087886 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 729) took 9137 ms. Trace:
I20260925 01:50:15.089279 13452 raft_consensus.cc:493] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.089440 13452 raft_consensus.cc:515] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.089344 11953 rpcz_store.cc:276] 0925 01:50:05.950639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.950710 (+ 71us) service_pool.cc:224] Handling call
0925 01:50:15.087749 (+9137039us) ts_tablet_manager.cc:1151] Deleting tablet bfc152df745b46fb84aec1c9fa017ba5
0925 01:50:15.087761 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.087864 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9136718}
I20260925 01:50:15.090185 13452 leader_election.cc:290] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:15.090261 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bfc152df745b46fb84aec1c9fa017ba5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfc152df745b46fb84aec1c9fa017ba5 already in progress: creating tablet
I20260925 01:50:15.092059 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 056669ad4f8240d99ee7519554ad780a (DEFAULT_TABLE table=default.Table_e9c35a7dc406446a80d02846b353e385 [id=2f70af1f170f407a96da2428afd7a372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.092644 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056669ad4f8240d99ee7519554ad780a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.095122 11679 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_18f0eff413dd4d708f97e5479fc790da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.095877 11679 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18f0eff413dd4d708f97e5479fc790da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.097716 11176 leader_election.cc:304] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.069059 13626 raft_consensus.cc:2804] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.073279 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982b2a3dcdcb44bd8ad8562f30c38f13" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.097922 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_949b582350a34f2cbdb030e708ec9d83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:15.075788 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef093a4a1134407ba94207137ce3e81" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.098502 13626 raft_consensus.cc:493] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:15.098624 13626 raft_consensus.cc:3060] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
W20260925 01:50:15.098757 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_949b582350a34f2cbdb030e708ec9d83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.085201 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1023) took 2249 ms. Trace:
I20260925 01:50:15.101176 13356 rpcz_store.cc:276] 0925 01:50:12.836027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.836093 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:14.886238 (+2050145us) ts_tablet_manager.cc:1151] Deleting tablet 8afcf8f6d0e24472a3190059df032698
0925 01:50:14.886249 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:14.960756 (+ 74507us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.043525 (+ 82769us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.085164 (+ 41639us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047204}
I20260925 01:50:15.094230 11359 tablet_service.cc:1511] Processing CreateTablet for tablet ccbe85e25ce94070b0f8bd1e2f6adb2a (DEFAULT_TABLE table=default.Table_42510f9b2fb7457cb365f2539885131e [id=5514e95d6b764fcf8c64c8ddc8e0b3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.105912 11946 ts_tablet_manager.cc:1929] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.106094 11677 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_f728cc17ba0a422aaf10e1f6377f8136"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:15.106601 13356 tablet_replica.cc:333] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
W20260925 01:50:15.106817 11677 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f728cc17ba0a422aaf10e1f6377f8136 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.106863 13356 raft_consensus.cc:2243] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.109445 11754 tablet_bootstrap.cc:492] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:15.109668 11754 ts_tablet_manager.cc:1403] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260925 01:50:15.095260 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 92d1dd73d3c2459da61e680554b00139 (DEFAULT_TABLE table=default.Table_0d83bc4068b545a7afe9a4498e2c8f87 [id=c202e01c103e4b5fa5c6183c6da1cae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.095763 11353 tablet_service.cc:1511] Processing CreateTablet for tablet eecc0bcbb26645dab341c096466289a6 (DEFAULT_TABLE table=default.Table_78376eb26eea43d3b1f015290026d136 [id=ab49a98f9c904b2b92f44180504b9de7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.115554 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbe85e25ce94070b0f8bd1e2f6adb2a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.117578 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet cf01b7f0ae6044988f543e1c4a50849d (table default.Table_6a2502f7f78c4f05840c9202928f9c85 [id=c0ff3cc1e8c54c159bdcff1b1b44be29], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cf01b7f0ae6044988f543e1c4a50849d consensus state has no leader
I20260925 01:50:15.119415 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d1dd73d3c2459da61e680554b00139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.119814 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 43298d3575c34e6090b8f0767ec6918e
I20260925 01:50:15.120409 11676 catalog_manager.cc:6934] ReplaceTablet: tablet 43298d3575c34e6090b8f0767ec6918e deleted and replaced by tablet a8bcfdf984d742a6b858e5ed263f1f82
I20260925 01:50:15.122295 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecc0bcbb26645dab341c096466289a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.122357 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 1602d22ad10f45d592c79e0d2affb2ae
I20260925 01:50:15.125183 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_c09c4425b40144d0a7ca1abb8474429f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.125845 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c09c4425b40144d0a7ca1abb8474429f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.126171 13452 raft_consensus.cc:493] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.126293 13452 raft_consensus.cc:515] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.126499 13209 raft_consensus.cc:2804] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.126590 13209 raft_consensus.cc:493] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:15.126652 13209 raft_consensus.cc:3060] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.126940 13452 leader_election.cc:290] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:15.127607 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_7fdf9bf8058a405bb0f934b312864480"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.128304 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fdf9bf8058a405bb0f934b312864480 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.129881 13209 raft_consensus.cc:515] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.131215 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728157ec17ed4df5a4a8559df6c1ac78" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:15.131840 11177 leader_election.cc:343] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.132067 13209 leader_election.cc:290] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.132263 13209 raft_consensus.cc:2804] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.132364 13209 raft_consensus.cc:493] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:15.132484 13209 raft_consensus.cc:3060] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.133010 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 1602d22ad10f45d592c79e0d2affb2ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.133144 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 57a16e11801146b7b17cd6cf1d91dc76 (DEFAULT_TABLE table=default.Table_1ce201094f214585996cc8cce5f9010d [id=3cd687eb2ff74fe5a8b83bb60dde7856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.133235 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 43298d3575c34e6090b8f0767ec6918e with delete_type TABLET_DATA_DELETED (replaced by tablet a8bcfdf984d742a6b858e5ed263f1f82) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.133522 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a16e11801146b7b17cd6cf1d91dc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.134397 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 730) took 9162 ms. Trace:
I20260925 01:50:15.142380 13356 raft_consensus.cc:2272] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.143705 13356 ts_tablet_manager.cc:1916] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.145465 13452 raft_consensus.cc:493] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.145614 13452 raft_consensus.cc:515] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.146308 13452 leader_election.cc:290] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:15.148571 13533 raft_consensus.cc:493] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.148947 13533 raft_consensus.cc:515] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:15.149858 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 52168.6us
I20260925 01:50:15.150534 13420 consensus_queue.cc:1048] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:15.151118 13420 consensus_queue.cc:1048] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 01:50:15.152283 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd594870fa6a4ba190a18a48d821d72c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:15.152448 13612 tablet.cc:1751] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260925 01:50:15.152885 11177 leader_election.cc:343] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.153195 13458 raft_consensus.cc:2749] T 60411b0feafe4fef9c4fdc364163f1df P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.157618 13533 leader_election.cc:290] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.102921 13626 raft_consensus.cc:515] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.159415 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a37a6deaeb24c99824b62fbb2d603b1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:15.160058 11177 leader_election.cc:343] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.161271 13626 leader_election.cc:290] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.166430 11754 raft_consensus.cc:359] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.166997 11946 log.cc:1199] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ff70e44b72d1425c81751ff0b3d93b11
I20260925 01:50:15.119004 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa298826f7b40499614197464aad93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.155927 13411 raft_consensus.cc:493] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.167359 13411 raft_consensus.cc:515] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.168047 13411 leader_election.cc:290] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.165442 11753 tablet_bootstrap.cc:492] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:15.139418 11953 rpcz_store.cc:276] 0925 01:50:05.972229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:05.972853 (+ 624us) service_pool.cc:224] Handling call
0925 01:50:15.134282 (+9161429us) ts_tablet_manager.cc:1151] Deleting tablet 22a335062caa48139e1cd4bca7bd4e2b
0925 01:50:15.134291 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.134379 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9161109}
I20260925 01:50:15.169009 11753 ts_tablet_manager.cc:1403] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.125s user 0.009s sys 0.005s
W20260925 01:50:15.169234 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 22a335062caa48139e1cd4bca7bd4e2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22a335062caa48139e1cd4bca7bd4e2b already in progress: creating tablet
I20260925 01:50:15.169602 11946 ts_tablet_manager.cc:1950] T ff70e44b72d1425c81751ff0b3d93b11 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:15.107599 11456 leader_election.cc:343] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.170784 11753 raft_consensus.cc:359] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.171111 11456 leader_election.cc:304] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.171474 11753 raft_consensus.cc:385] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.171962 11753 raft_consensus.cc:740] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.172369 13411 raft_consensus.cc:2749] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.173435 11753 consensus_queue.cc:260] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.177628 13458 raft_consensus.cc:493] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.177778 13458 raft_consensus.cc:515] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.178469 13458 leader_election.cc:290] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:15.178632 11753 ts_tablet_manager.cc:1434] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
W20260925 01:50:15.172685 11456 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 65107.5us
W20260925 01:50:15.179286 11456 leader_election.cc:343] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:15.179337 11314 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: c7944aa1ac8f4c5d8ea3aa2acae41257
I20260925 01:50:15.179633 11456 leader_election.cc:304] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:15.180110 11314 leader_election.cc:343] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 818a792969a245f5b0fe5f80128206ba
I20260925 01:50:15.180258 13411 raft_consensus.cc:2749] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.182650 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 056669ad4f8240d99ee7519554ad780a (DEFAULT_TABLE table=default.Table_e9c35a7dc406446a80d02846b353e385 [id=2f70af1f170f407a96da2428afd7a372]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:15.182929 11314 leader_election.cc:343] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: c7944aa1ac8f4c5d8ea3aa2acae41257
I20260925 01:50:15.183172 11314 leader_election.cc:304] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.183616 11503 tablet_service.cc:1511] Processing CreateTablet for tablet eecc0bcbb26645dab341c096466289a6 (DEFAULT_TABLE table=default.Table_78376eb26eea43d3b1f015290026d136 [id=ab49a98f9c904b2b92f44180504b9de7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.184320 13452 raft_consensus.cc:2749] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.184103 11487 tablet_service.cc:1511] Processing CreateTablet for tablet ccbe85e25ce94070b0f8bd1e2f6adb2a (DEFAULT_TABLE table=default.Table_42510f9b2fb7457cb365f2539885131e [id=5514e95d6b764fcf8c64c8ddc8e0b3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.185530 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 52e12e7edeaf44b9aa6349d63713d6fa (DEFAULT_TABLE table=default.Table_4b49c482845141aaafc53df1990e3233 [id=c78f75ccfd0f4181a30d9f3fb77ef1bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.186022 11241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6386bd0cb4894068985fe152299f0b47" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.186468 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.185544 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet 43298d3575c34e6090b8f0767ec6918e with delete_type TABLET_DATA_DELETED (replaced by tablet a8bcfdf984d742a6b858e5ed263f1f82) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.186996 11489 tablet_service.cc:1511] Processing CreateTablet for tablet 92d1dd73d3c2459da61e680554b00139 (DEFAULT_TABLE table=default.Table_0d83bc4068b545a7afe9a4498e2c8f87 [id=c202e01c103e4b5fa5c6183c6da1cae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.187798 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet cb7bac6e89b8405e8bd541eba6278a0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.190582 13420 raft_consensus.cc:493] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.190722 13420 raft_consensus.cc:515] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.191394 13420 leader_election.cc:290] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.192034 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a00b69e42e1465981d6c3eec217393f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:15.193006 11177 leader_election.cc:343] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.193413 11370 raft_consensus.cc:3060] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.196338 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5dcf3b6d134065be92ec6ea8caffc7" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.196341 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6386bd0cb4894068985fe152299f0b47" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.204491 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 57a16e11801146b7b17cd6cf1d91dc76 (DEFAULT_TABLE table=default.Table_1ce201094f214585996cc8cce5f9010d [id=3cd687eb2ff74fe5a8b83bb60dde7856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.209816 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056669ad4f8240d99ee7519554ad780a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.210979 11499 tablet_service.cc:1558] Processing DeleteTablet for tablet 1602d22ad10f45d592c79e0d2affb2ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.212134 11753 tablet_bootstrap.cc:492] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:15.214874 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbe85e25ce94070b0f8bd1e2f6adb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.215250 11489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d1dd73d3c2459da61e680554b00139. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.185108 11314 leader_election.cc:343] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 818a792969a245f5b0fe5f80128206ba
I20260925 01:50:15.218533 11314 leader_election.cc:304] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.220706 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecc0bcbb26645dab341c096466289a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.220994 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a16e11801146b7b17cd6cf1d91dc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.223052 13452 raft_consensus.cc:2749] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.228758 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148f74b071c6420f8c78278c0cb37738" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:15.229368 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e12e7edeaf44b9aa6349d63713d6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.230101 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 986) took 2562 ms. Trace:
I20260925 01:50:15.232738 11314 leader_election.cc:304] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.234127 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148f74b071c6420f8c78278c0cb37738" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.234613 13452 raft_consensus.cc:2749] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.235548 11953 tablet_replica.cc:333] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:15.235852 11953 raft_consensus.cc:2243] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.236119 11953 raft_consensus.cc:2272] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.237569 11314 leader_election.cc:304] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.232174 11946 rpcz_store.cc:276] 0925 01:50:12.666747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.666808 (+ 61us) service_pool.cc:224] Handling call
0925 01:50:14.972411 (+2305603us) ts_tablet_manager.cc:1151] Deleting tablet ff70e44b72d1425c81751ff0b3d93b11
0925 01:50:14.972422 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.085663 (+113241us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.105842 (+ 20179us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.229607 (+123765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32751,"tablet-delete.queue_time_us":2305399}
I20260925 01:50:15.240952 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a07f977c6a00450a8e8ceb6580dab980
I20260925 01:50:15.241344 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 9771b89303094974902c4ad1f1c8608e (table default.Table_b2c0a186ead548bca5ccee40cb8df40f [id=0715eef3ce6a4fa292556da81676ed28]) successfully deleted
W20260925 01:50:15.242112 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet e1480131c1e74536b5f3fa54764dc4f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1480131c1e74536b5f3fa54764dc4f3 already in progress: creating tablet
I20260925 01:50:15.242112 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e3b08f61aaf5442889011fe309dea835
I20260925 01:50:15.242838 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 70c94e791a494eb580253e0c8e0fa56a
I20260925 01:50:15.245685 11672 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a3b1ed8c6faa4759b7d68e4bf1c60e90" } new_table_name: "default.Table_02f23c36767d4a14bee973dceb97d914" modify_external_catalogs: true
I20260925 01:50:15.246249 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f40821075d3c4668b7099d6fceee3c21" } new_table_name: "default.Table_cdc7c2e3297c460382947670a3a2e9e9" modify_external_catalogs: true
I20260925 01:50:15.246495 11675 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet c86a78873e8847fa95bead4774bea606
W20260925 01:50:15.240449 11457 leader_election.cc:343] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.241129 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33967e5e11524b78bb86ce7a3e2e16ad" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.247287 11514 raft_consensus.cc:2468] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:15.241523 11513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b6bde824d74acfaaffc23a0b05db8b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.247548 11513 raft_consensus.cc:3060] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.248032 11677 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_6529ebbfdfc342a0b8dd088869ca0556" } new_table_name: "default.Table_55a570be01b241f8939758ca3e3bfad5" modify_external_catalogs: true
I20260925 01:50:15.249406 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_bd863d8d02fb435dbeafcf9279cbdeaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:15.167081 11754 raft_consensus.cc:385] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.250921 11754 raft_consensus.cc:740] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.251192 11754 consensus_queue.cc:260] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.255810 11671 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet e6b97d37704f4a0d88457d124bb4f259
I20260925 01:50:15.262274 13321 raft_consensus.cc:493] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.262432 13321 raft_consensus.cc:515] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.266582 11946 tablet_replica.cc:333] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:15.266541 13209 raft_consensus.cc:515] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.266821 11946 raft_consensus.cc:2243] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.267148 11753 tablet_bootstrap.cc:654] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.267220 13209 leader_election.cc:290] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.267836 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f1e725fe84552943563aa95687842" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:15.268455 11177 leader_election.cc:343] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.271347 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40083a885974e3595ec2fb5b16d4a5d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.271536 11514 raft_consensus.cc:2468] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:15.275996 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet fdc26312580742a8a01b897e551a3a3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc26312580742a8a01b897e551a3a3d already in progress: creating tablet
W20260925 01:50:15.276427 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet a8d3b4ec14d5457eb0d0d364904e755d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8d3b4ec14d5457eb0d0d364904e755d already in progress: creating tablet
W20260925 01:50:15.276687 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 03487a3fa9574fd583d9c95d0624203c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03487a3fa9574fd583d9c95d0624203c already in progress: creating tablet
I20260925 01:50:15.278290 11754 ts_tablet_manager.cc:1434] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.168s user 0.003s sys 0.000s
I20260925 01:50:15.278632 11754 tablet_bootstrap.cc:492] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:15.279770 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113d7ccee4e349e19d3948e09d2c533d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.279958 11514 raft_consensus.cc:2468] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:15.280485 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet b4e5d28d466741a0a085a4f9938fffd1 (table default.Table_bcb7951d232d405aa37610b2feac232d [id=75fabdd6afe3465ea2fa07ac644cda0a]) successfully deleted
I20260925 01:50:15.281580 11953 ts_tablet_manager.cc:1916] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.281934 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e28aeabdf724784b8ed27535ea0701b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.282142 11514 raft_consensus.cc:2468] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:15.283418 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc4a51356880486a928181ee701f74d0" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.283578 11514 raft_consensus.cc:3060] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.284143 11671 catalog_manager.cc:6934] ReplaceTablet: tablet e6b97d37704f4a0d88457d124bb4f259 deleted and replaced by tablet 73c6a6781be8487d8d6b0112fbbdd3c9
I20260925 01:50:15.286471 11514 raft_consensus.cc:2468] T cc4a51356880486a928181ee701f74d0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:15.287534 11456 leader_election.cc:343] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.287680 11456 leader_election.cc:304] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.292217 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f977c6a00450a8e8ceb6580dab980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.293879 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9513d1d55fe846f5b1a2b7d315209002" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.286332 13639 tablet.cc:1751] T 176e572f77e242d799c334820579268d P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:15.294335 11519 raft_consensus.cc:3060] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.295984 13411 raft_consensus.cc:2749] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.296244 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet e3b08f61aaf5442889011fe309dea835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.297556 11519 raft_consensus.cc:2468] T 9513d1d55fe846f5b1a2b7d315209002 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:15.297576 13411 raft_consensus.cc:493] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.297740 13411 raft_consensus.cc:515] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.298344 13411 leader_election.cc:290] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.298374 11490 tablet_service.cc:1558] Processing DeleteTablet for tablet c86a78873e8847fa95bead4774bea606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.298789 11946 raft_consensus.cc:2272] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.298985 11491 tablet_service.cc:1558] Processing DeleteTablet for tablet e3b08f61aaf5442889011fe309dea835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.299044 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee952102744ef8b287965330d7cd97" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.299259 11497 tablet_service.cc:1558] Processing DeleteTablet for tablet e6b97d37704f4a0d88457d124bb4f259 with delete_type TABLET_DATA_DELETED (replaced by tablet 73c6a6781be8487d8d6b0112fbbdd3c9) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.299325 11946 ts_tablet_manager.cc:1916] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.299589 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f977c6a00450a8e8ceb6580dab980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.299854 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet e6b97d37704f4a0d88457d124bb4f259 with delete_type TABLET_DATA_DELETED (replaced by tablet 73c6a6781be8487d8d6b0112fbbdd3c9) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.300671 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 70c94e791a494eb580253e0c8e0fa56a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.301215 13321 leader_election.cc:290] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:15.310096 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd863d8d02fb435dbeafcf9279cbdeaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.313206 11675 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_37f09900657f43d79f9eca3fe69932f9" } new_table_name: "default.Table_489b7ad781074fb393d47d1a83599588" modify_external_catalogs: true
I20260925 01:50:15.314824 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_540dd004daf24dc095bd909960244ad4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:15.316798 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 70c94e791a494eb580253e0c8e0fa56a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.317562 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet c86a78873e8847fa95bead4774bea606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.318223 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ff70e44b72d1425c81751ff0b3d93b11 (table default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]) successfully deleted
W20260925 01:50:15.318264 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_540dd004daf24dc095bd909960244ad4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.318202 11673 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_a6927e74a7f84b81b3732c15a8b42061"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.319456 11673 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6927e74a7f84b81b3732c15a8b42061 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.318143 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 6a9ccd099cba4b92909bb17c45dfce8a (table default.Table_a6b67f9415ae41dbaf3903dbbaec308f [id=c23a94a77b36437f843f323488d4ed42]). Expected version 1 got 0
I20260925 01:50:15.320339 11674 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 60411b0feafe4fef9c4fdc364163f1df (table default.Table_9c96e3747586472d861731441a16b7eb [id=0848b51bdadb45b5b1a5357208cfcd58]). Expected version 4 got 0
I20260925 01:50:15.321987 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d8796cbab6bf43eca69ec0652e34fe86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.326694 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8796cbab6bf43eca69ec0652e34fe86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.337940 11754 tablet_bootstrap.cc:654] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:15.332422 11672 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b840331db6014ee88baf8b85c31e41f4 has no consensus state
I20260925 01:50:15.341470 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 8afcf8f6d0e24472a3190059df032698 (table default.Table_77556b8645c143cba6b3bee14942c58b [id=749545cadfbc47f3a12a9d327cfda9ff]) successfully deleted
W20260925 01:50:15.346475 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7dfb342a744147e99917b6f32bd07b06 consensus state has no leader
I20260925 01:50:15.346966 11680 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_99845f420c274423ac97431b16de7342" } new_table_name: "default.Table_4c28353cd962466da807b985394094d4" modify_external_catalogs: true
I20260925 01:50:15.347496 13612 tablet.cc:1751] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:15.349233 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2b84bf610ee94c31aebe09bdd48350df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.350494 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b84bf610ee94c31aebe09bdd48350df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:15.343716 11456 leader_election.cc:343] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.362123 11516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2f7ef888846ec9667916ba47084db" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.362372 11516 raft_consensus.cc:3060] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.364930 11946 ts_tablet_manager.cc:1929] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.365048 11946 log.cc:1199] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/33967e5e11524b78bb86ce7a3e2e16ad
I20260925 01:50:15.365293 11516 raft_consensus.cc:2468] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:15.365418 11946 ts_tablet_manager.cc:1950] T 33967e5e11524b78bb86ce7a3e2e16ad P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:15.365583 11515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b92054aaa704c7ebd6b075c30db2616" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.365744 11515 raft_consensus.cc:3060] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.367331 11753 tablet_bootstrap.cc:492] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:15.367476 11753 ts_tablet_manager.cc:1403] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.156s user 0.003s sys 0.002s
I20260925 01:50:15.368430 11755 tablet_bootstrap.cc:492] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:15.368422 11753 raft_consensus.cc:359] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.368616 11753 raft_consensus.cc:385] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.368685 11753 raft_consensus.cc:740] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.368968 11753 consensus_queue.cc:260] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.369536 11520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728157ec17ed4df5a4a8559df6c1ac78" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.369632 13639 tablet.cc:1751] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260925 01:50:15.369712 11520 raft_consensus.cc:3060] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.369513 11753 ts_tablet_manager.cc:1434] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:15.372933 11520 raft_consensus.cc:2468] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:15.375053 11521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd594870fa6a4ba190a18a48d821d72c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.375342 11521 raft_consensus.cc:2468] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:15.375622 11517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a37a6deaeb24c99824b62fbb2d603b1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.375782 11517 raft_consensus.cc:3060] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.377422 11754 tablet_bootstrap.cc:492] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:15.377573 11754 ts_tablet_manager.cc:1403] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.000s
I20260925 01:50:15.368762 11515 raft_consensus.cc:2468] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:15.378813 11674 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_75c9b6035afe42349ad58a9bc0645d80" } modify_external_catalogs: true
I20260925 01:50:15.380735 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet b91957f62d8044ea8f6a3464c84b9e10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c886579e1eb4cac958514f7dc53b7b8) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.380885 13632 raft_consensus.cc:493] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.381307 13632 raft_consensus.cc:515] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.383162 13632 leader_election.cc:290] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.379097 11674 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_75c9b6035afe42349ad58a9bc0645d80" } modify_external_catalogs: true
I20260925 01:50:15.385911 11517 raft_consensus.cc:2468] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
W20260925 01:50:15.386660 11177 consensus_peers.cc:597] T 602af3d6e7bb44f8a316691019f85c25 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:15.388222 11515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a00b69e42e1465981d6c3eec217393f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.388466 11515 raft_consensus.cc:2468] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:15.403146 11754 raft_consensus.cc:359] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.409229 11513 raft_consensus.cc:2468] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:15.416165 11953 ts_tablet_manager.cc:1929] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.424595 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7347b31f782c4508b004c7523dc11dbb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:15.425470 11755 ts_tablet_manager.cc:1403] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.365s user 0.006s sys 0.020s
I20260925 01:50:15.425585 11361 raft_consensus.cc:3060] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.425712 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 031687d4b26b4c7889dfbe3485c9f4c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.426257 13458 raft_consensus.cc:493] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.411999 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341dca6f396449daadcaf8bbb77ed04b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.421809 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 988) took 2754 ms. Trace:
I20260925 01:50:15.436153 11946 rpcz_store.cc:276] 0925 01:50:12.666908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.667036 (+ 128us) service_pool.cc:224] Handling call
0925 01:50:15.266511 (+2599475us) ts_tablet_manager.cc:1151] Deleting tablet 33967e5e11524b78bb86ce7a3e2e16ad
0925 01:50:15.266527 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.361339 (+ 94812us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.364865 (+ 3526us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.421778 (+ 56913us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31777,"tablet-delete.queue_time_us":2599360}
I20260925 01:50:15.436713 11519 raft_consensus.cc:2468] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:15.436764 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 33967e5e11524b78bb86ce7a3e2e16ad (table default.Table_5995b17dc74742079004a9f3dadc82b8 [id=19ba7adc361640ed8767b565d92b0ada]) successfully deleted
I20260925 01:50:15.437199 11946 tablet_replica.cc:333] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:15.437433 11946 raft_consensus.cc:2243] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.437628 11946 raft_consensus.cc:2272] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.438549 11946 ts_tablet_manager.cc:1916] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:15.425472 11177 leader_election.cc:343] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.427112 11755 raft_consensus.cc:359] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.450300 11755 raft_consensus.cc:385] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 01:50:15.450374 11177 consensus_peers.cc:597] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:15.450415 11755 raft_consensus.cc:740] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.450495 11221 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a00b69e42e1465981d6c3eec217393f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.437743 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d867e7f58554c1196e837346b0b37d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.441859 13637 tablet.cc:1751] T 6a9ccd099cba4b92909bb17c45dfce8a P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:15.450712 11755 consensus_queue.cc:260] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.438222 11208 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f2f5603ea23446c9db47fd78d0c7854 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.451288 11755 ts_tablet_manager.cc:1434] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.026s user 0.000s sys 0.001s
I20260925 01:50:15.438297 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a65e06aba3640e2b42d05fb325c6171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.438409 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet b948d000f8314491b02244bdce37ba33 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dcb755b54004ffdbd9aac6594b4d26f) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.451673 11755 tablet_bootstrap.cc:492] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:15.451983 11754 raft_consensus.cc:385] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.452075 11754 raft_consensus.cc:740] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.452781 11754 consensus_queue.cc:260] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.453570 11755 tablet_bootstrap.cc:654] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.454675 11953 log.cc:1199] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/d253f8b1e4ac41388a885178f2ed0f40
I20260925 01:50:15.455463 11953 ts_tablet_manager.cc:1950] T d253f8b1e4ac41388a885178f2ed0f40 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:15.454891 13458 raft_consensus.cc:515] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.469769 13458 leader_election.cc:290] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:15.456928 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 731) took 9455 ms. Trace:
I20260925 01:50:15.473112 11753 tablet_bootstrap.cc:492] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:15.475059 11753 tablet_bootstrap.cc:654] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.471517 11953 rpcz_store.cc:276] 0925 01:50:06.001650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.007168 (+ 5518us) service_pool.cc:224] Handling call
0925 01:50:15.169273 (+9162105us) ts_tablet_manager.cc:1151] Deleting tablet d253f8b1e4ac41388a885178f2ed0f40
0925 01:50:15.235469 (+ 66196us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.288514 (+ 53045us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.416075 (+127561us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.456862 (+ 40787us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9161815}
I20260925 01:50:15.477538 11677 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_eb0cc83e98e14a84b8ca8fcb5011b6c4" } modify_external_catalogs: true
I20260925 01:50:15.477782 11677 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_eb0cc83e98e14a84b8ca8fcb5011b6c4" } modify_external_catalogs: true
I20260925 01:50:15.481047 11953 tablet_replica.cc:333] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:15.481026 11678 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_d55afd57e18746038f74734786804941"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.481879 11678 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d55afd57e18746038f74734786804941 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.482381 11953 raft_consensus.cc:2243] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.484058 11953 raft_consensus.cc:2272] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.485319 11953 ts_tablet_manager.cc:1916] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.487375 13452 raft_consensus.cc:2749] T df5dcf3b6d134065be92ec6ea8caffc7 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:15.487643 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 199949us
I20260925 01:50:15.510766 11755 tablet_bootstrap.cc:492] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:15.511116 11755 ts_tablet_manager.cc:1403] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.001s
I20260925 01:50:15.511564 13321 raft_consensus.cc:493] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
W20260925 01:50:15.511736 11314 leader_election.cc:343] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b91957f62d8044ea8f6a3464c84b9e10
I20260925 01:50:15.511739 13321 raft_consensus.cc:515] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
W20260925 01:50:15.511996 11314 leader_election.cc:343] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 031687d4b26b4c7889dfbe3485c9f4c5
I20260925 01:50:15.512115 11755 raft_consensus.cc:359] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.512291 11755 raft_consensus.cc:385] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.512378 11755 raft_consensus.cc:740] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.512501 13321 leader_election.cc:290] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:15.512524 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfee952102744ef8b287965330d7cd97" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:15.512625 11755 consensus_queue.cc:260] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.513193 11755 ts_tablet_manager.cc:1434] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260925 01:50:15.513302 11314 leader_election.cc:343] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 031687d4b26b4c7889dfbe3485c9f4c5
I20260925 01:50:15.513447 11314 leader_election.cc:304] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.513556 11755 tablet_bootstrap.cc:492] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:15.513844 13321 raft_consensus.cc:2749] T 031687d4b26b4c7889dfbe3485c9f4c5 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:15.515337 11675 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 67ad5fb90dad4f869e87cfbb7717035e consensus state has no leader
W20260925 01:50:15.515496 11457 leader_election.cc:343] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.515627 11457 leader_election.cc:304] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.516007 13586 raft_consensus.cc:2749] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:15.516433 11314 leader_election.cc:343] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 01d50e428bfc46caa130f96ccc7e8f40
W20260925 01:50:15.519731 11314 leader_election.cc:343] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:50:15.519892 11314 leader_election.cc:304] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.520442 13452 raft_consensus.cc:2749] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:15.529587 11946 ts_tablet_manager.cc:1929] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:50:15.529670 11314 leader_election.cc:343] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b91957f62d8044ea8f6a3464c84b9e10
I20260925 01:50:15.529753 11946 log.cc:1199] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e40083a885974e3595ec2fb5b16d4a5d
I20260925 01:50:15.529806 11314 leader_election.cc:304] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.530089 13458 raft_consensus.cc:2749] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.530154 11946 ts_tablet_manager.cc:1950] T e40083a885974e3595ec2fb5b16d4a5d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:15.530471 13656 tablet.cc:1751] T 176e572f77e242d799c334820579268d P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260925 01:50:15.530998 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 989) took 2864 ms. Trace:
I20260925 01:50:15.531095 11946 rpcz_store.cc:276] 0925 01:50:12.666984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.667443 (+ 459us) service_pool.cc:224] Handling call
0925 01:50:15.437138 (+2769695us) ts_tablet_manager.cc:1151] Deleting tablet e40083a885974e3595ec2fb5b16d4a5d
0925 01:50:15.437152 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.465568 (+ 28416us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.529502 (+ 63934us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.530976 (+ 1474us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2769534}
I20260925 01:50:15.531622 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e40083a885974e3595ec2fb5b16d4a5d (table default.Table_0c8444676dd247048ee61b454fa4e0c3 [id=3eb929859fec4e119e50eb65fa8b0b2c]) successfully deleted
I20260925 01:50:15.534577 11215 tablet_service.cc:1511] Processing CreateTablet for tablet ab95e0ab94e04a38a6c3c52fdd97d72a (DEFAULT_TABLE table=default.Table_b428af9da57849c5a79628f9d4d41b86 [id=4c229b9935494212ab644fa81c774bb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.535085 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab95e0ab94e04a38a6c3c52fdd97d72a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.536760 11214 tablet_service.cc:1511] Processing CreateTablet for tablet dfa298826f7b40499614197464aad93d (DEFAULT_TABLE table=default.Table_7c51401ee2a840ee9ba64ed31002528d [id=2b16a911821d4324b959f51b5e9ae19f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.537233 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa298826f7b40499614197464aad93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.519176 11755 tablet_bootstrap.cc:654] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.542866 11953 ts_tablet_manager.cc:1929] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.543080 11953 log.cc:1199] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/257e6f224f99427eb68fd61fa1aadae0
I20260925 01:50:15.543483 11953 ts_tablet_manager.cc:1950] T 257e6f224f99427eb68fd61fa1aadae0 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:15.547322 11753 tablet_bootstrap.cc:492] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:15.547484 11753 ts_tablet_manager.cc:1403] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.001s
I20260925 01:50:15.548302 11754 ts_tablet_manager.cc:1434] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.171s user 0.003s sys 0.000s
I20260925 01:50:15.548213 11753 raft_consensus.cc:359] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.548391 11753 raft_consensus.cc:385] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.548461 11753 raft_consensus.cc:740] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.548604 11754 tablet_bootstrap.cc:492] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:15.548700 11753 consensus_queue.cc:260] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.549204 11753 ts_tablet_manager.cc:1434] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:15.549782 11753 tablet_bootstrap.cc:492] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:15.550160 11754 tablet_bootstrap.cc:654] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.551785 11753 tablet_bootstrap.cc:654] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.559576 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 95585d2cdfda48b29106213379f7903f (DEFAULT_TABLE table=default.Table_6b9a2b88205a4886a870605fa4258a5d [id=d10578fb1e994404b7819bbc2932805e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.559964 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95585d2cdfda48b29106213379f7903f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.564221 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 542b261cb0f24d218b67cee8aab8e7c5 (DEFAULT_TABLE table=default.Table_f48f8686b328486f968b63c037efe02e [id=9ae4cb9d756d40be8967d370c59dab15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.564654 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542b261cb0f24d218b67cee8aab8e7c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.566922 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 52e12e7edeaf44b9aa6349d63713d6fa (DEFAULT_TABLE table=default.Table_4b49c482845141aaafc53df1990e3233 [id=c78f75ccfd0f4181a30d9f3fb77ef1bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.567273 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e12e7edeaf44b9aa6349d63713d6fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.571070 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 732) took 9538 ms. Trace:
I20260925 01:50:15.571185 11953 rpcz_store.cc:276] 0925 01:50:06.032329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.032380 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:15.480945 (+9448565us) ts_tablet_manager.cc:1151] Deleting tablet 257e6f224f99427eb68fd61fa1aadae0
0925 01:50:15.480958 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.517191 (+ 36233us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.542788 (+ 25597us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.571017 (+ 28229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9448223}
I20260925 01:50:15.571715 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 257e6f224f99427eb68fd61fa1aadae0 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]) successfully deleted
I20260925 01:50:15.572238 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 738) took 8991 ms. Trace:
I20260925 01:50:15.572412 11953 rpcz_store.cc:276] 0925 01:50:06.581087 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.581140 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:15.572091 (+8990951us) ts_tablet_manager.cc:1151] Deleting tablet 5048a0fca2e64ffa9f19000f48a4c090
0925 01:50:15.572101 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.572200 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8990774}
W20260925 01:50:15.572947 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5048a0fca2e64ffa9f19000f48a4c090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5048a0fca2e64ffa9f19000f48a4c090 already in progress: creating tablet
I20260925 01:50:15.573376 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 739) took 8962 ms. Trace:
I20260925 01:50:15.573545 11953 rpcz_store.cc:276] 0925 01:50:06.610676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.610741 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:15.573256 (+8962515us) ts_tablet_manager.cc:1151] Deleting tablet 5ef093a4a1134407ba94207137ce3e81
0925 01:50:15.573265 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.573340 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8960156}
I20260925 01:50:15.574115 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 60ef530e59ae46a4b41898e7544f434d (DEFAULT_TABLE table=default.Table_8bd16ceb58bf4be1b639f910b08ff42c [id=ba8b8e8a2ab5426597cf9ad5e56305a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.574453 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ef530e59ae46a4b41898e7544f434d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.449481 13356 ts_tablet_manager.cc:1929] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.578751 13356 log.cc:1199] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/81024a75b31e45e098d108bae4cc17c9
I20260925 01:50:15.579147 13356 ts_tablet_manager.cc:1950] T 81024a75b31e45e098d108bae4cc17c9 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:15.579948 11946 tablet_replica.cc:333] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:15.580197 11946 raft_consensus.cc:2243] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.580385 11946 raft_consensus.cc:2272] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.580695 11208 tablet_service.cc:1511] Processing CreateTablet for tablet 056669ad4f8240d99ee7519554ad780a (DEFAULT_TABLE table=default.Table_e9c35a7dc406446a80d02846b353e385 [id=2f70af1f170f407a96da2428afd7a372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.581056 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 748) took 8934 ms. Trace:
I20260925 01:50:15.581112 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 056669ad4f8240d99ee7519554ad780a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.581161 11953 rpcz_store.cc:276] 0925 01:50:06.646774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.653657 (+ 6883us) service_pool.cc:224] Handling call
0925 01:50:15.580910 (+8927253us) ts_tablet_manager.cc:1151] Deleting tablet 1e1c0285c79b4e1280f3aa732e297c57
0925 01:50:15.580919 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.581005 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8927042}
W20260925 01:50:15.581662 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1e1c0285c79b4e1280f3aa732e297c57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e1c0285c79b4e1280f3aa732e297c57 already in progress: creating tablet
I20260925 01:50:15.582970 11755 tablet_bootstrap.cc:492] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:15.583184 11755 ts_tablet_manager.cc:1403] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.000s
I20260925 01:50:15.583736 11946 ts_tablet_manager.cc:1916] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.584132 11755 raft_consensus.cc:359] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.584376 11755 raft_consensus.cc:385] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.584486 11755 raft_consensus.cc:740] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.584810 11755 consensus_queue.cc:260] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.585444 11755 ts_tablet_manager.cc:1434] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:15.585805 11755 tablet_bootstrap.cc:492] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:15.587561 11755 tablet_bootstrap.cc:654] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.590337 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 745) took 8955 ms. Trace:
I20260925 01:50:15.594223 11953 rpcz_store.cc:276] 0925 01:50:06.634411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.653915 (+ 19504us) service_pool.cc:224] Handling call
0925 01:50:15.590186 (+8936271us) ts_tablet_manager.cc:1151] Deleting tablet 064c6cbe77d0405abe16a9a53d842590
0925 01:50:15.590196 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.590295 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8935966}
W20260925 01:50:15.594920 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 064c6cbe77d0405abe16a9a53d842590 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 064c6cbe77d0405abe16a9a53d842590 already in progress: creating tablet
I20260925 01:50:15.595435 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 749) took 8871 ms. Trace:
I20260925 01:50:15.595580 11953 rpcz_store.cc:276] 0925 01:50:06.723919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.723997 (+ 78us) service_pool.cc:224] Handling call
0925 01:50:15.595288 (+8871291us) ts_tablet_manager.cc:1151] Deleting tablet 507d06f04fb24c1abb9119a0fa5af141
0925 01:50:15.595296 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.595386 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8871105}
W20260925 01:50:15.596134 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 507d06f04fb24c1abb9119a0fa5af141 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 507d06f04fb24c1abb9119a0fa5af141 already in progress: creating tablet
I20260925 01:50:15.603493 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:15.608119 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 747) took 8969 ms. Trace:
I20260925 01:50:15.608282 11953 rpcz_store.cc:276] 0925 01:50:06.638154 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.809910 (+171756us) service_pool.cc:224] Handling call
0925 01:50:15.607409 (+8797499us) ts_tablet_manager.cc:1151] Deleting tablet 16dcc2d4bf24480f8e5fe67ae18764d0
0925 01:50:15.607928 (+ 519us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.608058 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8793472}
I20260925 01:50:15.608680 11953 tablet_replica.cc:333] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:15.608938 11953 raft_consensus.cc:2243] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:15.608973 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 16dcc2d4bf24480f8e5fe67ae18764d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16dcc2d4bf24480f8e5fe67ae18764d0 already in progress: creating tablet
I20260925 01:50:15.609162 11953 raft_consensus.cc:2272] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.609812 11953 ts_tablet_manager.cc:1916] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.612912 11370 raft_consensus.cc:3060] T f1d3077f21374d969626972654c7e5e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.614802 11220 tablet_service.cc:1511] Processing CreateTablet for tablet eecc0bcbb26645dab341c096466289a6 (DEFAULT_TABLE table=default.Table_78376eb26eea43d3b1f015290026d136 [id=ab49a98f9c904b2b92f44180504b9de7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.615213 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecc0bcbb26645dab341c096466289a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.622942 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 43298d3575c34e6090b8f0767ec6918e with delete_type TABLET_DATA_DELETED (replaced by tablet a8bcfdf984d742a6b858e5ed263f1f82) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.623562 11205 tablet_service.cc:1511] Processing CreateTablet for tablet 92d1dd73d3c2459da61e680554b00139 (DEFAULT_TABLE table=default.Table_0d83bc4068b545a7afe9a4498e2c8f87 [id=c202e01c103e4b5fa5c6183c6da1cae6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.623986 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d1dd73d3c2459da61e680554b00139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.624789 11214 tablet_service.cc:1511] Processing CreateTablet for tablet ccbe85e25ce94070b0f8bd1e2f6adb2a (DEFAULT_TABLE table=default.Table_42510f9b2fb7457cb365f2539885131e [id=5514e95d6b764fcf8c64c8ddc8e0b3c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.625327 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbe85e25ce94070b0f8bd1e2f6adb2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.626447 11755 tablet_bootstrap.cc:492] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:15.633625 11755 ts_tablet_manager.cc:1403] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.048s user 0.004s sys 0.000s
I20260925 01:50:15.634814 11221 tablet_service.cc:1511] Processing CreateTablet for tablet 57a16e11801146b7b17cd6cf1d91dc76 (DEFAULT_TABLE table=default.Table_1ce201094f214585996cc8cce5f9010d [id=3cd687eb2ff74fe5a8b83bb60dde7856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.635018 11210 tablet_service.cc:1558] Processing DeleteTablet for tablet e6b97d37704f4a0d88457d124bb4f259 with delete_type TABLET_DATA_DELETED (replaced by tablet 73c6a6781be8487d8d6b0112fbbdd3c9) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.635262 11213 tablet_service.cc:1558] Processing DeleteTablet for tablet c86a78873e8847fa95bead4774bea606 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.635327 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet a07f977c6a00450a8e8ceb6580dab980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.635465 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet e3b08f61aaf5442889011fe309dea835 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.635618 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 70c94e791a494eb580253e0c8e0fa56a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.635769 11207 tablet_service.cc:1558] Processing DeleteTablet for tablet 5122b8c24d3442a1a52ff0b003d65ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:07 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.635938 11217 tablet_service.cc:1558] Processing DeleteTablet for tablet 811b957c4e6647ccaa688d7273ec9eeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.636035 11205 tablet_service.cc:1558] Processing DeleteTablet for tablet 1602d22ad10f45d592c79e0d2affb2ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:14 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.635258 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57a16e11801146b7b17cd6cf1d91dc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.636353 11511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4f1e725fe84552943563aa95687842" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:15.636590 11511 raft_consensus.cc:3060] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.636663 11216 tablet_service.cc:1558] Processing DeleteTablet for tablet a8055cc9b06045449e6133298c8074e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:15.637132 11755 raft_consensus.cc:359] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.639945 11511 raft_consensus.cc:2468] T 9c4f1e725fe84552943563aa95687842 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:15.579953 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1027) took 2636 ms. Trace:
I20260925 01:50:15.640971 13356 rpcz_store.cc:276] 0925 01:50:12.943211 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.943264 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:15.106524 (+2163260us) ts_tablet_manager.cc:1151] Deleting tablet 81024a75b31e45e098d108bae4cc17c9
0925 01:50:15.106538 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.264198 (+157660us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.449373 (+185175us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.579934 (+130561us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35032,"tablet-delete.queue_time_us":2163049}
I20260925 01:50:15.641489 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1028) took 2549 ms. Trace:
I20260925 01:50:15.641583 13356 rpcz_store.cc:276] 0925 01:50:13.091750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.091826 (+ 76us) service_pool.cc:224] Handling call
0925 01:50:15.641332 (+2549506us) ts_tablet_manager.cc:1151] Deleting tablet 915b1621cea64c03bd486ef32e815f5f
0925 01:50:15.641345 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.641468 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2549297}
I20260925 01:50:15.641688 11755 raft_consensus.cc:385] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.641776 13632 raft_consensus.cc:493] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.641883 13356 tablet_replica.cc:333] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:15.641919 13632 raft_consensus.cc:515] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.642129 13356 raft_consensus.cc:2243] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:15.642163 11755 raft_consensus.cc:740] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.642418 13356 pending_rounds.cc:70] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:15.642490 13356 pending_rounds.cc:77] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072949630500864 op_type: NO_OP noop_request { }
I20260925 01:50:15.642588 13356 raft_consensus.cc:2889] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:15.642613 13632 leader_election.cc:290] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.642675 13356 raft_consensus.cc:2272] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.643103 13656 tablet.cc:1751] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:15.646284 13637 tablet.cc:1751] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:15.651859 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5122b8c24d3442a1a52ff0b003d65ffb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:15.652437 11177 leader_election.cc:343] T 5122b8c24d3442a1a52ff0b003d65ffb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.655026 13356 ts_tablet_manager.cc:1916] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.654973 13637 tablet.cc:1751] T 48bd9071170d4f6f9ac4039020de5c00 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:15.655916 13656 tablet.cc:1751] T 48bd9071170d4f6f9ac4039020de5c00 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:15.642927 11755 consensus_queue.cc:260] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.659680 11755 ts_tablet_manager.cc:1434] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260925 01:50:15.672150 11673 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1a952a0b0caf4fec81d7f1cecb5eb9c5" } modify_external_catalogs: true
I20260925 01:50:15.672339 11673 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_1a952a0b0caf4fec81d7f1cecb5eb9c5" } modify_external_catalogs: true
W20260925 01:50:15.678821 11680 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d77dac40ea344d78829e7a59b7f6dec4 consensus state has no leader
I20260925 01:50:15.679435 11754 tablet_bootstrap.cc:492] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:15.679584 11754 ts_tablet_manager.cc:1403] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.131s user 0.002s sys 0.000s
I20260925 01:50:15.680228 11754 raft_consensus.cc:359] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.680526 11754 raft_consensus.cc:385] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.680576 11754 raft_consensus.cc:740] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.680748 11754 consensus_queue.cc:260] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.681313 11754 ts_tablet_manager.cc:1434] T 5e6715233be44b9aad5210d17500f59d P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:15.681589 11754 tablet_bootstrap.cc:492] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:15.683158 11754 tablet_bootstrap.cc:654] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.684466 13452 raft_consensus.cc:493] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.684629 13452 raft_consensus.cc:515] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.685238 13452 leader_election.cc:290] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:15.687081 11314 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
W20260925 01:50:15.687577 11314 leader_election.cc:343] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:15.687704 11314 leader_election.cc:304] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.687966 13452 raft_consensus.cc:2749] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:15.696103 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7347b31f782c4508b004c7523dc11dbb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:15.696321 11519 raft_consensus.cc:2468] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:15.697690 13632 raft_consensus.cc:493] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.697856 13632 raft_consensus.cc:515] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.698547 13632 leader_election.cc:290] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.699447 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8055cc9b06045449e6133298c8074e1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:15.700009 11177 leader_election.cc:343] T a8055cc9b06045449e6133298c8074e1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.708292 11680 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_28b35d15250242b4b53514812418ac09" } modify_external_catalogs: true
I20260925 01:50:15.708504 11680 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_28b35d15250242b4b53514812418ac09" } modify_external_catalogs: true
I20260925 01:50:15.709192 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3572f8f700844070919dafb22da6d277"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.709774 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3572f8f700844070919dafb22da6d277 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.711315 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_4f04d8a8129f4449af2863275c6f337e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:15.711901 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f04d8a8129f4449af2863275c6f337e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.717293 11753 tablet_bootstrap.cc:492] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:15.717506 11753 ts_tablet_manager.cc:1403] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.168s user 0.003s sys 0.007s
I20260925 01:50:15.718269 11753 raft_consensus.cc:359] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.718559 11753 raft_consensus.cc:385] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.718662 11753 raft_consensus.cc:740] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.718961 11753 consensus_queue.cc:260] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.719545 11753 ts_tablet_manager.cc:1434] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:15.722325 11753 tablet_bootstrap.cc:492] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:15.722990 11953 ts_tablet_manager.cc:1929] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.723137 11953 log.cc:1199] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/d7f97ead49634bf6b03e292544af4d07
I20260925 01:50:15.723482 11953 ts_tablet_manager.cc:1950] T d7f97ead49634bf6b03e292544af4d07 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:15.724005 13356 ts_tablet_manager.cc:1929] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:15.724184 11753 tablet_bootstrap.cc:654] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.729264 13356 log.cc:1199] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/5048a0fca2e64ffa9f19000f48a4c090
I20260925 01:50:15.729808 13356 ts_tablet_manager.cc:1950] T 5048a0fca2e64ffa9f19000f48a4c090 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:15.733784 11946 ts_tablet_manager.cc:1929] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.733901 11946 log.cc:1199] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/0b92054aaa704c7ebd6b075c30db2616
I20260925 01:50:15.734227 11946 ts_tablet_manager.cc:1950] T 0b92054aaa704c7ebd6b075c30db2616 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:15.735049 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 987) took 3068 ms. Trace:
I20260925 01:50:15.735144 11946 rpcz_store.cc:276] 0925 01:50:12.666831 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.667853 (+ 1022us) service_pool.cc:224] Handling call
0925 01:50:15.579058 (+2911205us) ts_tablet_manager.cc:1151] Deleting tablet 0b92054aaa704c7ebd6b075c30db2616
0925 01:50:15.579070 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.691306 (+112236us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.733729 (+ 42423us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.735030 (+ 1301us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2900871}
I20260925 01:50:15.735618 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 0b92054aaa704c7ebd6b075c30db2616 (table default.Table_17e3438d1c3f4f16b6d2239eda8e5844 [id=a5bd4c860d4a438caec8cb47b396f3fa]) successfully deleted
I20260925 01:50:15.735870 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1029) took 2623 ms. Trace:
I20260925 01:50:15.739575 13356 rpcz_store.cc:276] 0925 01:50:13.112838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.112899 (+ 61us) service_pool.cc:224] Handling call
0925 01:50:15.641834 (+2528935us) ts_tablet_manager.cc:1151] Deleting tablet 5048a0fca2e64ffa9f19000f48a4c090
0925 01:50:15.641845 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.698505 (+ 56660us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.723933 (+ 25428us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.735848 (+ 11915us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11780,"tablet-delete.queue_time_us":2528728}
I20260925 01:50:15.741001 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1032) took 2566 ms. Trace:
I20260925 01:50:15.741627 11176 leader_election.cc:304] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.742383 13356 rpcz_store.cc:276] 0925 01:50:13.174369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.174439 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:15.740853 (+2566414us) ts_tablet_manager.cc:1151] Deleting tablet d0edb8007afa42c6af8b289ff9cea830
0925 01:50:15.740863 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.740981 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2566230}
I20260925 01:50:15.742726 13626 raft_consensus.cc:2804] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.742772 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1030) took 2568 ms. Trace:
I20260925 01:50:15.742803 13626 raft_consensus.cc:493] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:15.742868 13626 raft_consensus.cc:3060] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.742835 13356 rpcz_store.cc:276] 0925 01:50:13.174053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.176920 (+ 2867us) service_pool.cc:224] Handling call
0925 01:50:15.742651 (+2565731us) ts_tablet_manager.cc:1151] Deleting tablet d08b978d9b2945ffa966e2237bddd48c
0925 01:50:15.742662 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.742756 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2565537}
I20260925 01:50:15.743186 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1031) took 2569 ms. Trace:
I20260925 01:50:15.743245 13356 rpcz_store.cc:276] 0925 01:50:13.174193 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.177153 (+ 2960us) service_pool.cc:224] Handling call
0925 01:50:15.743087 (+2565934us) ts_tablet_manager.cc:1151] Deleting tablet 5276072bbeca403fb06566b4a43489a0
0925 01:50:15.743097 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.743171 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2565784}
I20260925 01:50:15.743536 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1033) took 2486 ms. Trace:
I20260925 01:50:15.743595 13356 rpcz_store.cc:276] 0925 01:50:13.257508 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.257570 (+ 62us) service_pool.cc:224] Handling call
0925 01:50:15.743448 (+2485878us) ts_tablet_manager.cc:1151] Deleting tablet 38249392c0df4d50b0e09f3671f92800
0925 01:50:15.743456 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.743519 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2485699}
I20260925 01:50:15.743815 13356 tablet_replica.cc:333] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:15.744032 13356 raft_consensus.cc:2243] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.744189 13356 raft_consensus.cc:2272] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.745841 13626 raft_consensus.cc:515] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.747262 13626 leader_election.cc:290] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.748294 13356 ts_tablet_manager.cc:1916] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.749440 11176 leader_election.cc:304] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.753976 11675 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:15.754223 13209 raft_consensus.cc:493] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.754354 13209 raft_consensus.cc:515] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.754674 11679 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_de000ba4ea5a41d4a139b9c75e308212 [id=4ae41188fe5546918a2ec8cfb40e6ebc] alter complete (version 3)
I20260925 01:50:15.754945 13209 leader_election.cc:290] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.755084 11679 master_service.cc:960] ReplaceTablet: received request to replace tablet 81c2d13ee77945f6a993ba99d57b5427 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:15.755568 13626 raft_consensus.cc:2804] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.755856 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_3f086080b9334a1388185e942992e65d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:15.756248 13626 raft_consensus.cc:493] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 01:50:15.756387 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f086080b9334a1388185e942992e65d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.756446 13626 raft_consensus.cc:3060] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.759801 13626 raft_consensus.cc:515] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.760032 11676 catalog_manager.cc:2546] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_802f781d29a44950921e75c254835e2a" } modify_external_catalogs: true
I20260925 01:50:15.760198 11676 catalog_manager.cc:2794] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_802f781d29a44950921e75c254835e2a" } modify_external_catalogs: true
I20260925 01:50:15.761102 13626 leader_election.cc:290] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.769069 13356 ts_tablet_manager.cc:1929] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.772253 13356 log.cc:1199] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/86c8c3bba9614539bfe3018461ad21f8
I20260925 01:50:15.772677 13356 ts_tablet_manager.cc:1950] T 86c8c3bba9614539bfe3018461ad21f8 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:15.773531 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1034) took 2459 ms. Trace:
I20260925 01:50:15.776774 13356 rpcz_store.cc:276] 0925 01:50:13.314299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.314492 (+ 193us) service_pool.cc:224] Handling call
0925 01:50:15.743778 (+2429286us) ts_tablet_manager.cc:1151] Deleting tablet 86c8c3bba9614539bfe3018461ad21f8
0925 01:50:15.743785 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.765509 (+ 21724us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.769013 (+ 3504us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.773513 (+ 4500us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2389925}
I20260925 01:50:15.777307 13356 tablet_replica.cc:333] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:15.777473 11753 tablet_bootstrap.cc:492] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:15.777580 13356 raft_consensus.cc:2243] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:15.777742 11753 ts_tablet_manager.cc:1403] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260925 01:50:15.777848 13356 pending_rounds.cc:70] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:15.777951 13356 pending_rounds.cc:77] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072950774317056 op_type: NO_OP noop_request { }
I20260925 01:50:15.778080 13356 raft_consensus.cc:2889] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:15.778173 13356 raft_consensus.cc:2272] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.778718 13356 ts_tablet_manager.cc:1916] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.778869 11753 raft_consensus.cc:359] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.779093 11753 raft_consensus.cc:385] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.779199 11753 raft_consensus.cc:740] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.779476 11753 consensus_queue.cc:260] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.780905 11755 tablet_bootstrap.cc:492] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:15.786136 11378 raft_consensus.cc:3060] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.787304 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
I20260925 01:50:15.793300 11753 ts_tablet_manager.cc:1434] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260925 01:50:15.790778 11672 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_2dbdc5ea9a1a428f993b071f95f0f9ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:15.793659 11753 tablet_bootstrap.cc:492] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:15.793869 11672 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dbdc5ea9a1a428f993b071f95f0f9ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:15.771535 11176 leader_election.cc:304] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.794381 13626 raft_consensus.cc:2804] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.794523 13626 raft_consensus.cc:493] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:15.794589 13626 raft_consensus.cc:3060] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.800465 13626 raft_consensus.cc:515] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.791342 11671 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_aff4f0f44c1f482b996bba5360da5424" } new_table_name: "default.Table_0fd53fb59a4741af9ea7e0f1f3e5cd28" modify_external_catalogs: true
I20260925 01:50:15.808509 11176 leader_election.cc:304] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.808926 13209 raft_consensus.cc:2804] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:15.809022 13209 raft_consensus.cc:493] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:15.809084 13209 raft_consensus.cc:3060] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:15.809401 11176 leader_election.cc:304] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.809674 13632 raft_consensus.cc:2804] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:15.812314 13209 raft_consensus.cc:515] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.813637 13209 leader_election.cc:290] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.809077 13356 ts_tablet_manager.cc:1929] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:15.816507 13356 log.cc:1199] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/329a5af9fb654d4c894e1cf4fd636c13
I20260925 01:50:15.817088 13356 ts_tablet_manager.cc:1950] T 329a5af9fb654d4c894e1cf4fd636c13 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:15.817807 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet abcb285ebc1a4bfd8317546823e01b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.817968 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 70f4777a789a48a18cfadbfb9d49a708 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.817965 11678 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_f48f8686b328486f968b63c037efe02e" } new_table_name: "default.Table_ea40c7c49471478c9862109f5f22792d" modify_external_catalogs: true
I20260925 01:50:15.818205 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.819088 13662 raft_consensus.cc:493] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.820868 13662 raft_consensus.cc:515] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.822234 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb285ebc1a4bfd8317546823e01b09" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.822619 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1035) took 2507 ms. Trace:
W20260925 01:50:15.822930 11456 leader_election.cc:343] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.827984 13356 rpcz_store.cc:276] 0925 01:50:13.315611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.315677 (+ 66us) service_pool.cc:224] Handling call
0925 01:50:15.777255 (+2461578us) ts_tablet_manager.cc:1151] Deleting tablet 329a5af9fb654d4c894e1cf4fd636c13
0925 01:50:15.777267 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.802957 (+ 25690us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.809016 (+ 6059us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.822603 (+ 13587us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2423319}
I20260925 01:50:15.829380 13356 tablet_replica.cc:333] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:15.829743 13356 raft_consensus.cc:2243] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.829944 13356 raft_consensus.cc:2272] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.832209 13662 leader_election.cc:290] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.832615 13356 ts_tablet_manager.cc:1916] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.833169 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113d7ccee4e349e19d3948e09d2c533d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:15.836593 11365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40083a885974e3595ec2fb5b16d4a5d" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:15.837034 11177 leader_election.cc:343] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:15.837237 11177 leader_election.cc:343] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.837286 11361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811b957c4e6647ccaa688d7273ec9eeb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:15.837759 11177 leader_election.cc:343] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.838096 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33967e5e11524b78bb86ce7a3e2e16ad" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:15.838967 11177 leader_election.cc:343] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.840557 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e28aeabdf724784b8ed27535ea0701b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:15.841715 13626 leader_election.cc:290] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.842617 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 818a792969a245f5b0fe5f80128206ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.843027 11946 tablet_replica.cc:333] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:15.843245 11946 raft_consensus.cc:2243] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.843441 11946 raft_consensus.cc:2272] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.843987 11946 ts_tablet_manager.cc:1916] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:15.844720 11177 leader_election.cc:343] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.846168 13452 raft_consensus.cc:493] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.847076 11753 tablet_bootstrap.cc:654] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.847779 11176 leader_election.cc:304] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.848552 11674 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 0226f482c8ff49ce976490e6aadfcee4
I20260925 01:50:15.852912 11754 tablet_bootstrap.cc:492] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:15.854703 11754 ts_tablet_manager.cc:1403] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.173s user 0.004s sys 0.000s
I20260925 01:50:15.855613 11754 raft_consensus.cc:359] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.855804 11754 raft_consensus.cc:385] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.855901 11754 raft_consensus.cc:740] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.856127 11754 consensus_queue.cc:260] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.856693 11754 ts_tablet_manager.cc:1434] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:15.857015 11754 tablet_bootstrap.cc:492] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:15.859341 11754 tablet_bootstrap.cc:654] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.863245 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abcb285ebc1a4bfd8317546823e01b09" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:15.866446 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 0226f482c8ff49ce976490e6aadfcee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.868326 11674 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_3f06c30890b148468b29c92d1e399bbd" } new_table_name: "default.Table_e4708ca2b1474b5094f9af58c2a8bed7" modify_external_catalogs: true
I20260925 01:50:15.870481 13452 raft_consensus.cc:515] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.871541 11754 tablet_bootstrap.cc:492] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:15.871711 11754 ts_tablet_manager.cc:1403] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260925 01:50:15.873142 13356 ts_tablet_manager.cc:1929] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:15.873333 13356 log.cc:1199] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/0e3ba459a81845699435c2e44f5c9f19
I20260925 01:50:15.873733 13356 ts_tablet_manager.cc:1950] T 0e3ba459a81845699435c2e44f5c9f19 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:15.851365 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 0226f482c8ff49ce976490e6aadfcee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:15.864008 11457 leader_election.cc:343] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.875753 11457 leader_election.cc:304] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.876742 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1036) took 2560 ms. Trace:
I20260925 01:50:15.876865 13662 raft_consensus.cc:2749] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.874524 13209 raft_consensus.cc:2804] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:15.879331 13209 raft_consensus.cc:697] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:15.879618 13209 consensus_queue.cc:237] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.883968 11353 tablet_service.cc:1511] Processing CreateTablet for tablet f677c82ee0654024b604eca7c255bb20 (DEFAULT_TABLE table=default.Table_dac2652a538c4e93a7587d1b9d268fdf [id=c3292e00b7bc409a9b2f10839d10ce76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.884089 11503 tablet_service.cc:1511] Processing CreateTablet for tablet f677c82ee0654024b604eca7c255bb20 (DEFAULT_TABLE table=default.Table_dac2652a538c4e93a7587d1b9d268fdf [id=c3292e00b7bc409a9b2f10839d10ce76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.884507 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f677c82ee0654024b604eca7c255bb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.886349 13452 leader_election.cc:290] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:15.889513 11755 tablet_bootstrap.cc:654] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:15.889986 11176 leader_election.cc:304] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.890590 11176 leader_election.cc:304] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:15.891330 11314 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 06fca09010f841c5a7b58678560065f3
I20260925 01:50:15.898151 11673 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 679cbe0cc09b47938f60959d845d1767
I20260925 01:50:15.898151 13411 raft_consensus.cc:493] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.898331 13411 raft_consensus.cc:515] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.899657 10879 master-stress-test.cc:579] Killing test thread 1/25
I20260925 01:50:15.906375 10879 master-stress-test.cc:581] Killed test thread 1/25
I20260925 01:50:15.906497 10879 master-stress-test.cc:579] Killing test thread 2/25
I20260925 01:50:15.906576 10879 master-stress-test.cc:581] Killed test thread 2/25
I20260925 01:50:15.906625 10879 master-stress-test.cc:579] Killing test thread 3/25
I20260925 01:50:15.907567 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 755) took 8920 ms. Trace:
I20260925 01:50:15.907711 11953 rpcz_store.cc:276] 0925 01:50:06.973574 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:06.973636 (+ 62us) service_pool.cc:224] Handling call
0925 01:50:15.608597 (+8634961us) ts_tablet_manager.cc:1151] Deleting tablet d7f97ead49634bf6b03e292544af4d07
0925 01:50:15.608607 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.627237 (+ 18630us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.722894 (+ 95657us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.894346 (+171452us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8634761}
I20260925 01:50:15.908272 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 772) took 8503 ms. Trace:
I20260925 01:50:15.908386 11953 rpcz_store.cc:276] 0925 01:50:07.405052 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.405182 (+ 130us) service_pool.cc:224] Handling call
0925 01:50:15.908075 (+8502893us) ts_tablet_manager.cc:1151] Deleting tablet cea3ad181ffa42d694a609bf99001c75
0925 01:50:15.908090 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.908218 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8502469}
I20260925 01:50:15.908670 13452 raft_consensus.cc:493] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.908778 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 775) took 8431 ms. Trace:
I20260925 01:50:15.910696 11176 leader_election.cc:304] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:15.891661 13632 raft_consensus.cc:697] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:15.911202 13632 consensus_queue.cc:237] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.890844 13672 raft_consensus.cc:2804] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:15.912462 13672 raft_consensus.cc:697] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:15.912863 13672 consensus_queue.cc:237] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.915769 13669 raft_consensus.cc:2804] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:15.915993 13669 raft_consensus.cc:697] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:15.916369 13669 consensus_queue.cc:237] T 728157ec17ed4df5a4a8559df6c1ac78 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.918493 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f677c82ee0654024b604eca7c255bb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.908857 13452 raft_consensus.cc:515] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.919126 13452 leader_election.cc:290] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:15.919703 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 679cbe0cc09b47938f60959d845d1767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:15.919978 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet d7f97ead49634bf6b03e292544af4d07 (table default.Table_0e71b8f12efa4591b712a486be4752b9 [id=a0cfa508705d43c0b763a35cf3b1f3c4]) successfully deleted
W20260925 01:50:15.920252 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet cea3ad181ffa42d694a609bf99001c75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cea3ad181ffa42d694a609bf99001c75 already in progress: creating tablet
I20260925 01:50:15.922801 11673 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:15.924603 11953 rpcz_store.cc:276] 0925 01:50:07.477083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.477148 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:15.908640 (+8431492us) ts_tablet_manager.cc:1151] Deleting tablet 5122b8c24d3442a1a52ff0b003d65ffb
0925 01:50:15.908650 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.908732 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8431289}
W20260925 01:50:15.925259 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5122b8c24d3442a1a52ff0b003d65ffb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5122b8c24d3442a1a52ff0b003d65ffb already in progress: creating tablet
I20260925 01:50:15.926258 11346 tablet_service.cc:1511] Processing CreateTablet for tablet cbd54e9e0c23406b8949cc2cbfa8b89a (DEFAULT_TABLE table=default.Table_02d89a08fe85499db7ac1e181e841745 [id=a4dcb021a94a4a49868a671a61674843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.926750 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd54e9e0c23406b8949cc2cbfa8b89a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.926823 11314 leader_election.cc:343] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 06fca09010f841c5a7b58678560065f3
I20260925 01:50:15.926978 11314 leader_election.cc:304] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.928556 13452 raft_consensus.cc:2749] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.928699 11953 tablet_replica.cc:333] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:15.928951 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2de2c9e9db4d06bc76acf382cda5bf (DEFAULT_TABLE table=default.Table_9eb8e584d86641148b7287cd8bf0ccdb [id=d552efc7554c421b83e7d8506456724b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.930475 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2de2c9e9db4d06bc76acf382cda5bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:15.930542 11314 leader_election.cc:343] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 3d398851fb194c61a0a3b2c60c7a5e8b
I20260925 01:50:15.928952 11953 raft_consensus.cc:2243] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.934345 11953 raft_consensus.cc:2272] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.934942 11953 ts_tablet_manager.cc:1916] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.946691 13411 leader_election.cc:290] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:15.947765 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a78873e8847fa95bead4774bea606" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:15.948385 11456 leader_election.cc:343] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.950369 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a78873e8847fa95bead4774bea606" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:15.950989 11457 leader_election.cc:343] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.951113 11457 leader_election.cc:304] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:15.951292 11496 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2de2c9e9db4d06bc76acf382cda5bf (DEFAULT_TABLE table=default.Table_9eb8e584d86641148b7287cd8bf0ccdb [id=d552efc7554c421b83e7d8506456724b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:15.951718 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2de2c9e9db4d06bc76acf382cda5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:15.952057 13411 raft_consensus.cc:2749] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:15.952764 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 679cbe0cc09b47938f60959d845d1767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:15.873778 11754 raft_consensus.cc:359] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.956729 11754 raft_consensus.cc:385] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.956930 11754 raft_consensus.cc:740] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.957875 13356 rpcz_store.cc:276] 0925 01:50:13.316171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.316227 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:15.829323 (+2513096us) ts_tablet_manager.cc:1151] Deleting tablet 0e3ba459a81845699435c2e44f5c9f19
0925 01:50:15.829336 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.840848 (+ 11512us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.873065 (+ 32217us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:15.876681 (+ 3616us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2473058}
I20260925 01:50:15.959411 13356 tablet_replica.cc:333] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:15.961534 13411 raft_consensus.cc:493] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:15.961692 13411 raft_consensus.cc:515] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.962741 13411 leader_election.cc:290] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:15.962745 13356 raft_consensus.cc:2243] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:15.963063 13356 raft_consensus.cc:2272] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:15.963840 13356 ts_tablet_manager.cc:1916] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:15.958654 11754 consensus_queue.cc:260] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:15.966398 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7bac6e89b8405e8bd541eba6278a0b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:15.966745 11754 ts_tablet_manager.cc:1434] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.095s user 0.002s sys 0.001s
W20260925 01:50:15.967126 11456 leader_election.cc:343] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:15.967190 11754 tablet_bootstrap.cc:492] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:15.972913 11753 tablet_bootstrap.cc:492] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:15.973222 11753 ts_tablet_manager.cc:1403] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.180s user 0.005s sys 0.000s
I20260925 01:50:15.974131 11753 raft_consensus.cc:359] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.974395 11753 raft_consensus.cc:385] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:15.974519 11753 raft_consensus.cc:740] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:15.974807 11753 consensus_queue.cc:260] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:15.995839 11680 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 5d37a05d2bcd4c94ba51fef8096f889d
I20260925 01:50:16.001399 11946 ts_tablet_manager.cc:1929] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.001590 11946 log.cc:1199] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5e6715233be44b9aad5210d17500f59d
I20260925 01:50:16.001957 11946 ts_tablet_manager.cc:1950] T 5e6715233be44b9aad5210d17500f59d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.004848 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d37a05d2bcd4c94ba51fef8096f889d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.007822 11754 tablet_bootstrap.cc:654] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.009013 11680 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_45047ee3993f4d56830d4d28479fc138"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:16.009872 11680 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45047ee3993f4d56830d4d28479fc138 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:16.011770 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 985) took 3345 ms. Trace:
I20260925 01:50:16.012130 11496 tablet_service.cc:1558] Processing DeleteTablet for tablet 4930edeb2edd4e7494dbf1761b5d20c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.012967 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d37a05d2bcd4c94ba51fef8096f889d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:16.013434 11314 leader_election.cc:343] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 3d398851fb194c61a0a3b2c60c7a5e8b
I20260925 01:50:16.014258 13209 raft_consensus.cc:2804] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:16.014464 13209 raft_consensus.cc:493] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:16.014668 13209 raft_consensus.cc:3060] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.017781 13209 raft_consensus.cc:515] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.011875 11946 rpcz_store.cc:276] 0925 01:50:12.666668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.692975 (+ 26307us) service_pool.cc:224] Handling call
0925 01:50:15.842957 (+3149982us) ts_tablet_manager.cc:1151] Deleting tablet 5e6715233be44b9aad5210d17500f59d
0925 01:50:15.842971 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.955964 (+112993us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.001294 (+ 45330us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.011737 (+ 10443us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3149719}
I20260925 01:50:16.018944 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5e6715233be44b9aad5210d17500f59d (table default.Table_cc6c271622254896bab14472c1455e8f [id=55ffdd6e6ba74e3cae87646903fb68cf]) successfully deleted
W20260925 01:50:16.019474 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 108779us
I20260925 01:50:16.019636 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 998) took 3271 ms. Trace:
I20260925 01:50:16.020292 11946 rpcz_store.cc:276] 0925 01:50:12.748643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.801568 (+ 52925us) service_pool.cc:224] Handling call
0925 01:50:16.019450 (+3217882us) ts_tablet_manager.cc:1151] Deleting tablet 03487a3fa9574fd583d9c95d0624203c
0925 01:50:16.019469 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.019612 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3216288}
W20260925 01:50:16.021234 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 03487a3fa9574fd583d9c95d0624203c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03487a3fa9574fd583d9c95d0624203c already in progress: creating tablet
I20260925 01:50:16.021683 11946 tablet_replica.cc:333] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.022156 11946 raft_consensus.cc:2243] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.022668 11946 raft_consensus.cc:2272] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.023556 11946 ts_tablet_manager.cc:1916] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.026120 11314 leader_election.cc:304] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.026948 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd594870fa6a4ba190a18a48d821d72c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:16.027582 11177 leader_election.cc:343] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:16.027995 11176 consensus_peers.cc:597] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb -> Peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Couldn't send request to peer 514f31e4c2e54d9aaf6d4dd771d153b9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff70e44b72d1425c81751ff0b3d93b11. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:16.028359 11176 leader_election.cc:304] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:16.029032 11176 leader_election.cc:304] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:16.037364 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 73538.1us
I20260925 01:50:16.038327 13452 raft_consensus.cc:2749] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.042199 13662 raft_consensus.cc:493] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.042402 13662 raft_consensus.cc:515] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.043972 13662 leader_election.cc:290] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.045117 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc2c21fb6104d08b37d1c1f19aa3bf3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:16.047261 11457 leader_election.cc:343] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.053867 11496 tablet_service.cc:1511] Processing CreateTablet for tablet cbd54e9e0c23406b8949cc2cbfa8b89a (DEFAULT_TABLE table=default.Table_02d89a08fe85499db7ac1e181e841745 [id=a4dcb021a94a4a49868a671a61674843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.054395 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd54e9e0c23406b8949cc2cbfa8b89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.055440 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9eefafcf2e4f8c9056133e13140db7 (DEFAULT_TABLE table=default.Table_1047bf49907148c081b8098ab2ded503 [id=618fb4b601ed48219c7c454e601722d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.055821 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9eefafcf2e4f8c9056133e13140db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.053035 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7bac6e89b8405e8bd541eba6278a0b" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:16.062625 11457 leader_election.cc:343] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.062760 11457 leader_election.cc:304] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.063233 13411 raft_consensus.cc:2749] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.065966 11946 ts_tablet_manager.cc:1929] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.066103 11946 log.cc:1199] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/113d7ccee4e349e19d3948e09d2c533d
I20260925 01:50:16.066515 11946 ts_tablet_manager.cc:1950] T 113d7ccee4e349e19d3948e09d2c533d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.067281 13637 tablet.cc:1751] T 6386bd0cb4894068985fe152299f0b47 P aac4ec033f794d7a90b52aa4e0b6155d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:16.068696 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9eefafcf2e4f8c9056133e13140db7 (DEFAULT_TABLE table=default.Table_1047bf49907148c081b8098ab2ded503 [id=618fb4b601ed48219c7c454e601722d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.069154 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9eefafcf2e4f8c9056133e13140db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.082043 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1003) took 3123 ms. Trace:
I20260925 01:50:16.082185 11946 rpcz_store.cc:276] 0925 01:50:12.958911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.958964 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:16.021630 (+3062666us) ts_tablet_manager.cc:1151] Deleting tablet 113d7ccee4e349e19d3948e09d2c533d
0925 01:50:16.021641 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.061597 (+ 39956us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.065916 (+ 4319us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.082014 (+ 16098us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3062446}
I20260925 01:50:16.082612 11946 tablet_replica.cc:333] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.082861 11946 raft_consensus.cc:2243] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.083031 11946 raft_consensus.cc:2272] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.083730 11946 ts_tablet_manager.cc:1916] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.086803 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 113d7ccee4e349e19d3948e09d2c533d (table default.Table_f3e4b358fe414d429eeb14421237c8ac [id=c633dead809249008fc80c9f840f4ee0]) successfully deleted
I20260925 01:50:16.092319 13626 raft_consensus.cc:2804] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:16.092612 11755 tablet_bootstrap.cc:492] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.092671 13626 raft_consensus.cc:697] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:16.093096 13626 consensus_queue.cc:237] T 2a37a6deaeb24c99824b62fbb2d603b1 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.093688 11946 ts_tablet_manager.cc:1929] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.093833 11946 log.cc:1199] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/728157ec17ed4df5a4a8559df6c1ac78
I20260925 01:50:16.021106 13209 leader_election.cc:290] T bd594870fa6a4ba190a18a48d821d72c P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.095388 11755 ts_tablet_manager.cc:1403] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.353s user 0.014s sys 0.001s
I20260925 01:50:16.029440 13672 raft_consensus.cc:2804] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:16.043627 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fc2c21fb6104d08b37d1c1f19aa3bf3" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:16.063041 11175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260925 01:50:16.096736 11456 leader_election.cc:343] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.096949 11456 leader_election.cc:304] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.097460 13586 raft_consensus.cc:2749] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.097954 11755 raft_consensus.cc:359] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.098278 11755 raft_consensus.cc:385] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.098400 13672 raft_consensus.cc:697] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:16.098450 11755 raft_consensus.cc:740] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.098822 11755 consensus_queue.cc:260] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.098894 13672 consensus_queue.cc:237] T 0b92054aaa704c7ebd6b075c30db2616 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.099622 11755 ts_tablet_manager.cc:1434] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260925 01:50:16.106546 11946 ts_tablet_manager.cc:1950] T 728157ec17ed4df5a4a8559df6c1ac78 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.108741 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1004) took 3149 ms. Trace:
I20260925 01:50:16.108951 11946 rpcz_store.cc:276] 0925 01:50:12.959386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.959429 (+ 43us) service_pool.cc:224] Handling call
0925 01:50:16.082547 (+3123118us) ts_tablet_manager.cc:1151] Deleting tablet 728157ec17ed4df5a4a8559df6c1ac78
0925 01:50:16.082557 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.088989 (+ 6432us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.093620 (+ 4631us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.108715 (+ 15095us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3122927}
I20260925 01:50:16.109581 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 728157ec17ed4df5a4a8559df6c1ac78 (table default.Table_b51b36266e424f8fa78dbf4ac8180c71 [id=c9e6146deaba4cb5b413613ca81a419d]) successfully deleted
I20260925 01:50:16.110045 11946 tablet_replica.cc:333] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.110375 11946 raft_consensus.cc:2243] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.110617 11946 raft_consensus.cc:2272] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.111256 11946 ts_tablet_manager.cc:1916] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.111747 11679 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 81c2d13ee77945f6a993ba99d57b5427
I20260925 01:50:16.112262 11679 catalog_manager.cc:6934] ReplaceTablet: tablet 81c2d13ee77945f6a993ba99d57b5427 deleted and replaced by tablet a94a08841e4f4e7fb1513d3c674ea380
I20260925 01:50:16.116514 11346 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c2d13ee77945f6a993ba99d57b5427 with delete_type TABLET_DATA_DELETED (replaced by tablet a94a08841e4f4e7fb1513d3c674ea380) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.118944 11755 tablet_bootstrap.cc:492] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.120244 11679 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 6386bd0cb4894068985fe152299f0b47 (table default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621]). Expected version 1 got 0
I20260925 01:50:16.121192 11679 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_a5cb51f2c7664220b18c70d38bcb6928" } new_table_name: "default.Table_8da54c2e320949509f1fb2a34f870c06" modify_external_catalogs: true
I20260925 01:50:16.122143 11953 ts_tablet_manager.cc:1929] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.122408 11953 log.cc:1199] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/24cd89d238bf4220a48ecdf59cca5e6d
I20260925 01:50:16.122980 11953 ts_tablet_manager.cc:1950] T 24cd89d238bf4220a48ecdf59cca5e6d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:16.123615 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c2d13ee77945f6a993ba99d57b5427 with delete_type TABLET_DATA_DELETED (replaced by tablet a94a08841e4f4e7fb1513d3c674ea380) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.133626 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 83c69194c062411db10113b63f6be92c
I20260925 01:50:16.134498 11677 master_service.cc:960] ReplaceTablet: received request to replace tablet a39d277b58664b5d9b06c22545da03c8 from {username='slave'} at 127.0.0.1:60372
W20260925 01:50:16.134502 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 105436us
I20260925 01:50:16.135041 11176 leader_election.cc:304] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:16.136173 13209 raft_consensus.cc:2804] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:16.136760 13209 raft_consensus.cc:493] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:16.134635 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 83c69194c062411db10113b63f6be92c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.138907 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 774) took 8662 ms. Trace:
I20260925 01:50:16.139042 11953 rpcz_store.cc:276] 0925 01:50:07.476929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.477376 (+ 447us) service_pool.cc:224] Handling call
0925 01:50:15.924952 (+8447576us) ts_tablet_manager.cc:1151] Deleting tablet 24cd89d238bf4220a48ecdf59cca5e6d
0925 01:50:15.924963 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:15.941864 (+ 16901us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.122017 (+180153us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.138868 (+ 16851us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8447414}
I20260925 01:50:16.139598 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 24cd89d238bf4220a48ecdf59cca5e6d (table default.Table_9704bbf8ddbe4f129bccb5a8e30be536 [id=462de86042324bc49bf8949a13d0fec2]) successfully deleted
I20260925 01:50:16.140003 11953 tablet_replica.cc:333] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:16.140355 11953 raft_consensus.cc:2243] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.148303 11946 ts_tablet_manager.cc:1929] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.152891 13209 raft_consensus.cc:3060] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.153257 11946 log.cc:1199] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8e28aeabdf724784b8ed27535ea0701b
I20260925 01:50:16.153702 11946 ts_tablet_manager.cc:1950] T 8e28aeabdf724784b8ed27535ea0701b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.154626 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1005) took 3195 ms. Trace:
I20260925 01:50:16.154919 11946 rpcz_store.cc:276] 0925 01:50:12.959503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.959585 (+ 82us) service_pool.cc:224] Handling call
0925 01:50:16.109970 (+3150385us) ts_tablet_manager.cc:1151] Deleting tablet 8e28aeabdf724784b8ed27535ea0701b
0925 01:50:16.109983 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.140248 (+ 30265us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.148228 (+ 7980us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.154605 (+ 6377us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3150163}
I20260925 01:50:16.155500 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8e28aeabdf724784b8ed27535ea0701b (table default.Table_d9ec82d6876c42f4ba2646cb90d5c35b [id=8713b7aabc1a423fa360ce93bc949629]) successfully deleted
I20260925 01:50:16.156071 11946 tablet_replica.cc:333] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.156109 13209 raft_consensus.cc:515] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.156428 11946 raft_consensus.cc:2243] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.156632 11946 raft_consensus.cc:2272] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.157294 11946 ts_tablet_manager.cc:1916] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.162648 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 83c69194c062411db10113b63f6be92c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.169831 11753 ts_tablet_manager.cc:1434] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.196s user 0.001s sys 0.000s
I20260925 01:50:16.170251 11753 tablet_bootstrap.cc:492] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:16.171993 11753 tablet_bootstrap.cc:654] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.142566 11755 tablet_bootstrap.cc:654] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.146087 13452 raft_consensus.cc:493] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.174013 13452 raft_consensus.cc:515] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.174845 13452 leader_election.cc:290] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:16.157476 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a00b69e42e1465981d6c3eec217393f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:16.175638 11177 leader_election.cc:343] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:16.176417 11314 leader_election.cc:343] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 31353cc95e014e5bb24e5e5cefab1503
I20260925 01:50:16.177632 11953 raft_consensus.cc:2272] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.178907 11953 ts_tablet_manager.cc:1916] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:16.179708 11314 leader_election.cc:343] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 31353cc95e014e5bb24e5e5cefab1503
I20260925 01:50:16.179824 11314 leader_election.cc:304] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.180279 13452 raft_consensus.cc:2749] T 31353cc95e014e5bb24e5e5cefab1503 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.180382 11755 tablet_bootstrap.cc:492] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.180506 11755 ts_tablet_manager.cc:1403] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.003s
I20260925 01:50:16.181308 11755 raft_consensus.cc:359] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.181556 11755 raft_consensus.cc:385] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.181653 11755 raft_consensus.cc:740] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.182400 11755 consensus_queue.cc:260] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.182466 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 3c57266db845402ea98f080ef442ab4f (DEFAULT_TABLE table=default.Table_c0235a98cfd84c9280854f416f571e0e [id=74bbdb76644041f0828f0456f5c59f23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.182875 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c57266db845402ea98f080ef442ab4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.190649 11755 ts_tablet_manager.cc:1434] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:50:16.191067 11755 tablet_bootstrap.cc:492] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.192911 11755 tablet_bootstrap.cc:654] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:16.194348 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 58329.5us
I20260925 01:50:16.194958 11176 leader_election.cc:304] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:16.195364 13679 raft_consensus.cc:2804] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
W20260925 01:50:16.196918 11665 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 67ad5fb90dad4f869e87cfbb7717035e (table default.Table_489b7ad781074fb393d47d1a83599588 [id=52e166447f1840ea8f0b00cf195471f7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 67ad5fb90dad4f869e87cfbb7717035e consensus state has no leader
I20260925 01:50:16.206012 11176 leader_election.cc:304] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:16.219734 11953 ts_tablet_manager.cc:1929] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260925 01:50:16.219870 11953 log.cc:1199] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/0575861dd3d6437284cc183acb87af0a
I20260925 01:50:16.220252 11953 ts_tablet_manager.cc:1950] T 0575861dd3d6437284cc183acb87af0a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:16.220609 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 776) took 8743 ms. Trace:
I20260925 01:50:16.220702 11953 rpcz_store.cc:276] 0925 01:50:07.477226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.477581 (+ 355us) service_pool.cc:224] Handling call
0925 01:50:16.139928 (+8662347us) ts_tablet_manager.cc:1151] Deleting tablet 0575861dd3d6437284cc183acb87af0a
0925 01:50:16.139939 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.204920 (+ 64981us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.219664 (+ 14744us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.220588 (+ 924us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8662189}
I20260925 01:50:16.236680 11953 tablet_replica.cc:333] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:16.237025 11953 raft_consensus.cc:2243] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.237238 11953 raft_consensus.cc:2272] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.237927 11953 ts_tablet_manager.cc:1916] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:16.223461 13676 log.cc:927] Time spent T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb: Append to log took a long time: real 0.209s user 0.000s sys 0.000s
I20260925 01:50:16.239814 11176 leader_election.cc:304] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:16.240262 13669 raft_consensus.cc:2804] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:16.240386 13669 raft_consensus.cc:493] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:16.240483 13669 raft_consensus.cc:3060] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.244131 13669 raft_consensus.cc:515] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.246025 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341dca6f396449daadcaf8bbb77ed04b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
W20260925 01:50:16.246748 11177 leader_election.cc:343] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.247077 13669 leader_election.cc:290] T 341dca6f396449daadcaf8bbb77ed04b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.248034 13669 raft_consensus.cc:2804] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election won for term 1
I20260925 01:50:16.248277 13669 raft_consensus.cc:697] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:16.248716 13669 consensus_queue.cc:237] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.233744 13209 leader_election.cc:290] T 8a00b69e42e1465981d6c3eec217393f P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.233326 13356 ts_tablet_manager.cc:1929] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.254671 13356 log.cc:1199] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/4f19bccf3c5540cb828ec7bfc89a1c17
I20260925 01:50:16.255210 13356 ts_tablet_manager.cc:1950] T 4f19bccf3c5540cb828ec7bfc89a1c17 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:16.256191 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1037) took 2938 ms. Trace:
I20260925 01:50:16.256381 13356 rpcz_store.cc:276] 0925 01:50:13.317351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.317414 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:15.959207 (+2641793us) ts_tablet_manager.cc:1151] Deleting tablet 4f19bccf3c5540cb828ec7bfc89a1c17
0925 01:50:15.959219 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.229329 (+270110us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.232933 (+ 3604us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.256148 (+ 23215us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2602921}
I20260925 01:50:16.256923 13356 tablet_replica.cc:333] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:16.257196 13356 raft_consensus.cc:2243] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:16.257575 13356 pending_rounds.cc:70] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Trying to abort 1 pending ops.
I20260925 01:50:16.257712 13356 pending_rounds.cc:77] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072951260282880 op_type: NO_OP noop_request { }
I20260925 01:50:16.257885 13356 raft_consensus.cc:2889] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:16.258077 13356 raft_consensus.cc:2272] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.258725 13356 ts_tablet_manager.cc:1916] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.264835 11360 tablet_service.cc:1511] Processing CreateTablet for tablet bfa644147a2848508ad2449642fc26bf (DEFAULT_TABLE table=default.Table_5d6ca05ed4c34a6eb0d256874587bbdc [id=da87cf0660954d4c9900bdc802dd1374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.265300 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa644147a2848508ad2449642fc26bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.271013 11346 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd4701a82e5458f957e5a2760deec64 (DEFAULT_TABLE table=default.Table_d5b337fd8b9e4144a43f8e4e2fdcd47f [id=f080e43efd2d4d3583aed39b990aa2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.271287 11359 tablet_service.cc:1511] Processing CreateTablet for tablet d65a662583cf4029a60098d1f742984b (DEFAULT_TABLE table=default.Table_984614b000d54d07bed18722acbd3ea8 [id=75602bd9eb9743198fb700841658c56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.271433 11358 tablet_service.cc:1511] Processing CreateTablet for tablet e68eedccfe874307a451e496262cf39b (DEFAULT_TABLE table=default.Table_02b8ee20c5a444adb0a04e5d84832388 [id=4849773d7cb44ac7b1128536258956be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.271736 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcb755b54004ffdbd9aac6594b4d26f (DEFAULT_TABLE table=default.Table_d12ae3dd5f37487295db3494777287c3 [id=c507bd8e7910476782a4b5e21f56d40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.271883 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd4701a82e5458f957e5a2760deec64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.272050 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 81fcd78500ef4c6ab84b2f93a18f6d8d (DEFAULT_TABLE table=default.Table_5b7699461f464ddaa5c53e91987897d0 [id=066b9b4be20c483f8e5daccd9b6e932e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.271483 11353 tablet_service.cc:1511] Processing CreateTablet for tablet a8bcfdf984d742a6b858e5ed263f1f82 (DEFAULT_TABLE table=default.Table_d7b95bb1d61b4d5cac9713b3ee125e24 [id=d314ea449ea5484ab9d7b6819625496f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.274580 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcb755b54004ffdbd9aac6594b4d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.274757 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fcd78500ef4c6ab84b2f93a18f6d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.278236 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8bcfdf984d742a6b858e5ed263f1f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.283234 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68eedccfe874307a451e496262cf39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.284693 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65a662583cf4029a60098d1f742984b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.290354 11676 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet fa4380a06af440308d98a9d29db76313
I20260925 01:50:16.290638 11675 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_55a570be01b241f8939758ca3e3bfad5 [id=f368a746576a4b5f8407a13437b4b3d0] alter complete (version 2)
I20260925 01:50:16.291507 11675 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_8e2f973593334b65afc2c3ac0c170a62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:16.292043 11675 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e2f973593334b65afc2c3ac0c170a62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260925 01:50:16.293352 11671 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8e9d16f20d44e71bdb3bccb9b858079 consensus state has no leader
I20260925 01:50:16.293705 11671 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_e7b6cdac5bbf4c1fb4665a67755588d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260925 01:50:16.295002 11676 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_cdece493529349aca97c9cd6eb9e7b11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:16.295470 11676 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdece493529349aca97c9cd6eb9e7b11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:16.295496 11673 catalog_manager.cc:3583] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60372:
table { table_name: "default.Table_4735603a234e494e8530cb2f9745858c" } new_table_name: "default.Table_48c989f6fa584f9da88833a6fd98bb7e" modify_external_catalogs: true
I20260925 01:50:16.295636 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet fa4380a06af440308d98a9d29db76313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.296017 13679 raft_consensus.cc:697] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Becoming Leader. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Running, Role: LEADER
I20260925 01:50:16.296442 13679 consensus_queue.cc:237] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:16.298704 11671 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7b6cdac5bbf4c1fb4665a67755588d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:16.300756 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 226498ea628a475d8fcab28a6598a819 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.182822 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 3c57266db845402ea98f080ef442ab4f (DEFAULT_TABLE table=default.Table_c0235a98cfd84c9280854f416f571e0e [id=74bbdb76644041f0828f0456f5c59f23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.300980 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 31353cc95e014e5bb24e5e5cefab1503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.301194 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c57266db845402ea98f080ef442ab4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.219223 13683 tablet.cc:1751] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:16.230131 13662 raft_consensus.cc:493] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.307816 13662 raft_consensus.cc:515] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.308566 13662 leader_election.cc:290] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.234866 11946 ts_tablet_manager.cc:1929] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.308753 11946 log.cc:1199] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/7347b31f782c4508b004c7523dc11dbb
I20260925 01:50:16.308972 13626 raft_consensus.cc:493] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.309108 11946 ts_tablet_manager.cc:1950] T 7347b31f782c4508b004c7523dc11dbb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.309283 13626 raft_consensus.cc:515] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.309908 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1006) took 3349 ms. Trace:
I20260925 01:50:16.310015 11946 rpcz_store.cc:276] 0925 01:50:12.960277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.960340 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:16.155854 (+3195514us) ts_tablet_manager.cc:1151] Deleting tablet 7347b31f782c4508b004c7523dc11dbb
0925 01:50:16.155868 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.160672 (+ 4804us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.234788 (+ 74116us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.309887 (+ 75099us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3195328}
I20260925 01:50:16.310402 11946 tablet_replica.cc:333] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.265103 11496 tablet_service.cc:1511] Processing CreateTablet for tablet bfa644147a2848508ad2449642fc26bf (DEFAULT_TABLE table=default.Table_5d6ca05ed4c34a6eb0d256874587bbdc [id=da87cf0660954d4c9900bdc802dd1374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.311268 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f4777a789a48a18cfadbfb9d49a708" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:16.311497 11496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa644147a2848508ad2449642fc26bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.265931 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd4701a82e5458f957e5a2760deec64 (DEFAULT_TABLE table=default.Table_d5b337fd8b9e4144a43f8e4e2fdcd47f [id=f080e43efd2d4d3583aed39b990aa2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.314347 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd4701a82e5458f957e5a2760deec64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.266286 11487 tablet_service.cc:1511] Processing CreateTablet for tablet a8bcfdf984d742a6b858e5ed263f1f82 (DEFAULT_TABLE table=default.Table_d7b95bb1d61b4d5cac9713b3ee125e24 [id=d314ea449ea5484ab9d7b6819625496f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.318363 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8bcfdf984d742a6b858e5ed263f1f82. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:16.317831 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 78006.8us
I20260925 01:50:16.318920 11176 leader_election.cc:304] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters: aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:16.319708 11674 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 824719105840401cb518dd5eea76f229 consensus state has no leader
I20260925 01:50:16.320807 13689 raft_consensus.cc:2804] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:16.320897 13689 raft_consensus.cc:493] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:16.320996 13689 raft_consensus.cc:3060] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.267773 11495 tablet_service.cc:1511] Processing CreateTablet for tablet d65a662583cf4029a60098d1f742984b (DEFAULT_TABLE table=default.Table_984614b000d54d07bed18722acbd3ea8 [id=75602bd9eb9743198fb700841658c56a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:16.322376 11678 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 542b261cb0f24d218b67cee8aab8e7c5 consensus state has no leader
I20260925 01:50:16.322422 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65a662583cf4029a60098d1f742984b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.322664 11678 master_service.cc:960] ReplaceTablet: received request to replace tablet 035e48a1fb884aa8a2c0b7065d0c1a6e from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:16.324285 13689 raft_consensus.cc:515] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:16.325204 11679 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0652894c66c5413ca0f54e84c8fca89a consensus state has no leader
I20260925 01:50:16.325573 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7347b31f782c4508b004c7523dc11dbb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:16.268553 11497 tablet_service.cc:1511] Processing CreateTablet for tablet e68eedccfe874307a451e496262cf39b (DEFAULT_TABLE table=default.Table_02b8ee20c5a444adb0a04e5d84832388 [id=4849773d7cb44ac7b1128536258956be]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:16.326292 11177 leader_election.cc:343] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.326433 11497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68eedccfe874307a451e496262cf39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.327167 10879 master-stress-test.cc:581] Killed test thread 3/25
I20260925 01:50:16.327247 10879 master-stress-test.cc:579] Killing test thread 4/25
I20260925 01:50:16.327327 10879 master-stress-test.cc:581] Killed test thread 4/25
I20260925 01:50:16.327369 10879 master-stress-test.cc:579] Killing test thread 5/25
I20260925 01:50:16.268862 11491 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcb755b54004ffdbd9aac6594b4d26f (DEFAULT_TABLE table=default.Table_d12ae3dd5f37487295db3494777287c3 [id=c507bd8e7910476782a4b5e21f56d40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.270179 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 81fcd78500ef4c6ab84b2f93a18f6d8d (DEFAULT_TABLE table=default.Table_5b7699461f464ddaa5c53e91987897d0 [id=066b9b4be20c483f8e5daccd9b6e932e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.287541 13586 raft_consensus.cc:493] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.330454 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcb755b54004ffdbd9aac6594b4d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.330325 13586 raft_consensus.cc:515] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.331037 13586 leader_election.cc:290] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.331331 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fcd78500ef4c6ab84b2f93a18f6d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.297014 11489 tablet_service.cc:1558] Processing DeleteTablet for tablet fa4380a06af440308d98a9d29db76313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:49304
W20260925 01:50:16.334841 11456 leader_election.cc:343] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.335119 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811b957c4e6647ccaa688d7273ec9eeb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
I20260925 01:50:16.335248 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 7347b31f782c4508b004c7523dc11dbb (table default.Table_992ecd7522c34d958da6f855b4bb8346 [id=3c7c1c6e189f47409dafd2c532f7cf12]) successfully deleted
I20260925 01:50:16.335369 11242 raft_consensus.cc:2468] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 0.
I20260925 01:50:16.336119 11456 leader_election.cc:304] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
I20260925 01:50:16.336390 13586 raft_consensus.cc:2804] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 01:50:16.336472 13586 raft_consensus.cc:493] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 01:50:16.336529 13586 raft_consensus.cc:3060] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.339337 13586 raft_consensus.cc:515] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.340698 11242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811b957c4e6647ccaa688d7273ec9eeb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb"
I20260925 01:50:16.340935 11242 raft_consensus.cc:3060] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.342157 13586 leader_election.cc:290] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Requested vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.342367 11946 raft_consensus.cc:2243] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.342792 11946 raft_consensus.cc:2272] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.343492 11946 ts_tablet_manager.cc:1916] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.348500 11242 raft_consensus.cc:2468] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514f31e4c2e54d9aaf6d4dd771d153b9 in term 1.
I20260925 01:50:16.351022 11456 leader_election.cc:304] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb; no voters:
W20260925 01:50:16.351228 11456 raft_consensus.cc:2686] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:16.351328 11953 ts_tablet_manager.cc:1929] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.357074 11674 catalog_manager.cc:2296] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60372:
name: "default.Table_14797b5c5be349228cfd29e6ddd7b35d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260925 01:50:16.357733 11674 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14797b5c5be349228cfd29e6ddd7b35d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 01:50:16.359153 11946 ts_tablet_manager.cc:1929] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.359262 11946 log.cc:1199] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/811b957c4e6647ccaa688d7273ec9eeb
I20260925 01:50:16.359766 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70f4777a789a48a18cfadbfb9d49a708" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:16.359988 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811b957c4e6647ccaa688d7273ec9eeb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d"
I20260925 01:50:16.359588 11946 ts_tablet_manager.cc:1950] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:16.360411 11457 leader_election.cc:343] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.360513 11457 leader_election.cc:304] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.360505 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "811b957c4e6647ccaa688d7273ec9eeb" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:16.360728 13586 raft_consensus.cc:2749] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:16.361073 11457 leader_election.cc:343] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:16.361729 11457 leader_election.cc:343] T 811b957c4e6647ccaa688d7273ec9eeb P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.361795 11755 tablet_bootstrap.cc:492] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.361927 11755 ts_tablet_manager.cc:1403] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.171s user 0.004s sys 0.021s
I20260925 01:50:16.361980 11677 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet a39d277b58664b5d9b06c22545da03c8
I20260925 01:50:16.362522 11677 catalog_manager.cc:6934] ReplaceTablet: tablet a39d277b58664b5d9b06c22545da03c8 deleted and replaced by tablet 9c83217ab3f64e1285dbabcf267e1af2
I20260925 01:50:16.362744 11755 raft_consensus.cc:359] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.362902 11755 raft_consensus.cc:385] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.362951 11755 raft_consensus.cc:740] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.363181 11755 consensus_queue.cc:260] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.363443 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9663d7f4008e4ee0a3ba4373258242eb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:16.363711 11755 ts_tablet_manager.cc:1434] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260925 01:50:16.363979 11177 leader_election.cc:343] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.364352 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet a39d277b58664b5d9b06c22545da03c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c83217ab3f64e1285dbabcf267e1af2) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.364854 13452 raft_consensus.cc:493] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.364961 13452 raft_consensus.cc:515] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.365046 13626 leader_election.cc:290] T 9663d7f4008e4ee0a3ba4373258242eb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.365478 13452 leader_election.cc:290] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:16.365764 11755 tablet_bootstrap.cc:492] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.367413 11755 tablet_bootstrap.cc:654] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:16.371999 11314 leader_election.cc:343] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 226498ea628a475d8fcab28a6598a819
I20260925 01:50:16.373672 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet a39d277b58664b5d9b06c22545da03c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c83217ab3f64e1285dbabcf267e1af2) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.374354 11953 log.cc:1199] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/519d954b6a214d0b8e960e128cfcea10
I20260925 01:50:16.374816 11953 ts_tablet_manager.cc:1950] T 519d954b6a214d0b8e960e128cfcea10 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:16.375672 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 773) took 8921 ms. Trace:
I20260925 01:50:16.375825 11953 rpcz_store.cc:276] 0925 01:50:07.454592 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.487609 (+ 33017us) service_pool.cc:224] Handling call
0925 01:50:16.236250 (+8748641us) ts_tablet_manager.cc:1151] Deleting tablet 519d954b6a214d0b8e960e128cfcea10
0925 01:50:16.236266 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.263343 (+ 27077us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.351264 (+ 87921us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.375654 (+ 24390us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8748442}
I20260925 01:50:16.376519 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 519d954b6a214d0b8e960e128cfcea10 (table default.Table_126b13b368c348bea98d7d87748aaf1c [id=3e31f69b151b4dd69a3ac8be6e2bc48d]) successfully deleted
I20260925 01:50:16.360524 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1007) took 3386 ms. Trace:
I20260925 01:50:16.377665 11946 rpcz_store.cc:276] 0925 01:50:12.973938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.974093 (+ 155us) service_pool.cc:224] Handling call
0925 01:50:16.310348 (+3336255us) ts_tablet_manager.cc:1151] Deleting tablet 811b957c4e6647ccaa688d7273ec9eeb
0925 01:50:16.310360 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.342684 (+ 32324us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x6160000e1a54. stack: 00007f859f5785c6 00007f859f578380 00007f859e58034d 00000000009a4cb4 00000000009a4c7d 00000000009a464a 00007f85ab66ca70 00007f85ac9f5583 00007f85af5c28b7 00007f85af5f5a64 00007f85af5d63a0 00007f85af5d612d 0000000000aaef9c 00007f859f5beaef 00007f859f5c1deb 00007f859f5c1c68
0925 01:50:16.354269 (+ 11585us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.359097 (+ 4828us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.360510 (+ 1413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73043328,"tablet-delete.queue_time_us":3335773}
W20260925 01:50:16.377815 11314 leader_election.cc:343] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 226498ea628a475d8fcab28a6598a819
I20260925 01:50:16.377928 11314 leader_election.cc:304] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.378028 11946 tablet_replica.cc:333] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.378170 13452 raft_consensus.cc:2749] T 226498ea628a475d8fcab28a6598a819 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.378276 11946 raft_consensus.cc:2243] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.378443 11946 raft_consensus.cc:2272] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.379019 11946 ts_tablet_manager.cc:1916] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.378860 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 811b957c4e6647ccaa688d7273ec9eeb (table default.Table_d3283efd340e4467bff4bc8b33862b02 [id=297da19bbbb7417a9d7a928bf0c92edd]) successfully deleted
I20260925 01:50:16.382253 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 777) took 8876 ms. Trace:
I20260925 01:50:16.382623 11953 rpcz_store.cc:276] 0925 01:50:07.505955 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.513587 (+ 7632us) service_pool.cc:224] Handling call
0925 01:50:16.377037 (+8863450us) ts_tablet_manager.cc:1151] Deleting tablet 4d14ab205bba4f9d92797d34ab82f13d
0925 01:50:16.377046 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.382228 (+ 5182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8862920}
W20260925 01:50:16.383225 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 4d14ab205bba4f9d92797d34ab82f13d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d14ab205bba4f9d92797d34ab82f13d already in progress: creating tablet
I20260925 01:50:16.383816 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 778) took 8639 ms. Trace:
I20260925 01:50:16.384038 11953 rpcz_store.cc:276] 0925 01:50:07.744308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.744366 (+ 58us) service_pool.cc:224] Handling call
0925 01:50:16.383609 (+8639243us) ts_tablet_manager.cc:1151] Deleting tablet cdd615a0405742fcb472d92829a8d7c7
0925 01:50:16.383621 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.383741 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8639051}
W20260925 01:50:16.384848 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet cdd615a0405742fcb472d92829a8d7c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdd615a0405742fcb472d92829a8d7c7 already in progress: creating tablet
I20260925 01:50:16.385293 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 779) took 8640 ms. Trace:
I20260925 01:50:16.385594 11755 tablet_bootstrap.cc:492] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.385537 11953 rpcz_store.cc:276] 0925 01:50:07.744940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.744987 (+ 47us) service_pool.cc:224] Handling call
0925 01:50:16.385181 (+8640194us) ts_tablet_manager.cc:1151] Deleting tablet 8e28aeabdf724784b8ed27535ea0701b
0925 01:50:16.385190 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.385276 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8640043}
I20260925 01:50:16.385733 11755 ts_tablet_manager.cc:1403] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.002s
I20260925 01:50:16.386636 11755 raft_consensus.cc:359] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.386893 11755 raft_consensus.cc:385] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.386951 11755 raft_consensus.cc:740] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.387199 11755 consensus_queue.cc:260] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.387851 11755 ts_tablet_manager.cc:1434] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:16.388130 11755 tablet_bootstrap.cc:492] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.389806 11755 tablet_bootstrap.cc:654] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:16.396049 11673 catalog_manager.cc:6106] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dfc41da6d8be47818cc2f68cd2558c7a consensus state has no leader
I20260925 01:50:16.397727 11672 catalog_manager.cc:6391] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: default.Table_71d7f580cbd84e62a58706a6e1b9b1e4 [id=1726c0f5240e46a68e6390a4c72f9621] alter complete (version 1)
I20260925 01:50:16.402486 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ecfc5a2a80449c9905c83b6bcb3652 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.401819 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 406d31139e1e441aa6fe204168486e28 with delete_type TABLET_DATA_DELETED (replaced by tablet 4480d3b5671a4f2aaf98941cc8d58433) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.403699 11678 catalog_manager.cc:6133] T 00000000000000000000000000000000 P 17a1694989f748dfa9cdb2c10f3f1de5: Sending DeleteTablet for 3 replicas of tablet 035e48a1fb884aa8a2c0b7065d0c1a6e
I20260925 01:50:16.404156 11678 catalog_manager.cc:6934] ReplaceTablet: tablet 035e48a1fb884aa8a2c0b7065d0c1a6e deleted and replaced by tablet cc55ffdf0d814f478ff3121fadcdc6ef
I20260925 01:50:16.406827 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e with delete_type TABLET_DATA_DELETED (replaced by tablet cc55ffdf0d814f478ff3121fadcdc6ef) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.407603 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e with delete_type TABLET_DATA_DELETED (replaced by tablet cc55ffdf0d814f478ff3121fadcdc6ef) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.413417 13691 tablet.cc:1751] T 6386bd0cb4894068985fe152299f0b47 P b93565e796c94a3699eb1824383bbaeb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:16.414840 11360 tablet_service.cc:1558] Processing DeleteTablet for tablet fce91b00d3a14e6398abacad61ff5b0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.415073 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet f46004be36b543a395a783a13b1b14cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.416218 11754 tablet_bootstrap.cc:492] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:16.416395 11754 ts_tablet_manager.cc:1403] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.449s user 0.006s sys 0.002s
I20260925 01:50:16.417306 11754 raft_consensus.cc:359] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.417518 11754 raft_consensus.cc:385] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.417623 11754 raft_consensus.cc:740] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.417836 11754 consensus_queue.cc:260] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.418365 11754 ts_tablet_manager.cc:1434] T 4f117df272c342b6b4ea5e5a4d7fd137 P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:16.418679 11754 tablet_bootstrap.cc:492] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:16.420125 10879 master-stress-test.cc:581] Killed test thread 5/25
I20260925 01:50:16.420231 10879 master-stress-test.cc:579] Killing test thread 6/25
I20260925 01:50:16.420322 10879 master-stress-test.cc:581] Killed test thread 6/25
I20260925 01:50:16.420385 10879 master-stress-test.cc:579] Killing test thread 7/25
I20260925 01:50:16.420495 10879 master-stress-test.cc:581] Killed test thread 7/25
I20260925 01:50:16.420557 10879 master-stress-test.cc:579] Killing test thread 8/25
I20260925 01:50:16.420645 10879 master-stress-test.cc:581] Killed test thread 8/25
I20260925 01:50:16.420785 10879 master-stress-test.cc:579] Killing test thread 9/25
I20260925 01:50:16.423131 10879 master-stress-test.cc:581] Killed test thread 9/25
I20260925 01:50:16.423280 10879 master-stress-test.cc:579] Killing test thread 10/25
I20260925 01:50:16.424237 10879 master-stress-test.cc:581] Killed test thread 10/25
I20260925 01:50:16.424327 10879 master-stress-test.cc:579] Killing test thread 11/25
I20260925 01:50:16.425279 10879 master-stress-test.cc:581] Killed test thread 11/25
I20260925 01:50:16.425361 10879 master-stress-test.cc:579] Killing test thread 12/25
I20260925 01:50:16.425992 10879 master-stress-test.cc:581] Killed test thread 12/25
I20260925 01:50:16.426097 10879 master-stress-test.cc:579] Killing test thread 13/25
I20260925 01:50:16.426708 10879 master-stress-test.cc:581] Killed test thread 13/25
I20260925 01:50:16.426782 10879 master-stress-test.cc:579] Killing test thread 14/25
I20260925 01:50:16.427172 10879 master-stress-test.cc:581] Killed test thread 14/25
I20260925 01:50:16.427246 10879 master-stress-test.cc:579] Killing test thread 15/25
I20260925 01:50:16.427345 10879 master-stress-test.cc:581] Killed test thread 15/25
I20260925 01:50:16.427410 10879 master-stress-test.cc:579] Killing test thread 16/25
I20260925 01:50:16.427495 10879 master-stress-test.cc:581] Killed test thread 16/25
I20260925 01:50:16.427554 10879 master-stress-test.cc:579] Killing test thread 17/25
I20260925 01:50:16.427645 10879 master-stress-test.cc:581] Killed test thread 17/25
I20260925 01:50:16.427711 10879 master-stress-test.cc:579] Killing test thread 18/25
I20260925 01:50:16.427798 10879 master-stress-test.cc:581] Killed test thread 18/25
I20260925 01:50:16.427855 10879 master-stress-test.cc:579] Killing test thread 19/25
I20260925 01:50:16.427935 10879 master-stress-test.cc:581] Killed test thread 19/25
I20260925 01:50:16.427989 10879 master-stress-test.cc:579] Killing test thread 20/25
I20260925 01:50:16.428068 10879 master-stress-test.cc:581] Killed test thread 20/25
I20260925 01:50:16.428122 10879 master-stress-test.cc:579] Killing test thread 21/25
I20260925 01:50:16.437150 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 780) took 8630 ms. Trace:
I20260925 01:50:16.443871 11678 catalog_manager.cc:5838] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:16.444445 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet cc4a51356880486a928181ee701f74d0 (table default.Table_4ad3881ff5874f4594e9c336a16513e4 [id=ad62203df2f049f2988e6c7ad5b5188d]). Expected version 2 got 0
I20260925 01:50:16.444749 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet df5dcf3b6d134065be92ec6ea8caffc7 (table default.Table_0f935fd09c3741a3bf5fd153ba450059 [id=7dc2076323334c7494e7ea4e28a558a7]). Expected version 1 got 0
I20260925 01:50:16.444952 11678 catalog_manager.cc:5838] T 9513d1d55fe846f5b1a2b7d315209002 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:16.445305 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 9513d1d55fe846f5b1a2b7d315209002 (table default.Table_76c89167538945999999e21b0ddaba59 [id=fc884308e078422c86ce1d6f7b0af92e]). Expected version 2 got 0
I20260925 01:50:16.445519 11678 catalog_manager.cc:5838] T 9c4f1e725fe84552943563aa95687842 P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:16.445832 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 9c4f1e725fe84552943563aa95687842 (table default.Table_aa03f8da712d43a9b1605c6fbc896171 [id=564bdd9ee3404040b32798c6890aff6e]). Expected version 4 got 0
I20260925 01:50:16.446219 11678 catalog_manager.cc:5838] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } }
I20260925 01:50:16.446620 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet aaa2f7ef888846ec9667916ba47084db (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]). Expected version 1 got 0
I20260925 01:50:16.437283 11953 rpcz_store.cc:276] 0925 01:50:07.806382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:07.806452 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:16.436928 (+8630476us) ts_tablet_manager.cc:1151] Deleting tablet d549d73cf407467faa68cbfb68306190
0925 01:50:16.436939 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.437122 (+ 183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8630229}
W20260925 01:50:16.455161 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d549d73cf407467faa68cbfb68306190 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d549d73cf407467faa68cbfb68306190 already in progress: creating tablet
I20260925 01:50:16.455863 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 781) took 8169 ms. Trace:
I20260925 01:50:16.455971 11953 rpcz_store.cc:276] 0925 01:50:08.286449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.286527 (+ 78us) service_pool.cc:224] Handling call
0925 01:50:16.455726 (+8169199us) ts_tablet_manager.cc:1151] Deleting tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f
0925 01:50:16.455737 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.455845 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8168943}
W20260925 01:50:16.456449 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d3e9dbc45b642b6aebe3f0a6876ca5f already in progress: creating tablet
I20260925 01:50:16.456909 11946 ts_tablet_manager.cc:1929] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.458659 11946 log.cc:1199] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8a00b69e42e1465981d6c3eec217393f
I20260925 01:50:16.462514 11753 tablet_bootstrap.cc:492] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:16.462659 11753 ts_tablet_manager.cc:1403] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.293s user 0.004s sys 0.000s
I20260925 01:50:16.463349 11753 raft_consensus.cc:359] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.463516 11753 raft_consensus.cc:385] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.463562 11753 raft_consensus.cc:740] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.463794 11753 consensus_queue.cc:260] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.464288 11753 ts_tablet_manager.cc:1434] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:16.468174 11755 tablet_bootstrap.cc:492] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.468334 11755 ts_tablet_manager.cc:1403] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.000s
I20260925 01:50:16.469089 11755 raft_consensus.cc:359] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.469269 11755 raft_consensus.cc:385] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.469331 11755 raft_consensus.cc:740] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.469576 11755 consensus_queue.cc:260] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.470216 11755 ts_tablet_manager.cc:1434] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260925 01:50:16.475577 13689 leader_election.cc:290] T 7347b31f782c4508b004c7523dc11dbb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Requested vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.479884 11753 tablet_bootstrap.cc:492] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:16.481443 11753 tablet_bootstrap.cc:654] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.482182 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c01195f07b84b359a974fab5ed52582 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:16.482780 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 162370us
I20260925 01:50:16.484278 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 81024a75b31e45e098d108bae4cc17c9 (table default.Table_e2abaeb692e1458dacd8e8bab6cf101f [id=3a20320201fe4834bd86c120b86856a8]) successfully deleted
W20260925 01:50:16.484754 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 915b1621cea64c03bd486ef32e815f5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 915b1621cea64c03bd486ef32e815f5f already in progress: creating tablet
I20260925 01:50:16.496670 11671 master_service.cc:960] ReplaceTablet: received request to replace tablet 2487a41e682740cb83a4281aeef0368a from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:16.499279 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 5048a0fca2e64ffa9f19000f48a4c090 (table default.Table_fbb2f99ff1e94b04ac906f20c094f645 [id=fc1e6e3a4c5845d3865d8bf7bf658dea]) successfully deleted
I20260925 01:50:16.504043 11953 tablet_replica.cc:333] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:16.504280 11755 tablet_bootstrap.cc:492] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.504272 11953 raft_consensus.cc:2243] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.506526 11953 raft_consensus.cc:2272] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:16.506937 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d0edb8007afa42c6af8b289ff9cea830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0edb8007afa42c6af8b289ff9cea830 already in progress: creating tablet
I20260925 01:50:16.507125 11953 ts_tablet_manager.cc:1916] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:16.507681 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet d08b978d9b2945ffa966e2237bddd48c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08b978d9b2945ffa966e2237bddd48c already in progress: creating tablet
W20260925 01:50:16.508105 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 5276072bbeca403fb06566b4a43489a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5276072bbeca403fb06566b4a43489a0 already in progress: creating tablet
I20260925 01:50:16.446873 11678 catalog_manager.cc:5838] T e7b6bde824d74acfaaffc23a0b05db8b P b93565e796c94a3699eb1824383bbaeb reported cstate change: term changed from 0 to 1, leader changed from <none> to b93565e796c94a3699eb1824383bbaeb (127.10.159.193). New cstate: current_term: 1 leader_uuid: "b93565e796c94a3699eb1824383bbaeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } health_report { overall_health: UNKNOWN } } }
I20260925 01:50:16.511070 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet e7b6bde824d74acfaaffc23a0b05db8b (table default.Table_c0c2a440fcfd4cdc8f97e52a83a31318 [id=2a9ff32ac39e45a898876d49c1332249]). Expected version 1 got 0
I20260925 01:50:16.511425 11678 catalog_manager.cc:5938] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
W20260925 01:50:16.514930 11665 catalog_manager.cc:5043] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): delete failed for tablet 38249392c0df4d50b0e09f3671f92800 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38249392c0df4d50b0e09f3671f92800 already in progress: creating tablet
I20260925 01:50:16.516396 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 86c8c3bba9614539bfe3018461ad21f8 (table default.Table_09e74499a02540e4b52702ff9edba4bf [id=f3f8339a90b64cd4812637e6f997f107]) successfully deleted
I20260925 01:50:16.517004 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 329a5af9fb654d4c894e1cf4fd636c13 (table default.Table_0edb84dafd8f46f6856de68ddb449886 [id=ea287d157483442c87bc629e0b7df82f]) successfully deleted
I20260925 01:50:16.517529 11755 tablet_bootstrap.cc:654] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.527814 11755 tablet_bootstrap.cc:492] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.528196 11755 ts_tablet_manager.cc:1403] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260925 01:50:16.531708 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 0e3ba459a81845699435c2e44f5c9f19 (table default.Table_d143a5ee928e48efae3ed675e65f4871 [id=bf9b5cb2e68745dabd9184ea927e76a6]) successfully deleted
I20260925 01:50:16.531951 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet 4f19bccf3c5540cb828ec7bfc89a1c17 (table default.Table_ec6a77ed80f04e6d8eaa7f81d505133f [id=0f94e9a1c0e44ed2a4fe40673de847db]) successfully deleted
I20260925 01:50:16.534735 11754 tablet_bootstrap.cc:654] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.536846 11953 ts_tablet_manager.cc:1929] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:16.536818 11359 tablet_service.cc:1511] Processing CreateTablet for tablet b840331db6014ee88baf8b85c31e41f4 (DEFAULT_TABLE table=default.Table_02f23c36767d4a14bee973dceb97d914 [id=725c05e0d9614abdb6a1b909e24d063b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.536957 11953 log.cc:1199] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/01d50e428bfc46caa130f96ccc7e8f40
I20260925 01:50:16.537235 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b840331db6014ee88baf8b85c31e41f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.537319 11953 ts_tablet_manager.cc:1950] T 01d50e428bfc46caa130f96ccc7e8f40 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:16.538092 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 782) took 8220 ms. Trace:
I20260925 01:50:16.538169 11953 rpcz_store.cc:276] 0925 01:50:08.317918 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.318111 (+ 193us) service_pool.cc:224] Handling call
0925 01:50:16.462823 (+8144712us) ts_tablet_manager.cc:1151] Deleting tablet 01d50e428bfc46caa130f96ccc7e8f40
0925 01:50:16.462834 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.510830 (+ 47996us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.536789 (+ 25959us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.538038 (+ 1249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8144480}
I20260925 01:50:16.538684 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 01d50e428bfc46caa130f96ccc7e8f40 (table default.Table_9cb04782490848a79ec41ab36549c475 [id=ebfab7ea221e4c91a3d97c7ae6e10579]) successfully deleted
I20260925 01:50:16.545701 13356 ts_tablet_manager.cc:1929] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:16.545938 13356 log.cc:1199] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/ff70e44b72d1425c81751ff0b3d93b11
I20260925 01:50:16.546172 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 0226f482c8ff49ce976490e6aadfcee4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.546583 13356 ts_tablet_manager.cc:1950] T ff70e44b72d1425c81751ff0b3d93b11 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:16.547021 11220 tablet_service.cc:1511] Processing CreateTablet for tablet f677c82ee0654024b604eca7c255bb20 (DEFAULT_TABLE table=default.Table_dac2652a538c4e93a7587d1b9d268fdf [id=c3292e00b7bc409a9b2f10839d10ce76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.547513 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f677c82ee0654024b604eca7c255bb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.547629 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1038) took 3098 ms. Trace:
I20260925 01:50:16.547868 13356 rpcz_store.cc:276] 0925 01:50:13.449019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.449164 (+ 145us) service_pool.cc:224] Handling call
0925 01:50:16.256834 (+2807670us) ts_tablet_manager.cc:1151] Deleting tablet ff70e44b72d1425c81751ff0b3d93b11
0925 01:50:16.256844 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.476045 (+219201us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.545531 (+ 69486us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.547574 (+ 2043us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2807474}
I20260925 01:50:16.548410 13356 tablet_replica.cc:333] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:16.548789 13356 raft_consensus.cc:2243] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:16.549216 13356 raft_consensus.cc:2272] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.552405 13452 raft_consensus.cc:493] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 514f31e4c2e54d9aaf6d4dd771d153b9)
I20260925 01:50:16.552553 13452 raft_consensus.cc:515] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.553193 13452 leader_election.cc:290] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:16.485477 11511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5122b8c24d3442a1a52ff0b003d65ffb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:16.554272 11511 raft_consensus.cc:2468] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:16.495471 11519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8055cc9b06045449e6133298c8074e1" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
W20260925 01:50:16.554608 11314 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: b306496f992f45a9b64b05b73712cb5b
I20260925 01:50:16.554661 11519 raft_consensus.cc:2468] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
W20260925 01:50:16.555418 11314 leader_election.cc:343] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b306496f992f45a9b64b05b73712cb5b
I20260925 01:50:16.555533 11314 leader_election.cc:304] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.502170 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 252415635b5e4b3286948e91d421d6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.503950 11946 ts_tablet_manager.cc:1950] T 8a00b69e42e1465981d6c3eec217393f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.531059 11515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd594870fa6a4ba190a18a48d821d72c" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:16.531374 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "341dca6f396449daadcaf8bbb77ed04b" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:16.533213 11523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a00b69e42e1465981d6c3eec217393f" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9"
I20260925 01:50:16.555971 11515 raft_consensus.cc:3060] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.556176 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1008) took 3579 ms. Trace:
I20260925 01:50:16.556253 11946 rpcz_store.cc:276] 0925 01:50:12.977214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.977303 (+ 89us) service_pool.cc:224] Handling call
0925 01:50:16.377975 (+3400672us) ts_tablet_manager.cc:1151] Deleting tablet 8a00b69e42e1465981d6c3eec217393f
0925 01:50:16.377988 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.397216 (+ 19228us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.456814 (+ 59598us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.556164 (+ 99350us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3400144}
I20260925 01:50:16.556586 11946 tablet_replica.cc:333] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.556807 11946 raft_consensus.cc:2243] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.556978 11946 raft_consensus.cc:2272] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.555994 11514 raft_consensus.cc:3060] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:16.557559 11946 ts_tablet_manager.cc:1916] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.560322 11515 raft_consensus.cc:2468] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:16.560665 11514 raft_consensus.cc:2468] T 341dca6f396449daadcaf8bbb77ed04b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 1.
I20260925 01:50:16.534567 11510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9663d7f4008e4ee0a3ba4373258242eb" candidate_uuid: "b93565e796c94a3699eb1824383bbaeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:16.561286 11510 raft_consensus.cc:2468] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b93565e796c94a3699eb1824383bbaeb in term 0.
I20260925 01:50:16.536589 11487 tablet_service.cc:1511] Processing CreateTablet for tablet b840331db6014ee88baf8b85c31e41f4 (DEFAULT_TABLE table=default.Table_02f23c36767d4a14bee973dceb97d914 [id=725c05e0d9614abdb6a1b909e24d063b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.561743 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b840331db6014ee88baf8b85c31e41f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.562635 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8a00b69e42e1465981d6c3eec217393f (table default.Table_1c719484abbc48d985408ab5f7a3e42c [id=ce0e7e5581b649feab00f639935dba9f]) successfully deleted
I20260925 01:50:16.563266 13452 raft_consensus.cc:2749] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 01:50:16.564342 13683 tablet.cc:1751] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260925 01:50:16.585963 13683 tablet.cc:1751] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260925 01:50:16.529273 11755 raft_consensus.cc:359] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.589612 11755 raft_consensus.cc:385] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.589733 11755 raft_consensus.cc:740] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.590046 11755 consensus_queue.cc:260] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.590775 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 679cbe0cc09b47938f60959d845d1767 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.591452 11214 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2de2c9e9db4d06bc76acf382cda5bf (DEFAULT_TABLE table=default.Table_9eb8e584d86641148b7287cd8bf0ccdb [id=d552efc7554c421b83e7d8506456724b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.591504 11208 tablet_service.cc:1511] Processing CreateTablet for tablet cbd54e9e0c23406b8949cc2cbfa8b89a (DEFAULT_TABLE table=default.Table_02d89a08fe85499db7ac1e181e841745 [id=a4dcb021a94a4a49868a671a61674843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.591854 11214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2de2c9e9db4d06bc76acf382cda5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.593149 11220 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d37a05d2bcd4c94ba51fef8096f889d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.593219 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 48bd9071170d4f6f9ac4039020de5c00 (table default.Table_55a570be01b241f8939758ca3e3bfad5 [id=f368a746576a4b5f8407a13437b4b3d0]). Expected version 2 got 1
I20260925 01:50:16.595925 11755 ts_tablet_manager.cc:1434] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.068s user 0.002s sys 0.000s
I20260925 01:50:16.596287 11755 tablet_bootstrap.cc:492] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.598006 11755 tablet_bootstrap.cc:654] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.598763 11220 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9eefafcf2e4f8c9056133e13140db7 (DEFAULT_TABLE table=default.Table_1047bf49907148c081b8098ab2ded503 [id=618fb4b601ed48219c7c454e601722d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.599030 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 81c2d13ee77945f6a993ba99d57b5427 with delete_type TABLET_DATA_DELETED (replaced by tablet a94a08841e4f4e7fb1513d3c674ea380) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.604308 11753 tablet_bootstrap.cc:492] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:16.605726 11215 tablet_service.cc:1558] Processing DeleteTablet for tablet 83c69194c062411db10113b63f6be92c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.606246 11215 tablet_service.cc:1511] Processing CreateTablet for tablet 3c57266db845402ea98f080ef442ab4f (DEFAULT_TABLE table=default.Table_c0235a98cfd84c9280854f416f571e0e [id=74bbdb76644041f0828f0456f5c59f23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.607321 11671 master_service.cc:960] ReplaceTablet: received request to replace tablet 4cd34fa172904e51ade794892c580248 from {username='slave'} at 127.0.0.1:60372
I20260925 01:50:16.607692 11216 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd4701a82e5458f957e5a2760deec64 (DEFAULT_TABLE table=default.Table_d5b337fd8b9e4144a43f8e4e2fdcd47f [id=f080e43efd2d4d3583aed39b990aa2cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.608186 11205 tablet_service.cc:1511] Processing CreateTablet for tablet e68eedccfe874307a451e496262cf39b (DEFAULT_TABLE table=default.Table_02b8ee20c5a444adb0a04e5d84832388 [id=4849773d7cb44ac7b1128536258956be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.607702 11221 tablet_service.cc:1511] Processing CreateTablet for tablet bfa644147a2848508ad2449642fc26bf (DEFAULT_TABLE table=default.Table_5d6ca05ed4c34a6eb0d256874587bbdc [id=da87cf0660954d4c9900bdc802dd1374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.608209 11218 tablet_service.cc:1511] Processing CreateTablet for tablet a8bcfdf984d742a6b858e5ed263f1f82 (DEFAULT_TABLE table=default.Table_d7b95bb1d61b4d5cac9713b3ee125e24 [id=d314ea449ea5484ab9d7b6819625496f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.609162 11217 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcb755b54004ffdbd9aac6594b4d26f (DEFAULT_TABLE table=default.Table_d12ae3dd5f37487295db3494777287c3 [id=c507bd8e7910476782a4b5e21f56d40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.609539 11210 tablet_service.cc:1511] Processing CreateTablet for tablet b840331db6014ee88baf8b85c31e41f4 (DEFAULT_TABLE table=default.Table_02f23c36767d4a14bee973dceb97d914 [id=725c05e0d9614abdb6a1b909e24d063b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.609634 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet fa4380a06af440308d98a9d29db76313 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:15 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.609861 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e6715233be44b9aad5210d17500f59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.610019 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet a39d277b58664b5d9b06c22545da03c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c83217ab3f64e1285dbabcf267e1af2) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.610177 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e with delete_type TABLET_DATA_DELETED (replaced by tablet cc55ffdf0d814f478ff3121fadcdc6ef) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.610311 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet 9663d7f4008e4ee0a3ba4373258242eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.610522 11209 tablet_service.cc:1558] Processing DeleteTablet for tablet d401574e89014d2aaa5f98d0d9a2729f with delete_type TABLET_DATA_DELETED (replaced by tablet 0492ea6f9d0a4cdf9e339920863b54f9) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.611929 11665 catalog_manager.cc:5063] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): tablet ff70e44b72d1425c81751ff0b3d93b11 (table default.Table_93ee32c298354a5bbb21cb437993fe10 [id=5a2b789a92404c0281b0fd4db5d5eb1d]) successfully deleted
I20260925 01:50:16.612181 11208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd54e9e0c23406b8949cc2cbfa8b89a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.612190 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet b97f703869d4471cb940ef654203ec2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:04 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.612375 11218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8bcfdf984d742a6b858e5ed263f1f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.612488 11204 tablet_service.cc:1511] Processing CreateTablet for tablet d65a662583cf4029a60098d1f742984b (DEFAULT_TABLE table=default.Table_984614b000d54d07bed18722acbd3ea8 [id=75602bd9eb9743198fb700841658c56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.612761 11207 tablet_service.cc:1511] Processing CreateTablet for tablet 81fcd78500ef4c6ab84b2f93a18f6d8d (DEFAULT_TABLE table=default.Table_5b7699461f464ddaa5c53e91987897d0 [id=066b9b4be20c483f8e5daccd9b6e932e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.613032 11203 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f117df272c342b6b4ea5e5a4d7fd137 with delete_type TABLET_DATA_DELETED (replaced by tablet 137e34ae88eb453e819d82b1814bf895) from {username='slave'} at 127.0.0.1:52978
I20260925 01:50:16.618247 11205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68eedccfe874307a451e496262cf39b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.618248 11753 ts_tablet_manager.cc:1403] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.138s user 0.006s sys 0.002s
I20260925 01:50:16.618656 13356 ts_tablet_manager.cc:1916] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.619379 11216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd4701a82e5458f957e5a2760deec64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.619521 11221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa644147a2848508ad2449642fc26bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.620190 11220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9eefafcf2e4f8c9056133e13140db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.620362 11204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d65a662583cf4029a60098d1f742984b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.620865 11207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81fcd78500ef4c6ab84b2f93a18f6d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.621120 11217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcb755b54004ffdbd9aac6594b4d26f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.621304 11210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b840331db6014ee88baf8b85c31e41f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.621906 11215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c57266db845402ea98f080ef442ab4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.632304 11953 tablet_replica.cc:333] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:16.632575 11953 raft_consensus.cc:2243] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.640383 13586 raft_consensus.cc:493] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.642171 13586 raft_consensus.cc:515] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.632759 11953 raft_consensus.cc:2272] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.648030 11953 ts_tablet_manager.cc:1916] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.653160 13586 leader_election.cc:290] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.658998 11755 tablet_bootstrap.cc:492] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.659268 11755 ts_tablet_manager.cc:1403] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.008s
I20260925 01:50:16.660198 11755 raft_consensus.cc:359] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:16.660475 11755 raft_consensus.cc:385] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.660581 11755 raft_consensus.cc:740] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.660609 11753 raft_consensus.cc:359] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.660945 11755 consensus_queue.cc:260] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:16.661860 11753 raft_consensus.cc:385] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.662101 11753 raft_consensus.cc:740] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.664683 11753 consensus_queue.cc:260] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.667959 11359 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b123ac1e894239875404438ed19927 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.668573 13452 raft_consensus.cc:493] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.668677 11755 ts_tablet_manager.cc:1434] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260925 01:50:16.668704 13452 raft_consensus.cc:515] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.668962 11755 tablet_bootstrap.cc:492] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.669312 13452 leader_election.cc:290] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:16.669318 11753 ts_tablet_manager.cc:1434] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260925 01:50:16.669652 11753 tablet_bootstrap.cc:492] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:16.671016 11755 tablet_bootstrap.cc:654] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.672601 11238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252415635b5e4b3286948e91d421d6f1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b93565e796c94a3699eb1824383bbaeb" is_pre_election: true
W20260925 01:50:16.673329 11456 leader_election.cc:343] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.679591 11946 ts_tablet_manager.cc:1929] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.697359 13356 ts_tablet_manager.cc:1929] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:16.695152 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet d3aadd649e4b4f489bfe4b0eea13ede8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:58 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.711589 11753 tablet_bootstrap.cc:654] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:16.676141 11314 leader_election.cc:343] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Not found: Tablet not found: 31ecfc5a2a80449c9905c83b6bcb3652
I20260925 01:50:16.724509 11753 tablet_bootstrap.cc:492] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:16.725713 11753 ts_tablet_manager.cc:1403] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.056s user 0.000s sys 0.004s
I20260925 01:50:16.727433 11753 raft_consensus.cc:359] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.728505 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 285903e900ec4ad5bfb4cc9c4122176a (DEFAULT_TABLE table=default.Table_14797b5c5be349228cfd29e6ddd7b35d [id=c52735754ad14404af65b4d2d27d15ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.728878 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 285903e900ec4ad5bfb4cc9c4122176a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.729828 11378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252415635b5e4b3286948e91d421d6f1" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:16.733210 13356 log.cc:1199] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-0/wal/wals/f385af75e11c4643b4e7c2d899ee99a4
I20260925 01:50:16.733664 13356 ts_tablet_manager.cc:1950] T f385af75e11c4643b4e7c2d899ee99a4 P b93565e796c94a3699eb1824383bbaeb: Deleting consensus metadata
I20260925 01:50:16.734613 13356 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52978 (request call id 1039) took 3277 ms. Trace:
I20260925 01:50:16.734786 13356 rpcz_store.cc:276] 0925 01:50:13.457370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.457440 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:16.548261 (+3090821us) ts_tablet_manager.cc:1151] Deleting tablet f385af75e11c4643b4e7c2d899ee99a4
0925 01:50:16.548275 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.688918 (+140643us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.697297 (+ 8379us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.734593 (+ 37296us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3090576}
I20260925 01:50:16.735196 13356 tablet_replica.cc:333] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb: stopping tablet replica
I20260925 01:50:16.735440 13356 raft_consensus.cc:2243] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.735631 13356 raft_consensus.cc:2272] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.736199 13356 ts_tablet_manager.cc:1916] T 0749a0ae58df4ff8b74a86f072332fad P b93565e796c94a3699eb1824383bbaeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.737417 11753 raft_consensus.cc:385] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.737571 11753 raft_consensus.cc:740] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.737886 11753 consensus_queue.cc:260] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.729408 11754 tablet_bootstrap.cc:492] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb: No bootstrap required, opened a new log
I20260925 01:50:16.738322 11754 ts_tablet_manager.cc:1403] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb: Time spent bootstrapping tablet: real 0.320s user 0.004s sys 0.002s
I20260925 01:50:16.738880 11753 ts_tablet_manager.cc:1434] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
W20260925 01:50:16.745836 11177 consensus_peers.cc:597] T cc4a51356880486a928181ee701f74d0 P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:16.746233 11360 tablet_service.cc:1511] Processing CreateTablet for tablet c6130cbd4fab4654a523cf0e3058f4a6 (DEFAULT_TABLE table=default.Table_2dbdc5ea9a1a428f993b071f95f0f9ac [id=fa06b6c7e988411d8297ccaac2f4e8bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.746625 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6130cbd4fab4654a523cf0e3058f4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.747366 11754 raft_consensus.cc:359] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.728260 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 285903e900ec4ad5bfb4cc9c4122176a (DEFAULT_TABLE table=default.Table_14797b5c5be349228cfd29e6ddd7b35d [id=c52735754ad14404af65b4d2d27d15ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.745153 11503 tablet_service.cc:1511] Processing CreateTablet for tablet c6130cbd4fab4654a523cf0e3058f4a6 (DEFAULT_TABLE table=default.Table_2dbdc5ea9a1a428f993b071f95f0f9ac [id=fa06b6c7e988411d8297ccaac2f4e8bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.747931 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6130cbd4fab4654a523cf0e3058f4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.750178 10879 master-stress-test.cc:581] Killed test thread 21/25
I20260925 01:50:16.750278 10879 master-stress-test.cc:579] Killing test thread 22/25
I20260925 01:50:16.750358 10879 master-stress-test.cc:581] Killed test thread 22/25
I20260925 01:50:16.750411 10879 master-stress-test.cc:579] Killing test thread 23/25
I20260925 01:50:16.750480 10879 master-stress-test.cc:581] Killed test thread 23/25
I20260925 01:50:16.750523 10879 master-stress-test.cc:579] Killing test thread 24/25
I20260925 01:50:16.750592 10879 master-stress-test.cc:581] Killed test thread 24/25
I20260925 01:50:16.750635 10879 master-stress-test.cc:579] Killing test thread 25/25
I20260925 01:50:16.750707 10879 master-stress-test.cc:581] Killed test thread 25/25
I20260925 01:50:16.750852 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 11160
I20260925 01:50:16.755177 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 285903e900ec4ad5bfb4cc9c4122176a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.756655 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 5eeca1ed714e48ce99e6fb3a9a7dca81 (DEFAULT_TABLE table=default.Table_4f04d8a8129f4449af2863275c6f337e [id=a63828fa65784c16a3a32099482be087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.757175 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eeca1ed714e48ce99e6fb3a9a7dca81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.758359 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 5eeca1ed714e48ce99e6fb3a9a7dca81 (DEFAULT_TABLE table=default.Table_4f04d8a8129f4449af2863275c6f337e [id=a63828fa65784c16a3a32099482be087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.758798 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eeca1ed714e48ce99e6fb3a9a7dca81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:16.733044 11457 leader_election.cc:343] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.760545 11457 leader_election.cc:304] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.762552 13586 raft_consensus.cc:2749] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:16.767680 11314 leader_election.cc:343] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 31ecfc5a2a80449c9905c83b6bcb3652
I20260925 01:50:16.767831 11314 leader_election.cc:304] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:16.769032 13458 raft_consensus.cc:2749] T 31ecfc5a2a80449c9905c83b6bcb3652 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.775573 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 56a736a749704670b2493bba92663812 (DEFAULT_TABLE table=default.Table_3572f8f700844070919dafb22da6d277 [id=a41e7c240e5f416aa9cbee52a96ca012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.776628 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a736a749704670b2493bba92663812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.783335 11953 ts_tablet_manager.cc:1929] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.783478 11953 log.cc:1199] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/be89c0911dfa4b9d83d6bd88755be2b2
I20260925 01:50:16.783773 11953 ts_tablet_manager.cc:1950] T be89c0911dfa4b9d83d6bd88755be2b2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:16.786664 11753 tablet_bootstrap.cc:492] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:16.789592 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 56a736a749704670b2493bba92663812 (DEFAULT_TABLE table=default.Table_3572f8f700844070919dafb22da6d277 [id=a41e7c240e5f416aa9cbee52a96ca012]), partition=RANGE (key) PARTITION UNBOUNDED
W20260925 01:50:16.720690 11176 leader_election.cc:343] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 811b957c4e6647ccaa688d7273ec9eeb
I20260925 01:50:16.790647 11176 leader_election.cc:304] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:16.791011 11176 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.195:45589, user_credentials={real_user=slave}} blocked reactor thread for 70359.7us
W20260925 01:50:16.791275 11176 leader_election.cc:343] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 33967e5e11524b78bb86ce7a3e2e16ad
I20260925 01:50:16.791383 11176 leader_election.cc:304] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:16.791746 11176 leader_election.cc:343] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 8e28aeabdf724784b8ed27535ea0701b
I20260925 01:50:16.791839 11176 leader_election.cc:304] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:16.792174 11176 leader_election.cc:343] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 113d7ccee4e349e19d3948e09d2c533d
I20260925 01:50:16.792289 11176 leader_election.cc:304] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
W20260925 01:50:16.792635 11176 leader_election.cc:343] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: e40083a885974e3595ec2fb5b16d4a5d
I20260925 01:50:16.792727 11176 leader_election.cc:304] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b93565e796c94a3699eb1824383bbaeb; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, aac4ec033f794d7a90b52aa4e0b6155d
I20260925 01:50:16.793162 13672 raft_consensus.cc:2749] T 811b957c4e6647ccaa688d7273ec9eeb P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.793375 13672 raft_consensus.cc:2749] T 33967e5e11524b78bb86ce7a3e2e16ad P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.793459 13632 raft_consensus.cc:2749] T 8e28aeabdf724784b8ed27535ea0701b P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.793502 13672 raft_consensus.cc:2749] T 113d7ccee4e349e19d3948e09d2c533d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.793617 13632 raft_consensus.cc:2749] T e40083a885974e3595ec2fb5b16d4a5d P b93565e796c94a3699eb1824383bbaeb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 01:50:16.799220 11754 raft_consensus.cc:385] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.799327 11754 raft_consensus.cc:740] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b93565e796c94a3699eb1824383bbaeb, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.799556 11754 consensus_queue.cc:260] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.801136 11753 tablet_bootstrap.cc:654] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.805841 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a736a749704670b2493bba92663812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.807349 11754 ts_tablet_manager.cc:1434] T 3702f09e45a14c80af716d642d30cdfa P b93565e796c94a3699eb1824383bbaeb: Time spent starting tablet: real 0.061s user 0.001s sys 0.001s
I20260925 01:50:16.807659 11754 tablet_bootstrap.cc:492] T 5ef093a4a1134407ba94207137ce3e81 P b93565e796c94a3699eb1824383bbaeb: Bootstrap starting.
I20260925 01:50:16.809569 11754 tablet_bootstrap.cc:654] T 5ef093a4a1134407ba94207137ce3e81 P b93565e796c94a3699eb1824383bbaeb: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:16.810096 11177 consensus_peers.cc:597] T aaa2f7ef888846ec9667916ba47084db P b93565e796c94a3699eb1824383bbaeb -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:16.812570 11283 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 01:50:16.813977 11358 tablet_service.cc:1511] Processing CreateTablet for tablet f8144af4435e4ed08ff7680dc808a09c (DEFAULT_TABLE table=default.Table_d55afd57e18746038f74734786804941 [id=5e0e281e579342c0ba3a9e7530c61486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.814477 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8144af4435e4ed08ff7680dc808a09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.792989 11488 tablet_service.cc:1511] Processing CreateTablet for tablet f8144af4435e4ed08ff7680dc808a09c (DEFAULT_TABLE table=default.Table_d55afd57e18746038f74734786804941 [id=5e0e281e579342c0ba3a9e7530c61486]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.813802 13713 raft_consensus.cc:493] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.818182 13713 raft_consensus.cc:515] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:16.818589 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8144af4435e4ed08ff7680dc808a09c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.818812 13713 leader_election.cc:290] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:16.819521 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4930edeb2edd4e7494dbf1761b5d20c0" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:16.819747 11755 tablet_bootstrap.cc:492] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.819868 11755 ts_tablet_manager.cc:1403] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.151s user 0.000s sys 0.006s
W20260925 01:50:16.820079 11457 leader_election.cc:343] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.820526 11755 raft_consensus.cc:359] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.825340 11755 raft_consensus.cc:385] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.825603 11755 raft_consensus.cc:740] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.826174 11755 consensus_queue.cc:260] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.828657 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 186b99b9686a48bd815e4897dcf9cf16 (DEFAULT_TABLE table=default.Table_7fdf9bf8058a405bb0f934b312864480 [id=77c9980421b74883b8994af9a450d54a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.829046 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b99b9686a48bd815e4897dcf9cf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.830509 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 709305c6a4864009833f979a2fa7af77 (DEFAULT_TABLE table=default.Table_2b84bf610ee94c31aebe09bdd48350df [id=f6a1aa43ed474db7b574f17e0b6fafa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.830856 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709305c6a4864009833f979a2fa7af77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.835974 13689 raft_consensus.cc:493] T d401574e89014d2aaa5f98d0d9a2729f P b93565e796c94a3699eb1824383bbaeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.843207 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet b61b1bf5a8d446918edc6d166b7712ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.844340 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 709305c6a4864009833f979a2fa7af77 (DEFAULT_TABLE table=default.Table_2b84bf610ee94c31aebe09bdd48350df [id=f6a1aa43ed474db7b574f17e0b6fafa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.844830 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709305c6a4864009833f979a2fa7af77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.845152 11503 tablet_service.cc:1558] Processing DeleteTablet for tablet 85db5688ef064053870a39a906ad9071 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.845317 11946 log.cc:1199] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/2a37a6deaeb24c99824b62fbb2d603b1
I20260925 01:50:16.845651 11946 ts_tablet_manager.cc:1950] T 2a37a6deaeb24c99824b62fbb2d603b1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.847215 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1009) took 3844 ms. Trace:
I20260925 01:50:16.847330 11946 rpcz_store.cc:276] 0925 01:50:13.002540 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.052555 (+ 50015us) service_pool.cc:224] Handling call
0925 01:50:16.556537 (+3503982us) ts_tablet_manager.cc:1151] Deleting tablet 2a37a6deaeb24c99824b62fbb2d603b1
0925 01:50:16.556546 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.561969 (+ 5423us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.679519 (+117550us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.847192 (+167673us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3503193}
I20260925 01:50:16.847810 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1010) took 3758 ms. Trace:
I20260925 01:50:16.847994 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 2a37a6deaeb24c99824b62fbb2d603b1 (table default.Table_4ae934a7969f4cb2aae617f37447aa50 [id=a011ca83653c46f2a9a8cfaeace6319d]) successfully deleted
I20260925 01:50:16.847908 11946 rpcz_store.cc:276] 0925 01:50:13.089821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.090416 (+ 595us) service_pool.cc:224] Handling call
0925 01:50:16.847673 (+3757257us) ts_tablet_manager.cc:1151] Deleting tablet 915b1621cea64c03bd486ef32e815f5f
0925 01:50:16.847685 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.847792 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3757043}
I20260925 01:50:16.848327 11946 tablet_replica.cc:333] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.848558 11946 raft_consensus.cc:2243] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:16.848593 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 915b1621cea64c03bd486ef32e815f5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 915b1621cea64c03bd486ef32e815f5f already in progress: creating tablet
I20260925 01:50:16.848748 11946 raft_consensus.cc:2272] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.849293 11755 ts_tablet_manager.cc:1434] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.029s user 0.000s sys 0.002s
I20260925 01:50:16.849615 11755 tablet_bootstrap.cc:492] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.849927 11946 ts_tablet_manager.cc:1916] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.851338 11755 tablet_bootstrap.cc:654] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.851752 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
I20260925 01:50:16.856482 13452 raft_consensus.cc:493] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:16.857434 11753 tablet_bootstrap.cc:492] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:16.857411 13452 raft_consensus.cc:515] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.857551 11753 ts_tablet_manager.cc:1403] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.004s
I20260925 01:50:16.858003 13452 leader_election.cc:290] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:16.856103 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 785) took 8537 ms. Trace:
I20260925 01:50:16.858539 11753 raft_consensus.cc:359] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.858786 11753 raft_consensus.cc:385] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.858883 11753 raft_consensus.cc:740] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.858767 11953 rpcz_store.cc:276] 0925 01:50:08.318923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.319256 (+ 333us) service_pool.cc:224] Handling call
0925 01:50:16.632237 (+8312981us) ts_tablet_manager.cc:1151] Deleting tablet be89c0911dfa4b9d83d6bd88755be2b2
0925 01:50:16.632251 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.727750 (+ 95499us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.783274 (+ 55524us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.856083 (+ 72809us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8312815}
I20260925 01:50:16.859125 11953 tablet_replica.cc:333] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:16.859324 11953 raft_consensus.cc:2243] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:16.859273 11753 consensus_queue.cc:260] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.859607 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 186b99b9686a48bd815e4897dcf9cf16 (DEFAULT_TABLE table=default.Table_7fdf9bf8058a405bb0f934b312864480 [id=77c9980421b74883b8994af9a450d54a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.860046 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b99b9686a48bd815e4897dcf9cf16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.860354 11753 ts_tablet_manager.cc:1434] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:16.862408 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet be89c0911dfa4b9d83d6bd88755be2b2 (table default.Table_3ce60e2486054c3081ecab5a46f58e16 [id=653678819a1849b2a923a6793976ae8c]) successfully deleted
W20260925 01:50:16.866508 11314 leader_election.cc:343] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: e95fb28febd94a26ba9682fb9a462872
I20260925 01:50:16.867110 11753 tablet_bootstrap.cc:492] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:16.868621 11753 tablet_bootstrap.cc:654] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.859623 11953 pending_rounds.cc:70] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Trying to abort 1 pending ops.
I20260925 01:50:16.870970 11953 pending_rounds.cc:77] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7333072932274843648 op_type: NO_OP noop_request { }
I20260925 01:50:16.871083 11953 raft_consensus.cc:2889] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 01:50:16.871413 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 39f7bc79c6ef44298358d5cdb201c610 (DEFAULT_TABLE table=default.Table_f728cc17ba0a422aaf10e1f6377f8136 [id=7de4867b46854bc3be26388406101c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.872054 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 39f7bc79c6ef44298358d5cdb201c610 (DEFAULT_TABLE table=default.Table_f728cc17ba0a422aaf10e1f6377f8136 [id=7de4867b46854bc3be26388406101c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.872401 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f7bc79c6ef44298358d5cdb201c610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.876190 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f7bc79c6ef44298358d5cdb201c610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.877668 11946 ts_tablet_manager.cc:1929] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:16.877791 11946 log.cc:1199] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/f385af75e11c4643b4e7c2d899ee99a4
I20260925 01:50:16.878355 11946 ts_tablet_manager.cc:1950] T f385af75e11c4643b4e7c2d899ee99a4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.879343 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1012) took 3772 ms. Trace:
I20260925 01:50:16.879451 11946 rpcz_store.cc:276] 0925 01:50:13.106638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.106745 (+ 107us) service_pool.cc:224] Handling call
0925 01:50:16.848276 (+3741531us) ts_tablet_manager.cc:1151] Deleting tablet f385af75e11c4643b4e7c2d899ee99a4
0925 01:50:16.848287 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.853509 (+ 5222us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.877604 (+ 24095us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.879319 (+ 1715us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3741295}
I20260925 01:50:16.879565 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 2e785a6fd3cc440a9e984e81bd306bc9 (DEFAULT_TABLE table=default.Table_cdece493529349aca97c9cd6eb9e7b11 [id=1573055b561248a5bbe6d80b65b18c3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.879844 11946 tablet_replica.cc:333] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.880029 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e785a6fd3cc440a9e984e81bd306bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.880101 11946 raft_consensus.cc:2243] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.880276 11946 raft_consensus.cc:2272] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.880795 11946 ts_tablet_manager.cc:1916] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.882794 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet f385af75e11c4643b4e7c2d899ee99a4 (table default.Table_0d011eae3e3e4b40a2df36dd1362b71e [id=6edf9644aff24924b25ac5b41147c40c]) successfully deleted
I20260925 01:50:16.883721 11953 raft_consensus.cc:2272] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.884325 11953 ts_tablet_manager.cc:1916] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.884864 13452 raft_consensus.cc:493] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.885010 11753 tablet_bootstrap.cc:492] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:16.884994 13452 raft_consensus.cc:515] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.885123 11753 ts_tablet_manager.cc:1403] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.005s
I20260925 01:50:16.885586 13452 leader_election.cc:290] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:16.886773 11314 leader_election.cc:343] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: f46004be36b543a395a783a13b1b14cf
I20260925 01:50:16.885720 11753 raft_consensus.cc:359] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.887156 11753 raft_consensus.cc:385] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.887249 11753 raft_consensus.cc:740] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.887533 11753 consensus_queue.cc:260] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.887966 11946 ts_tablet_manager.cc:1929] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.888062 11946 log.cc:1199] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5122b8c24d3442a1a52ff0b003d65ffb
I20260925 01:50:16.888317 11946 ts_tablet_manager.cc:1950] T 5122b8c24d3442a1a52ff0b003d65ffb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.890892 11753 ts_tablet_manager.cc:1434] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 01:50:16.891196 11753 tablet_bootstrap.cc:492] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:16.892123 13458 raft_consensus.cc:493] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.892252 13458 raft_consensus.cc:515] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.892642 11753 tablet_bootstrap.cc:654] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.892835 13458 leader_election.cc:290] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:16.893214 11495 tablet_service.cc:1511] Processing CreateTablet for tablet e78b57d4a08f4380aa35ee3bf57d4df3 (DEFAULT_TABLE table=default.Table_45047ee3993f4d56830d4d28479fc138 [id=0896efc4a5af42af9069f113febe2156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.893589 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78b57d4a08f4380aa35ee3bf57d4df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.894003 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1011) took 3787 ms. Trace:
I20260925 01:50:16.894132 11946 rpcz_store.cc:276] 0925 01:50:13.106475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.107102 (+ 627us) service_pool.cc:224] Handling call
0925 01:50:16.879793 (+3772691us) ts_tablet_manager.cc:1151] Deleting tablet 5122b8c24d3442a1a52ff0b003d65ffb
0925 01:50:16.879803 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.884437 (+ 4634us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.887925 (+ 3488us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.893985 (+ 6060us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3772527}
I20260925 01:50:16.894569 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5122b8c24d3442a1a52ff0b003d65ffb (table default.Table_aef1efeefaf4495bb03c12af5e28505b [id=d97f3281c5084ab184e72bb9ff6c8c41]) successfully deleted
I20260925 01:50:16.894608 11355 tablet_service.cc:1511] Processing CreateTablet for tablet a94a08841e4f4e7fb1513d3c674ea380 (DEFAULT_TABLE table=default.Table_30cf8a0d9f664848b66efda848625415 [id=3fd1df291b154b069a76d8f72067c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.894944 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94a08841e4f4e7fb1513d3c674ea380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.898380 11491 tablet_service.cc:1511] Processing CreateTablet for tablet a94a08841e4f4e7fb1513d3c674ea380 (DEFAULT_TABLE table=default.Table_30cf8a0d9f664848b66efda848625415 [id=3fd1df291b154b069a76d8f72067c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.898633 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1014) took 3724 ms. Trace:
I20260925 01:50:16.898689 13452 raft_consensus.cc:493] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.898705 11946 rpcz_store.cc:276] 0925 01:50:13.174044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.174132 (+ 88us) service_pool.cc:224] Handling call
0925 01:50:16.894401 (+3720269us) ts_tablet_manager.cc:1151] Deleting tablet 5276072bbeca403fb06566b4a43489a0
0925 01:50:16.898501 (+ 4100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.898613 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3720073}
I20260925 01:50:16.898804 13452 raft_consensus.cc:515] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:16.899173 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 5276072bbeca403fb06566b4a43489a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5276072bbeca403fb06566b4a43489a0 already in progress: creating tablet
I20260925 01:50:16.899354 13452 leader_election.cc:290] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:16.901778 11491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a94a08841e4f4e7fb1513d3c674ea380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.904074 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 2e785a6fd3cc440a9e984e81bd306bc9 (DEFAULT_TABLE table=default.Table_cdece493529349aca97c9cd6eb9e7b11 [id=1573055b561248a5bbe6d80b65b18c3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.904434 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e785a6fd3cc440a9e984e81bd306bc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.906322 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1015) took 3731 ms. Trace:
I20260925 01:50:16.906422 11946 rpcz_store.cc:276] 0925 01:50:13.174896 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.174948 (+ 52us) service_pool.cc:224] Handling call
0925 01:50:16.898948 (+3724000us) ts_tablet_manager.cc:1151] Deleting tablet d0edb8007afa42c6af8b289ff9cea830
0925 01:50:16.906161 (+ 7213us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.906298 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3723841}
I20260925 01:50:16.906740 11946 tablet_replica.cc:333] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:16.906718 11314 leader_election.cc:343] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b97f703869d4471cb940ef654203ec2b
W20260925 01:50:16.906939 11314 leader_election.cc:343] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 0c01195f07b84b359a974fab5ed52582
I20260925 01:50:16.906934 11946 raft_consensus.cc:2243] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:16.907217 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d0edb8007afa42c6af8b289ff9cea830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0edb8007afa42c6af8b289ff9cea830 already in progress: creating tablet
I20260925 01:50:16.907364 11946 raft_consensus.cc:2272] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.907900 11946 ts_tablet_manager.cc:1916] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.913703 11359 tablet_service.cc:1511] Processing CreateTablet for tablet e78b57d4a08f4380aa35ee3bf57d4df3 (DEFAULT_TABLE table=default.Table_45047ee3993f4d56830d4d28479fc138 [id=0896efc4a5af42af9069f113febe2156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.914310 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78b57d4a08f4380aa35ee3bf57d4df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.916407 11946 ts_tablet_manager.cc:1929] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.916518 11946 log.cc:1199] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a8055cc9b06045449e6133298c8074e1
I20260925 01:50:16.917057 11946 ts_tablet_manager.cc:1950] T a8055cc9b06045449e6133298c8074e1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.919085 11753 tablet_bootstrap.cc:492] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:16.919262 11753 ts_tablet_manager.cc:1403] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.012s
I20260925 01:50:16.920460 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1017) took 3743 ms. Trace:
I20260925 01:50:16.920580 11946 rpcz_store.cc:276] 0925 01:50:13.176791 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.177308 (+ 517us) service_pool.cc:224] Handling call
0925 01:50:16.906687 (+3729379us) ts_tablet_manager.cc:1151] Deleting tablet a8055cc9b06045449e6133298c8074e1
0925 01:50:16.906696 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.911988 (+ 5292us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.916349 (+ 4361us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.920442 (+ 4093us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3729210}
I20260925 01:50:16.920900 11946 tablet_replica.cc:333] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.921105 11946 raft_consensus.cc:2243] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.921258 11946 raft_consensus.cc:2272] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.921774 11946 ts_tablet_manager.cc:1916] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.923272 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet d07df8063b2e4971a12af229585cfe44 (table default.Table_bb66c0a95d8241b292c7b0952b5ee75c [id=a3f1002dfc3c4ba38bdec9e7b2bc25b6]). Expected version 1 got 0
I20260925 01:50:16.926681 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a8055cc9b06045449e6133298c8074e1 (table default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]) successfully deleted
I20260925 01:50:16.927371 11495 tablet_service.cc:1558] Processing DeleteTablet for tablet 47b62644673447239feb0f8f851012ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:16.928195 11755 tablet_bootstrap.cc:492] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:16.928365 11755 ts_tablet_manager.cc:1403] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.000s
I20260925 01:50:16.928851 11946 ts_tablet_manager.cc:1929] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.928959 11946 log.cc:1199] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/bd594870fa6a4ba190a18a48d821d72c
I20260925 01:50:16.929271 11946 ts_tablet_manager.cc:1950] T bd594870fa6a4ba190a18a48d821d72c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.929143 11755 raft_consensus.cc:359] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.929340 11755 raft_consensus.cc:385] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.929400 11755 raft_consensus.cc:740] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.930051 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1016) took 3753 ms. Trace:
I20260925 01:50:16.930157 11946 rpcz_store.cc:276] 0925 01:50:13.176668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.178344 (+ 1676us) service_pool.cc:224] Handling call
0925 01:50:16.920859 (+3742515us) ts_tablet_manager.cc:1151] Deleting tablet bd594870fa6a4ba190a18a48d821d72c
0925 01:50:16.920868 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.925662 (+ 4794us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.928802 (+ 3140us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.930032 (+ 1230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3742375}
I20260925 01:50:16.930380 13586 raft_consensus.cc:493] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.930521 13586 raft_consensus.cc:515] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.930532 11753 raft_consensus.cc:359] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.930773 11753 raft_consensus.cc:385] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:16.930850 11753 raft_consensus.cc:740] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:16.931097 13586 leader_election.cc:290] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:16.931252 11753 consensus_queue.cc:260] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.931797 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aadd649e4b4f489bfe4b0eea13ede8" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:16.932410 11753 ts_tablet_manager.cc:1434] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260925 01:50:16.934602 11753 tablet_bootstrap.cc:492] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:16.936692 11753 tablet_bootstrap.cc:654] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.937096 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 64ce95e571524d6ea6c98087bc08d4b9 (table default.Table_d3033e2cc4344abcabf1b52f454c2a82 [id=a366ecc4f824423ea7184781cf6a0206]). Expected version 2 got 0
W20260925 01:50:16.938510 11457 leader_election.cc:343] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:16.938942 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet bd594870fa6a4ba190a18a48d821d72c (table default.Table_8041861b60a24a3c974d0e20742fc1ac [id=c5063b64da5341b9a9e9282585d74695]) successfully deleted
I20260925 01:50:16.941390 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1013) took 3767 ms. Trace:
I20260925 01:50:16.941530 11946 rpcz_store.cc:276] 0925 01:50:13.173743 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.182579 (+ 8836us) service_pool.cc:224] Handling call
0925 01:50:16.932596 (+3750017us) ts_tablet_manager.cc:1151] Deleting tablet d08b978d9b2945ffa966e2237bddd48c
0925 01:50:16.941217 (+ 8621us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.941361 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3625925}
I20260925 01:50:16.942173 11946 tablet_replica.cc:333] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.942468 11946 raft_consensus.cc:2243] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.942682 11946 raft_consensus.cc:2272] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.943439 11946 ts_tablet_manager.cc:1916] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.945483 11671 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 64ce95e571524d6ea6c98087bc08d4b9 (table default.Table_d3033e2cc4344abcabf1b52f454c2a82 [id=a366ecc4f824423ea7184781cf6a0206]). Expected version 2 got 0
W20260925 01:50:16.953787 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet d08b978d9b2945ffa966e2237bddd48c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08b978d9b2945ffa966e2237bddd48c already in progress: creating tablet
I20260925 01:50:16.957739 11495 tablet_service.cc:1511] Processing CreateTablet for tablet d290933e4efc4040aea4fe553a4c5035 (DEFAULT_TABLE table=default.Table_8e2f973593334b65afc2c3ac0c170a62 [id=542f99079b0b4f93be2f8b0f7a7cbd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.958257 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d290933e4efc4040aea4fe553a4c5035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.959192 11946 ts_tablet_manager.cc:1929] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.959326 11755 consensus_queue.cc:260] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.963465 11358 tablet_service.cc:1511] Processing CreateTablet for tablet d290933e4efc4040aea4fe553a4c5035 (DEFAULT_TABLE table=default.Table_8e2f973593334b65afc2c3ac0c170a62 [id=542f99079b0b4f93be2f8b0f7a7cbd16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.964329 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d290933e4efc4040aea4fe553a4c5035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:16.965752 11946 log.cc:1199] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/4f117df272c342b6b4ea5e5a4d7fd137
I20260925 01:50:16.966293 11946 ts_tablet_manager.cc:1950] T 4f117df272c342b6b4ea5e5a4d7fd137 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.968040 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1019) took 3659 ms. Trace:
I20260925 01:50:16.968243 11946 rpcz_store.cc:276] 0925 01:50:13.308129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.308192 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:16.942103 (+3633911us) ts_tablet_manager.cc:1151] Deleting tablet 4f117df272c342b6b4ea5e5a4d7fd137
0925 01:50:16.942118 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.948222 (+ 6104us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.959141 (+ 10919us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.968007 (+ 8866us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3633725}
I20260925 01:50:16.968992 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 4f117df272c342b6b4ea5e5a4d7fd137 (table default.Table_f0078624576649ef939ea7242932cca4 [id=87123c3a37a043358c97309b26bae779]) successfully deleted
I20260925 01:50:16.969040 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1020) took 3660 ms. Trace:
I20260925 01:50:16.969151 11946 rpcz_store.cc:276] 0925 01:50:13.308248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.308327 (+ 79us) service_pool.cc:224] Handling call
0925 01:50:16.968827 (+3660500us) ts_tablet_manager.cc:1151] Deleting tablet 38249392c0df4d50b0e09f3671f92800
0925 01:50:16.968844 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.969019 (+ 175us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3660328}
I20260925 01:50:16.969522 11946 tablet_replica.cc:333] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:16.969785 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 38249392c0df4d50b0e09f3671f92800 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38249392c0df4d50b0e09f3671f92800 already in progress: creating tablet
I20260925 01:50:16.969803 11946 raft_consensus.cc:2243] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.969993 11946 raft_consensus.cc:2272] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.971159 11946 ts_tablet_manager.cc:1916] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:16.972906 11755 ts_tablet_manager.cc:1434] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.044s user 0.002s sys 0.001s
I20260925 01:50:16.977540 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ffb404d93a4436ba9e624b45650fe1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:16.983237 11755 tablet_bootstrap.cc:492] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:16.984104 11487 tablet_service.cc:1511] Processing CreateTablet for tablet 73c6a6781be8487d8d6b0112fbbdd3c9 (DEFAULT_TABLE table=default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:16.985183 11755 tablet_bootstrap.cc:654] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:16.988819 11946 ts_tablet_manager.cc:1929] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:16.990921 13458 raft_consensus.cc:493] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:16.991065 13458 raft_consensus.cc:515] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:16.991696 13458 leader_election.cc:290] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:16.992863 11314 leader_election.cc:343] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 406d31139e1e441aa6fe204168486e28
I20260925 01:50:16.995046 11946 log.cc:1199] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/d401574e89014d2aaa5f98d0d9a2729f
I20260925 01:50:16.995616 11946 ts_tablet_manager.cc:1950] T d401574e89014d2aaa5f98d0d9a2729f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:16.996721 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1018) took 3688 ms. Trace:
I20260925 01:50:16.996928 11946 rpcz_store.cc:276] 0925 01:50:13.308000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.308542 (+ 542us) service_pool.cc:224] Handling call
0925 01:50:16.969456 (+3660914us) ts_tablet_manager.cc:1151] Deleting tablet d401574e89014d2aaa5f98d0d9a2729f
0925 01:50:16.969468 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.975705 (+ 6237us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.988739 (+ 13034us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:16.996693 (+ 7954us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3660779}
I20260925 01:50:16.997534 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet d401574e89014d2aaa5f98d0d9a2729f (table default.Table_320d2038849e40c199abf2f5df73274b [id=977b69f7df2c41cab43ee3498fb261c3]) successfully deleted
I20260925 01:50:16.997710 11946 tablet_replica.cc:333] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:16.998031 11946 raft_consensus.cc:2243] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:16.998335 11946 raft_consensus.cc:2272] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:16.999105 11946 ts_tablet_manager.cc:1916] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.002174 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c6a6781be8487d8d6b0112fbbdd3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.003057 11953 ts_tablet_manager.cc:1929] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:17.003199 11953 log.cc:1199] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/829d167dc0214890b722c0197500f159
I20260925 01:50:17.003588 11953 ts_tablet_manager.cc:1950] T 829d167dc0214890b722c0197500f159 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.004406 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 787) took 8685 ms. Trace:
I20260925 01:50:17.004527 11953 rpcz_store.cc:276] 0925 01:50:08.319108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.319173 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:16.859077 (+8539904us) ts_tablet_manager.cc:1151] Deleting tablet 829d167dc0214890b722c0197500f159
0925 01:50:16.859086 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:16.925978 (+ 66892us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.002999 (+ 77021us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.004387 (+ 1388us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8539614}
I20260925 01:50:17.005051 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 829d167dc0214890b722c0197500f159 (table default.Table_5ee00c6a9b644c778e571ff1952327d1 [id=83d275d67d4340e985a5c6a6e3354c45]) successfully deleted
I20260925 01:50:17.005398 11953 tablet_replica.cc:333] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.005600 11953 raft_consensus.cc:2243] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.005846 11953 raft_consensus.cc:2272] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.006781 11359 tablet_service.cc:1511] Processing CreateTablet for tablet 73c6a6781be8487d8d6b0112fbbdd3c9 (DEFAULT_TABLE table=default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.007210 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c6a6781be8487d8d6b0112fbbdd3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.008107 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 10d734c878f645e1a45305d2bbd32228 (DEFAULT_TABLE table=default.Table_949b582350a34f2cbdb030e708ec9d83 [id=9df076090524484a926fe0fe7b59fa06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.008452 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d734c878f645e1a45305d2bbd32228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.013792 11946 ts_tablet_manager.cc:1929] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.013968 11946 log.cc:1199] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/3702f09e45a14c80af716d642d30cdfa
I20260925 01:50:17.014317 11946 ts_tablet_manager.cc:1950] T 3702f09e45a14c80af716d642d30cdfa P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.018815 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1021) took 3690 ms. Trace:
I20260925 01:50:17.018939 11755 tablet_bootstrap.cc:492] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.019116 11755 ts_tablet_manager.cc:1403] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260925 01:50:17.019552 11946 rpcz_store.cc:276] 0925 01:50:13.328823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.328880 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:16.997639 (+3668759us) ts_tablet_manager.cc:1151] Deleting tablet 3702f09e45a14c80af716d642d30cdfa
0925 01:50:16.997654 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.010756 (+ 13102us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.013745 (+ 2989us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.018795 (+ 5050us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3668549}
I20260925 01:50:17.019912 11946 tablet_replica.cc:333] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.020105 11946 raft_consensus.cc:2243] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.020131 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 3702f09e45a14c80af716d642d30cdfa (table default.Table_c5ab983011a64d018825a79f53480036 [id=b23610fb50124879a61cdc044e5287b5]) successfully deleted
I20260925 01:50:17.020241 11946 raft_consensus.cc:2272] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.020709 11946 ts_tablet_manager.cc:1916] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.019491 11753 tablet_bootstrap.cc:492] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.022197 11753 ts_tablet_manager.cc:1403] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.088s user 0.022s sys 0.043s
I20260925 01:50:17.022601 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 73982398ea574c4a91a342d5fded5043 (DEFAULT_TABLE table=default.Table_d8796cbab6bf43eca69ec0652e34fe86 [id=bddf47e161f04301ac5cc1a8e1b6670c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.022651 11755 raft_consensus.cc:359] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.022894 11755 raft_consensus.cc:385] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.022991 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73982398ea574c4a91a342d5fded5043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.023079 11755 raft_consensus.cc:740] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.023993 11755 consensus_queue.cc:260] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.025731 13586 raft_consensus.cc:493] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.025853 13586 raft_consensus.cc:515] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.026536 13586 leader_election.cc:290] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.029908 11753 raft_consensus.cc:359] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.030112 11753 raft_consensus.cc:385] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.030164 11753 raft_consensus.cc:740] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.027138 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ce95e571524d6ea6c98087bc08d4b9" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:17.030364 11753 consensus_queue.cc:260] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.030817 11753 ts_tablet_manager.cc:1434] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
W20260925 01:50:17.033450 11457 leader_election.cc:343] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.033715 11753 tablet_bootstrap.cc:492] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.039002 11342 tablet_service.cc:1558] Processing DeleteTablet for tablet f2618c46630c4295949b36f3d0087941 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.040692 11946 ts_tablet_manager.cc:1929] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.040800 11946 log.cc:1199] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/9663d7f4008e4ee0a3ba4373258242eb
I20260925 01:50:17.041090 11946 ts_tablet_manager.cc:1950] T 9663d7f4008e4ee0a3ba4373258242eb P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.041822 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1022) took 3620 ms. Trace:
I20260925 01:50:17.041913 11946 rpcz_store.cc:276] 0925 01:50:13.421290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.421358 (+ 68us) service_pool.cc:224] Handling call
0925 01:50:17.019869 (+3598511us) ts_tablet_manager.cc:1151] Deleting tablet 9663d7f4008e4ee0a3ba4373258242eb
0925 01:50:17.019878 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.037473 (+ 17595us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.040639 (+ 3166us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.041801 (+ 1162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3598265}
I20260925 01:50:17.042265 11946 tablet_replica.cc:333] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.042447 11946 raft_consensus.cc:2243] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.042591 11946 raft_consensus.cc:2272] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.043123 11946 ts_tablet_manager.cc:1916] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.044138 11953 ts_tablet_manager.cc:1916] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.046548 11753 tablet_bootstrap.cc:654] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.058228 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 9663d7f4008e4ee0a3ba4373258242eb (table default.Table_0e29902f6a844cb5b9bc1d8e99da120e [id=201d4639a19041b7ada8bbd3985d867f]) successfully deleted
I20260925 01:50:17.059746 11946 ts_tablet_manager.cc:1929] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.059988 11946 log.cc:1199] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/ab8d5af739854f939ab585d943e7b7ca
I20260925 01:50:17.060374 11946 ts_tablet_manager.cc:1950] T ab8d5af739854f939ab585d943e7b7ca P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.060905 11753 tablet_bootstrap.cc:492] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.061049 11753 ts_tablet_manager.cc:1403] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.005s
I20260925 01:50:17.061421 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1023) took 3568 ms. Trace:
I20260925 01:50:17.061581 11946 rpcz_store.cc:276] 0925 01:50:13.493224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.493275 (+ 51us) service_pool.cc:224] Handling call
0925 01:50:17.042222 (+3548947us) ts_tablet_manager.cc:1151] Deleting tablet ab8d5af739854f939ab585d943e7b7ca
0925 01:50:17.042231 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.056151 (+ 13920us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.059685 (+ 3534us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.061399 (+ 1714us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3548730}
I20260925 01:50:17.061818 11753 raft_consensus.cc:359] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.061992 11753 raft_consensus.cc:385] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.062077 11753 raft_consensus.cc:740] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.062310 11753 consensus_queue.cc:260] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.062848 11753 ts_tablet_manager.cc:1434] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:17.064313 11753 tablet_bootstrap.cc:492] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.065641 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet ab8d5af739854f939ab585d943e7b7ca (table default.Table_b4bfc0be56f644a58a63e250d8b3e1fc [id=ad065d5b1440401bb0897d5e5ac3cb30]) successfully deleted
I20260925 01:50:17.065732 13586 raft_consensus.cc:493] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.065871 13586 raft_consensus.cc:515] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.066165 11946 tablet_replica.cc:333] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.066195 11753 tablet_bootstrap.cc:654] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.066548 13586 leader_election.cc:290] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.066381 11946 raft_consensus.cc:2243] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.067167 11946 raft_consensus.cc:2272] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.067277 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d37a05d2bcd4c94ba51fef8096f889d" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:17.067874 11946 ts_tablet_manager.cc:1916] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:17.067998 11457 leader_election.cc:343] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.076041 11946 ts_tablet_manager.cc:1929] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.076236 11946 log.cc:1199] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/bfc152df745b46fb84aec1c9fa017ba5
I20260925 01:50:17.076642 11946 ts_tablet_manager.cc:1950] T bfc152df745b46fb84aec1c9fa017ba5 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.077639 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1029) took 3436 ms. Trace:
I20260925 01:50:17.078518 11495 tablet_service.cc:1511] Processing CreateTablet for tablet a0bb8bc1896449ff871c29597e17cbdb (DEFAULT_TABLE table=default.Table_3f086080b9334a1388185e942992e65d [id=41147f7b7f324917a7b8a2e63bc2100b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.079066 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bb8bc1896449ff871c29597e17cbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.079569 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 9c83217ab3f64e1285dbabcf267e1af2 (DEFAULT_TABLE table=default.Table_fb943909bd9f467ea5a0d11972b7ae55 [id=15af5ff18871486a98210060ef2d99d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.078881 11359 tablet_service.cc:1511] Processing CreateTablet for tablet a0bb8bc1896449ff871c29597e17cbdb (DEFAULT_TABLE table=default.Table_3f086080b9334a1388185e942992e65d [id=41147f7b7f324917a7b8a2e63bc2100b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.082532 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 264d215bb8994c8688df1f1263669f89 (DEFAULT_TABLE table=default.Table_c09c4425b40144d0a7ca1abb8474429f [id=6074e5f1eabd411b846c11505bc0c598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.084187 11358 tablet_service.cc:1511] Processing CreateTablet for tablet 10d734c878f645e1a45305d2bbd32228 (DEFAULT_TABLE table=default.Table_949b582350a34f2cbdb030e708ec9d83 [id=9df076090524484a926fe0fe7b59fa06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.084749 11755 ts_tablet_manager.cc:1434] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.066s user 0.001s sys 0.000s
I20260925 01:50:17.087477 11488 tablet_service.cc:1511] Processing CreateTablet for tablet 264d215bb8994c8688df1f1263669f89 (DEFAULT_TABLE table=default.Table_c09c4425b40144d0a7ca1abb8474429f [id=6074e5f1eabd411b846c11505bc0c598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.087895 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264d215bb8994c8688df1f1263669f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.088025 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 9c83217ab3f64e1285dbabcf267e1af2 (DEFAULT_TABLE table=default.Table_fb943909bd9f467ea5a0d11972b7ae55 [id=15af5ff18871486a98210060ef2d99d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.088121 11755 tablet_bootstrap.cc:492] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.088438 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c83217ab3f64e1285dbabcf267e1af2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.090894 11755 tablet_bootstrap.cc:654] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.092476 11360 tablet_service.cc:1511] Processing CreateTablet for tablet 73982398ea574c4a91a342d5fded5043 (DEFAULT_TABLE table=default.Table_d8796cbab6bf43eca69ec0652e34fe86 [id=bddf47e161f04301ac5cc1a8e1b6670c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.077842 11946 rpcz_store.cc:276] 0925 01:50:13.641345 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.643335 (+ 1990us) service_pool.cc:224] Handling call
0925 01:50:17.066048 (+3422713us) ts_tablet_manager.cc:1151] Deleting tablet bfc152df745b46fb84aec1c9fa017ba5
0925 01:50:17.066119 (+ 71us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.071514 (+ 5395us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.075988 (+ 4474us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.077612 (+ 1624us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3422528}
I20260925 01:50:17.105650 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet bfc152df745b46fb84aec1c9fa017ba5 (table default.Table_45e7213362f74039a9576e25db157d24 [id=7911f341edd649f588389f6e9b530665]) successfully deleted
I20260925 01:50:17.106185 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1030) took 3452 ms. Trace:
I20260925 01:50:17.106323 11946 rpcz_store.cc:276] 0925 01:50:13.654153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.670930 (+ 16777us) service_pool.cc:224] Handling call
0925 01:50:17.106021 (+3435091us) ts_tablet_manager.cc:1151] Deleting tablet 1b0d592dcd7a4a119befea22c35f5b2d
0925 01:50:17.106032 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.106166 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3434880}
W20260925 01:50:17.106845 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1b0d592dcd7a4a119befea22c35f5b2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b0d592dcd7a4a119befea22c35f5b2d already in progress: creating tablet
I20260925 01:50:17.107362 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1038) took 3360 ms. Trace:
I20260925 01:50:17.107555 11946 rpcz_store.cc:276] 0925 01:50:13.746806 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.747043 (+ 237us) service_pool.cc:224] Handling call
0925 01:50:17.107252 (+3360209us) ts_tablet_manager.cc:1151] Deleting tablet 71a64863f0744f44943113d7c60806b7
0925 01:50:17.107262 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.107341 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3359971}
W20260925 01:50:17.108237 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 71a64863f0744f44943113d7c60806b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71a64863f0744f44943113d7c60806b7 already in progress: creating tablet
I20260925 01:50:17.108747 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1036) took 3363 ms. Trace:
I20260925 01:50:17.108901 11946 rpcz_store.cc:276] 0925 01:50:13.744873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.748036 (+ 3163us) service_pool.cc:224] Handling call
0925 01:50:17.108606 (+3360570us) ts_tablet_manager.cc:1151] Deleting tablet 9e86bd9a65dd46f09d87ddd831552b59
0925 01:50:17.108620 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.108723 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3360297}
W20260925 01:50:17.109539 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 9e86bd9a65dd46f09d87ddd831552b59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e86bd9a65dd46f09d87ddd831552b59 already in progress: creating tablet
I20260925 01:50:17.110105 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1035) took 3365 ms. Trace:
I20260925 01:50:17.110277 11946 rpcz_store.cc:276] 0925 01:50:13.744723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.748348 (+ 3625us) service_pool.cc:224] Handling call
0925 01:50:17.109924 (+3361576us) ts_tablet_manager.cc:1151] Deleting tablet 313ef1a795454be38e6ab617c3b21bf5
0925 01:50:17.109938 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.110042 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3358332}
W20260925 01:50:17.111001 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 313ef1a795454be38e6ab617c3b21bf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 313ef1a795454be38e6ab617c3b21bf5 already in progress: creating tablet
I20260925 01:50:17.111510 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1044) took 3309 ms. Trace:
I20260925 01:50:17.111665 11946 rpcz_store.cc:276] 0925 01:50:13.801581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.801845 (+ 264us) service_pool.cc:224] Handling call
0925 01:50:17.111374 (+3309529us) ts_tablet_manager.cc:1151] Deleting tablet fb9339ab8dcb4ecca41fef9e9552009e
0925 01:50:17.111387 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.111487 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3309351}
W20260925 01:50:17.112295 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet fb9339ab8dcb4ecca41fef9e9552009e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb9339ab8dcb4ecca41fef9e9552009e already in progress: creating tablet
I20260925 01:50:17.112797 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1046) took 3311 ms. Trace:
I20260925 01:50:17.112968 11946 rpcz_store.cc:276] 0925 01:50:13.801792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.802117 (+ 325us) service_pool.cc:224] Handling call
0925 01:50:17.112659 (+3310542us) ts_tablet_manager.cc:1151] Deleting tablet 1cac299e4f8e4c9d90f244cd8719005a
0925 01:50:17.112672 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.112775 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3310364}
W20260925 01:50:17.113626 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1cac299e4f8e4c9d90f244cd8719005a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cac299e4f8e4c9d90f244cd8719005a already in progress: creating tablet
I20260925 01:50:17.114195 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1037) took 3367 ms. Trace:
I20260925 01:50:17.114349 11946 rpcz_store.cc:276] 0925 01:50:13.746669 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.844216 (+ 97547us) service_pool.cc:224] Handling call
0925 01:50:17.114019 (+3269803us) ts_tablet_manager.cc:1151] Deleting tablet 262ea578b7ea4ffa87bd5b8d398e6e2a
0925 01:50:17.114032 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.114172 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3265917}
W20260925 01:50:17.114858 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 262ea578b7ea4ffa87bd5b8d398e6e2a already in progress: creating tablet
I20260925 01:50:17.115248 11946 tablet_replica.cc:333] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.115525 11946 raft_consensus.cc:2243] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.115751 11946 raft_consensus.cc:2272] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.116333 11946 ts_tablet_manager.cc:1916] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.118633 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264d215bb8994c8688df1f1263669f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.118938 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c83217ab3f64e1285dbabcf267e1af2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.119513 11359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bb8bc1896449ff871c29597e17cbdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.120074 11358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d734c878f645e1a45305d2bbd32228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.120728 11360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73982398ea574c4a91a342d5fded5043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.125468 11946 ts_tablet_manager.cc:1929] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.125690 11946 log.cc:1199] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/75014fc54fc7481f83da07e1d96c4370
I20260925 01:50:17.126175 11946 ts_tablet_manager.cc:1950] T 75014fc54fc7481f83da07e1d96c4370 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.120069 11953 ts_tablet_manager.cc:1929] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260925 01:50:17.126793 11953 log.cc:1199] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/b306496f992f45a9b64b05b73712cb5b
I20260925 01:50:17.127094 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1053) took 3208 ms. Trace:
I20260925 01:50:17.127286 11953 ts_tablet_manager.cc:1950] T b306496f992f45a9b64b05b73712cb5b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.127231 11946 rpcz_store.cc:276] 0925 01:50:13.918684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.919648 (+ 964us) service_pool.cc:224] Handling call
0925 01:50:17.115184 (+3195536us) ts_tablet_manager.cc:1151] Deleting tablet 75014fc54fc7481f83da07e1d96c4370
0925 01:50:17.115193 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.120790 (+ 5597us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.125410 (+ 4620us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.127069 (+ 1659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3158905}
I20260925 01:50:17.127868 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 75014fc54fc7481f83da07e1d96c4370 (table default.Table_02c7cceb7e4f4d8d86e3e9f9bdea7b85 [id=bc109ead6d44465f944331ce2a20a350]) successfully deleted
I20260925 01:50:17.128257 13586 raft_consensus.cc:493] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.128507 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1081) took 2269 ms. Trace:
I20260925 01:50:17.128448 13586 raft_consensus.cc:515] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.129390 13586 leader_election.cc:290] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.129671 11946 rpcz_store.cc:276] 0925 01:50:14.858990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.859396 (+ 406us) service_pool.cc:224] Handling call
0925 01:50:17.128328 (+2268932us) ts_tablet_manager.cc:1151] Deleting tablet 0b0ce45b63c44b46a26a84dbc1eff4dc
0925 01:50:17.128343 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.128481 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2218161}
I20260925 01:50:17.129967 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07df8063b2e4971a12af229585cfe44" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.130147 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b0ce45b63c44b46a26a84dbc1eff4dc already in progress: creating tablet
W20260925 01:50:17.130553 11457 leader_election.cc:343] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.130622 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1085) took 2270 ms. Trace:
I20260925 01:50:17.130697 11946 rpcz_store.cc:276] 0925 01:50:14.859906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.862577 (+ 2671us) service_pool.cc:224] Handling call
0925 01:50:17.130441 (+2267864us) ts_tablet_manager.cc:1151] Deleting tablet 3d867e7f58554c1196e837346b0b37d3
0925 01:50:17.130455 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.130598 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2143650}
I20260925 01:50:17.131513 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1086) took 2271 ms. Trace:
I20260925 01:50:17.131666 11946 rpcz_store.cc:276] 0925 01:50:14.860005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.866717 (+ 6712us) service_pool.cc:224] Handling call
0925 01:50:17.131337 (+2264620us) ts_tablet_manager.cc:1151] Deleting tablet 6f2f5603ea23446c9db47fd78d0c7854
0925 01:50:17.131372 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.131496 (+ 124us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2124109}
I20260925 01:50:17.132332 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 786) took 8813 ms. Trace:
I20260925 01:50:17.132463 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1084) took 2272 ms. Trace:
I20260925 01:50:17.132464 11953 rpcz_store.cc:276] 0925 01:50:08.319034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.319450 (+ 416us) service_pool.cc:224] Handling call
0925 01:50:17.005354 (+8685904us) ts_tablet_manager.cc:1151] Deleting tablet b306496f992f45a9b64b05b73712cb5b
0925 01:50:17.005363 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.063155 (+ 57792us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.118736 (+ 55581us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.132315 (+ 13579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8685721}
I20260925 01:50:17.132650 11946 rpcz_store.cc:276] 0925 01:50:14.859766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.875673 (+ 15907us) service_pool.cc:224] Handling call
0925 01:50:17.132281 (+2256608us) ts_tablet_manager.cc:1151] Deleting tablet 1f97bbad6b7348caaed4d745343b811c
0925 01:50:17.132291 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.132421 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2118428}
I20260925 01:50:17.132963 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet b306496f992f45a9b64b05b73712cb5b (table default.Table_04449fc82e9a480cbd1dfa613ef87dbd [id=5fff99035f0e4089bf06b22ac548e8d2]) successfully deleted
I20260925 01:50:17.133332 11953 tablet_replica.cc:333] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.133605 11953 raft_consensus.cc:2243] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.133803 11953 raft_consensus.cc:2272] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.133843 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1087) took 2273 ms. Trace:
I20260925 01:50:17.134177 11946 rpcz_store.cc:276] 0925 01:50:14.860091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.876267 (+ 16176us) service_pool.cc:224] Handling call
0925 01:50:17.133573 (+2257306us) ts_tablet_manager.cc:1151] Deleting tablet 2a65e06aba3640e2b42d05fb325c6171
0925 01:50:17.133588 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.133793 (+ 205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2115587}
W20260925 01:50:17.131181 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 3d867e7f58554c1196e837346b0b37d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d867e7f58554c1196e837346b0b37d3 already in progress: creating tablet
I20260925 01:50:17.135816 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1088) took 2275 ms. Trace:
I20260925 01:50:17.136008 11946 rpcz_store.cc:276] 0925 01:50:14.860189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.876783 (+ 16594us) service_pool.cc:224] Handling call
0925 01:50:17.135617 (+2258834us) ts_tablet_manager.cc:1151] Deleting tablet b948d000f8314491b02244bdce37ba33
0925 01:50:17.135628 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.135774 (+ 146us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2117039}
W20260925 01:50:17.135300 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 6f2f5603ea23446c9db47fd78d0c7854 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f2f5603ea23446c9db47fd78d0c7854 already in progress: creating tablet
W20260925 01:50:17.136760 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1f97bbad6b7348caaed4d745343b811c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f97bbad6b7348caaed4d745343b811c already in progress: creating tablet
W20260925 01:50:17.137272 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 2a65e06aba3640e2b42d05fb325c6171 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a65e06aba3640e2b42d05fb325c6171 already in progress: creating tablet
I20260925 01:50:17.137882 11946 tablet_replica.cc:333] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.137949 11953 ts_tablet_manager.cc:1916] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.138270 11946 raft_consensus.cc:2243] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.138607 11946 raft_consensus.cc:2272] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.139578 11946 ts_tablet_manager.cc:1916] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:17.137722 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet b948d000f8314491b02244bdce37ba33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b948d000f8314491b02244bdce37ba33 already in progress: creating tablet
I20260925 01:50:17.151007 11946 ts_tablet_manager.cc:1929] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.151194 11946 log.cc:1199] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/982b2a3dcdcb44bd8ad8562f30c38f13
I20260925 01:50:17.151352 11355 tablet_service.cc:1511] Processing CreateTablet for tablet b95b0cc0b9744060a4ea7894e0d1d09d (DEFAULT_TABLE table=default.Table_18f0eff413dd4d708f97e5479fc790da [id=794ea433424946a5924c8d0ae323f991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.151844 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95b0cc0b9744060a4ea7894e0d1d09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.151984 11495 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0285493d3c4d579e9d4ddb71a1faf2 (DEFAULT_TABLE table=default.Table_bd863d8d02fb435dbeafcf9279cbdeaf [id=c4283a6b89db4253af8fe7eec75c0443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.152421 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0285493d3c4d579e9d4ddb71a1faf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.152611 11342 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0285493d3c4d579e9d4ddb71a1faf2 (DEFAULT_TABLE table=default.Table_bd863d8d02fb435dbeafcf9279cbdeaf [id=c4283a6b89db4253af8fe7eec75c0443]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.152958 11342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0285493d3c4d579e9d4ddb71a1faf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.154084 11353 tablet_service.cc:1511] Processing CreateTablet for tablet 33c9093290144829bca01adc21ede8f0 (DEFAULT_TABLE table=default.Table_540dd004daf24dc095bd909960244ad4 [id=a45ce671c74144b19be3320533d060ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.154384 11353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c9093290144829bca01adc21ede8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.155133 11487 tablet_service.cc:1511] Processing CreateTablet for tablet b95b0cc0b9744060a4ea7894e0d1d09d (DEFAULT_TABLE table=default.Table_18f0eff413dd4d708f97e5479fc790da [id=794ea433424946a5924c8d0ae323f991]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.155433 11487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95b0cc0b9744060a4ea7894e0d1d09d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.158154 13586 raft_consensus.cc:493] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.158280 13586 raft_consensus.cc:515] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.158687 11346 tablet_service.cc:1511] Processing CreateTablet for tablet cc55ffdf0d814f478ff3121fadcdc6ef (DEFAULT_TABLE table=default.Table_853886350ca941199d022640a1251fd3 [id=b297045646b64274923faa096b66bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.159003 11346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc55ffdf0d814f478ff3121fadcdc6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.158989 13586 leader_election.cc:290] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.159451 11503 tablet_service.cc:1511] Processing CreateTablet for tablet 33c9093290144829bca01adc21ede8f0 (DEFAULT_TABLE table=default.Table_540dd004daf24dc095bd909960244ad4 [id=a45ce671c74144b19be3320533d060ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.159881 11503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c9093290144829bca01adc21ede8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.162779 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5edd719563c4f009fc840aa6fdda04a" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:17.163170 11355 tablet_service.cc:1511] Processing CreateTablet for tablet 335766be0c9745f187865515391ef130 (DEFAULT_TABLE table=default.Table_e7b6cdac5bbf4c1fb4665a67755588d8 [id=7ba90acfedf9480aa4c3398ef706de62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.163596 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335766be0c9745f187865515391ef130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.163563 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 335766be0c9745f187865515391ef130 (DEFAULT_TABLE table=default.Table_e7b6cdac5bbf4c1fb4665a67755588d8 [id=7ba90acfedf9480aa4c3398ef706de62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.163899 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335766be0c9745f187865515391ef130. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 01:50:17.165155 11457 leader_election.cc:343] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.151657 11946 ts_tablet_manager.cc:1950] T 982b2a3dcdcb44bd8ad8562f30c38f13 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.173977 11755 tablet_bootstrap.cc:492] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.174242 11755 ts_tablet_manager.cc:1403] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.086s user 0.005s sys 0.000s
I20260925 01:50:17.170771 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1089) took 2096 ms. Trace:
I20260925 01:50:17.175958 11488 tablet_service.cc:1511] Processing CreateTablet for tablet cc55ffdf0d814f478ff3121fadcdc6ef (DEFAULT_TABLE table=default.Table_853886350ca941199d022640a1251fd3 [id=b297045646b64274923faa096b66bdcc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.176537 11488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc55ffdf0d814f478ff3121fadcdc6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.178124 11755 raft_consensus.cc:359] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.180501 11755 raft_consensus.cc:385] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.181880 11495 tablet_service.cc:1511] Processing CreateTablet for tablet a3e2e767a49441379be997c91ef16228 (DEFAULT_TABLE table=default.Table_a6927e74a7f84b81b3732c15a8b42061 [id=24961b0e61be4e28bfda0a7fa523beaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.182482 11755 raft_consensus.cc:740] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.182798 11755 consensus_queue.cc:260] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.182277 11355 tablet_service.cc:1511] Processing CreateTablet for tablet a3e2e767a49441379be997c91ef16228 (DEFAULT_TABLE table=default.Table_a6927e74a7f84b81b3732c15a8b42061 [id=24961b0e61be4e28bfda0a7fa523beaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260925 01:50:17.184229 11495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e2e767a49441379be997c91ef16228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.175532 11946 rpcz_store.cc:276] 0925 01:50:15.074314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.082560 (+ 8246us) service_pool.cc:224] Handling call
0925 01:50:17.137477 (+2054917us) ts_tablet_manager.cc:1151] Deleting tablet 982b2a3dcdcb44bd8ad8562f30c38f13
0925 01:50:17.137487 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.146239 (+ 8752us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.150957 (+ 4718us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.170750 (+ 19793us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2054620}
I20260925 01:50:17.185387 11946 tablet_replica.cc:333] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.185514 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 982b2a3dcdcb44bd8ad8562f30c38f13 (table default.Table_96968765ba9045588fca7ce661775b0d [id=708c92d3ed0f40459cb0ef392cbb4096]) successfully deleted
I20260925 01:50:17.185638 11946 raft_consensus.cc:2243] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.185823 11946 raft_consensus.cc:2272] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.186667 11946 ts_tablet_manager.cc:1916] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.188982 11355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e2e767a49441379be997c91ef16228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 01:50:17.189393 11755 ts_tablet_manager.cc:1434] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260925 01:50:17.194373 11755 tablet_bootstrap.cc:492] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.198892 11353 tablet_service.cc:1558] Processing DeleteTablet for tablet 9771b89303094974902c4ad1f1c8608e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.203594 11755 tablet_bootstrap.cc:654] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:17.213667 11664 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 9845a915c8b94fff8660e2e7e86731f3 (table default.Table_b165001c5a09432cbac6ce79abb7b5d2 [id=13825238e94d418694c22d3d5aefb4e1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9845a915c8b94fff8660e2e7e86731f3 consensus state has no leader
I20260925 01:50:17.219242 11946 ts_tablet_manager.cc:1929] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.219380 11946 log.cc:1199] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5ef093a4a1134407ba94207137ce3e81
I20260925 01:50:17.222572 13458 raft_consensus.cc:493] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.222740 13458 raft_consensus.cc:515] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.224255 11946 ts_tablet_manager.cc:1950] T 5ef093a4a1134407ba94207137ce3e81 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.225201 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1091) took 2150 ms. Trace:
I20260925 01:50:17.225294 11946 rpcz_store.cc:276] 0925 01:50:15.074577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.082949 (+ 8372us) service_pool.cc:224] Handling call
0925 01:50:17.185324 (+2102375us) ts_tablet_manager.cc:1151] Deleting tablet 5ef093a4a1134407ba94207137ce3e81
0925 01:50:17.185338 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.208876 (+ 23538us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.219176 (+ 10300us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.225178 (+ 6002us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2102171}
I20260925 01:50:17.225656 11946 tablet_replica.cc:333] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.225888 11946 raft_consensus.cc:2243] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.225884 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5ef093a4a1134407ba94207137ce3e81 (table default.Table_44b098622a324bd6a415bf756ce0160b [id=3084bc3a144e4f66a71dc80592cec4fe]) successfully deleted
I20260925 01:50:17.226094 11946 raft_consensus.cc:2272] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.226713 11946 ts_tablet_manager.cc:1916] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.233291 13452 raft_consensus.cc:493] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.233439 13452 raft_consensus.cc:515] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.235008 13458 leader_election.cc:290] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:17.235394 13452 leader_election.cc:290] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.236119 11314 leader_election.cc:343] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5d23c5d52faa4b6da2996fabb16bd74a
W20260925 01:50:17.236493 11314 leader_election.cc:343] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: fce91b00d3a14e6398abacad61ff5b0f
I20260925 01:50:17.236733 11753 tablet_bootstrap.cc:492] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.236865 11753 ts_tablet_manager.cc:1403] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.173s user 0.017s sys 0.036s
I20260925 01:50:17.237709 11753 raft_consensus.cc:359] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.237884 11753 raft_consensus.cc:385] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.237944 11753 raft_consensus.cc:740] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.238190 11753 consensus_queue.cc:260] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.238385 11755 tablet_bootstrap.cc:492] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.238521 11755 ts_tablet_manager.cc:1403] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.004s
I20260925 01:50:17.238848 11753 ts_tablet_manager.cc:1434] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:17.239270 11953 ts_tablet_manager.cc:1929] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.239435 11953 log.cc:1199] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/2e96576354fe46bf9bfcde18f0a53390
I20260925 01:50:17.240857 11753 tablet_bootstrap.cc:492] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.245883 11755 raft_consensus.cc:359] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.246107 11755 raft_consensus.cc:385] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.246167 11755 raft_consensus.cc:740] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.246364 11755 consensus_queue.cc:260] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.246845 11755 ts_tablet_manager.cc:1434] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:50:17.250736 11753 tablet_bootstrap.cc:654] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.253432 11946 ts_tablet_manager.cc:1929] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.253558 11946 log.cc:1199] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/148f74b071c6420f8c78278c0cb37738
I20260925 01:50:17.253885 11946 ts_tablet_manager.cc:1950] T 148f74b071c6420f8c78278c0cb37738 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.255342 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1090) took 2180 ms. Trace:
I20260925 01:50:17.255435 11946 rpcz_store.cc:276] 0925 01:50:15.074465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.083187 (+ 8722us) service_pool.cc:224] Handling call
0925 01:50:17.225603 (+2142416us) ts_tablet_manager.cc:1151] Deleting tablet 148f74b071c6420f8c78278c0cb37738
0925 01:50:17.225613 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.241194 (+ 15581us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.253375 (+ 12181us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.255321 (+ 1946us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2142288}
I20260925 01:50:17.256273 13734 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:50:17.257236 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 148f74b071c6420f8c78278c0cb37738 (table default.Table_f9bc2f31552244b3a2372edb87acf2e8 [id=9bac5b87f3f049f3afd533448ddc30ce]) successfully deleted
I20260925 01:50:17.258780 13734 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:50:17.259613 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 86c8c3bba9614539bfe3018461ad21f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.260483 11755 tablet_bootstrap.cc:492] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.263289 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1101) took 2078 ms. Trace:
I20260925 01:50:17.263386 11946 rpcz_store.cc:276] 0925 01:50:15.185294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.185485 (+ 191us) service_pool.cc:224] Handling call
0925 01:50:17.263133 (+2077648us) ts_tablet_manager.cc:1151] Deleting tablet 43298d3575c34e6090b8f0767ec6918e
0925 01:50:17.263146 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.263265 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2075987}
I20260925 01:50:17.264779 11946 tablet_replica.cc:333] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
W20260925 01:50:17.264873 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 43298d3575c34e6090b8f0767ec6918e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43298d3575c34e6090b8f0767ec6918e already in progress: creating tablet
I20260925 01:50:17.264979 11946 raft_consensus.cc:2243] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.265121 11946 raft_consensus.cc:2272] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.265666 11946 ts_tablet_manager.cc:1916] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.272948 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:50:17.273602 13734 leader_election.cc:290] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:50:17.274439 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:50:17.274747 11753 tablet_bootstrap.cc:492] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.274874 11753 ts_tablet_manager.cc:1403] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.008s
I20260925 01:50:17.275135 12952 leader_election.cc:304] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:50:17.275518 11753 raft_consensus.cc:359] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.275678 11753 raft_consensus.cc:385] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.275720 11753 raft_consensus.cc:740] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.275933 11753 consensus_queue.cc:260] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.278543 11753 ts_tablet_manager.cc:1434] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:17.278831 11753 tablet_bootstrap.cc:492] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.282325 11753 tablet_bootstrap.cc:654] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.285380 11946 ts_tablet_manager.cc:1929] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.285503 11946 log.cc:1199] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/cb7bac6e89b8405e8bd541eba6278a0b
I20260925 01:50:17.285822 11946 ts_tablet_manager.cc:1950] T cb7bac6e89b8405e8bd541eba6278a0b P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.286128 13586 raft_consensus.cc:493] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.286249 13586 raft_consensus.cc:515] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.286845 13586 leader_election.cc:290] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.287516 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b62644673447239feb0f8f851012ef" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:17.288108 13452 raft_consensus.cc:493] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.288230 13452 raft_consensus.cc:515] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:17.292518 13452 leader_election.cc:290] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:17.294718 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1103) took 2107 ms. Trace:
W20260925 01:50:17.295080 11457 leader_election.cc:343] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.294821 11946 rpcz_store.cc:276] 0925 01:50:15.187364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.187711 (+ 347us) service_pool.cc:224] Handling call
0925 01:50:17.264415 (+2076704us) ts_tablet_manager.cc:1151] Deleting tablet cb7bac6e89b8405e8bd541eba6278a0b
0925 01:50:17.264722 (+ 307us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.268913 (+ 4191us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.285317 (+ 16404us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.294693 (+ 9376us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2076496}
W20260925 01:50:17.295483 11314 leader_election.cc:343] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 1f1d2d998d834c21ab83694daae37520
I20260925 01:50:17.295531 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1105) took 2088 ms. Trace:
I20260925 01:50:17.295620 11946 rpcz_store.cc:276] 0925 01:50:15.210384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.210908 (+ 524us) service_pool.cc:224] Handling call
0925 01:50:17.295412 (+2084504us) ts_tablet_manager.cc:1151] Deleting tablet 1602d22ad10f45d592c79e0d2affb2ae
0925 01:50:17.295422 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.295513 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2084231}
I20260925 01:50:17.295890 11946 tablet_replica.cc:333] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.295873 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet cb7bac6e89b8405e8bd541eba6278a0b (table default.Table_02a831c4d17044d8b03bad381ad3327a [id=f1315f21c4784385b931036720c0174e]) successfully deleted
I20260925 01:50:17.296105 11946 raft_consensus.cc:2243] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.296267 11946 raft_consensus.cc:2272] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:17.296608 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 1602d22ad10f45d592c79e0d2affb2ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1602d22ad10f45d592c79e0d2affb2ae already in progress: creating tablet
I20260925 01:50:17.296783 11946 ts_tablet_manager.cc:1916] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.298853 11755 tablet_bootstrap.cc:654] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.301298 13452 raft_consensus.cc:493] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.301429 13452 raft_consensus.cc:515] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.302001 13452 leader_election.cc:290] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:17.302822 11753 tablet_bootstrap.cc:492] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.302963 11753 ts_tablet_manager.cc:1403] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20260925 01:50:17.303632 11753 raft_consensus.cc:359] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.303795 11753 raft_consensus.cc:385] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.303850 11753 raft_consensus.cc:740] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.304054 11753 consensus_queue.cc:260] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.304497 11753 ts_tablet_manager.cc:1434] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260925 01:50:17.304809 11753 tablet_bootstrap.cc:492] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:17.307231 11314 leader_election.cc:343] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 1f778b87d307483b9edb17dce7355a65
I20260925 01:50:17.307344 11753 tablet_bootstrap.cc:654] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.307946 11953 ts_tablet_manager.cc:1950] T 2e96576354fe46bf9bfcde18f0a53390 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.316561 11946 ts_tablet_manager.cc:1929] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.316713 11946 log.cc:1199] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c86a78873e8847fa95bead4774bea606
I20260925 01:50:17.317073 11946 ts_tablet_manager.cc:1950] T c86a78873e8847fa95bead4774bea606 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.317879 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1110) took 2019 ms. Trace:
I20260925 01:50:17.318317 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 788) took 8999 ms. Trace:
I20260925 01:50:17.320060 11953 rpcz_store.cc:276] 0925 01:50:08.319205 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.319506 (+ 301us) service_pool.cc:224] Handling call
0925 01:50:17.133283 (+8813777us) ts_tablet_manager.cc:1151] Deleting tablet 2e96576354fe46bf9bfcde18f0a53390
0925 01:50:17.133293 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.141630 (+ 8337us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.238424 (+ 96794us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.318290 (+ 79866us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8813622}
I20260925 01:50:17.298852 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 9a82e0251ebb4500b628924c89bfe1b2 (table default.Table_e2f3327250404a46bf3cc196408fb2a6 [id=d991f187447f4aedb17ee797607351f5]). Expected version 3 got 0
I20260925 01:50:17.317984 11946 rpcz_store.cc:276] 0925 01:50:15.298268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.298313 (+ 45us) service_pool.cc:224] Handling call
0925 01:50:17.295846 (+1997533us) ts_tablet_manager.cc:1151] Deleting tablet c86a78873e8847fa95bead4774bea606
0925 01:50:17.295855 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.300017 (+ 4162us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.316495 (+ 16478us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.317858 (+ 1363us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1997342}
I20260925 01:50:17.321046 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c86a78873e8847fa95bead4774bea606 (table default.Table_024ab99d505f4f6eaed9ebd195ac0ffd [id=a1a3b3d0054a4bff8de55b5c5e71880f]) successfully deleted
I20260925 01:50:17.321201 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 2e96576354fe46bf9bfcde18f0a53390 (table default.Table_901ce728b66a4e0aa595efc09462e77c [id=77342c106aac476884403421439b8f52]) successfully deleted
I20260925 01:50:17.321661 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1107) took 2023 ms. Trace:
I20260925 01:50:17.321774 11946 rpcz_store.cc:276] 0925 01:50:15.297937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.298889 (+ 952us) service_pool.cc:224] Handling call
0925 01:50:17.321485 (+2022596us) ts_tablet_manager.cc:1151] Deleting tablet e3b08f61aaf5442889011fe309dea835
0925 01:50:17.321502 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.321637 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2022305}
W20260925 01:50:17.322357 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet e3b08f61aaf5442889011fe309dea835 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3b08f61aaf5442889011fe309dea835 already in progress: creating tablet
I20260925 01:50:17.329444 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 49b110516abb45d1880d0e0e33e20174 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.329521 11953 tablet_replica.cc:333] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.329736 11953 raft_consensus.cc:2243] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.329928 11953 raft_consensus.cc:2272] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.330269 11946 tablet_replica.cc:333] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.330482 11946 raft_consensus.cc:2243] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.330682 11946 raft_consensus.cc:2272] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.331252 11946 ts_tablet_manager.cc:1916] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.336544 13734 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 01:50:17.341704 11946 ts_tablet_manager.cc:1929] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:17.341823 11946 log.cc:1199] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e6b97d37704f4a0d88457d124bb4f259
I20260925 01:50:17.346504 11953 ts_tablet_manager.cc:1916] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.347854 11946 ts_tablet_manager.cc:1950] T e6b97d37704f4a0d88457d124bb4f259 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.348677 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1109) took 2050 ms. Trace:
I20260925 01:50:17.348776 11946 rpcz_store.cc:276] 0925 01:50:15.298172 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.299204 (+ 1032us) service_pool.cc:224] Handling call
0925 01:50:17.330218 (+2031014us) ts_tablet_manager.cc:1151] Deleting tablet e6b97d37704f4a0d88457d124bb4f259
0925 01:50:17.330229 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.338610 (+ 8381us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.341645 (+ 3035us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.348655 (+ 7010us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030752}
I20260925 01:50:17.349270 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e6b97d37704f4a0d88457d124bb4f259 (table default.Table_f2a3bb55c7fc4681a8baf2b5416ed839 [id=7a90fa18b2534fac8ae77f73f0e4e3cf]) successfully deleted
I20260925 01:50:17.353681 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1106) took 2055 ms. Trace:
I20260925 01:50:17.353787 11946 rpcz_store.cc:276] 0925 01:50:15.297818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.299549 (+ 1731us) service_pool.cc:224] Handling call
0925 01:50:17.353241 (+2053692us) ts_tablet_manager.cc:1151] Deleting tablet a07f977c6a00450a8e8ceb6580dab980
0925 01:50:17.353252 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.353660 (+ 408us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2053460}
W20260925 01:50:17.354358 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a07f977c6a00450a8e8ceb6580dab980 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a07f977c6a00450a8e8ceb6580dab980 already in progress: creating tablet
I20260925 01:50:17.355262 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1108) took 2057 ms. Trace:
I20260925 01:50:17.355666 11946 rpcz_store.cc:276] 0925 01:50:15.298039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.316694 (+ 18655us) service_pool.cc:224] Handling call
0925 01:50:17.355141 (+2038447us) ts_tablet_manager.cc:1151] Deleting tablet 70c94e791a494eb580253e0c8e0fa56a
0925 01:50:17.355152 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.355244 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030764}
W20260925 01:50:17.362469 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 70c94e791a494eb580253e0c8e0fa56a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70c94e791a494eb580253e0c8e0fa56a already in progress: creating tablet
I20260925 01:50:17.362986 11946 tablet_replica.cc:333] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.363441 11946 raft_consensus.cc:2243] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.363873 11946 raft_consensus.cc:2272] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.364621 11946 ts_tablet_manager.cc:1916] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.364928 11755 tablet_bootstrap.cc:492] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.365079 11755 ts_tablet_manager.cc:1403] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.105s user 0.004s sys 0.006s
I20260925 01:50:17.365849 11755 raft_consensus.cc:359] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.366043 11755 raft_consensus.cc:385] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.366122 11755 raft_consensus.cc:740] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.366380 11755 consensus_queue.cc:260] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.366884 11755 ts_tablet_manager.cc:1434] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:17.367182 11755 tablet_bootstrap.cc:492] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.369606 11755 tablet_bootstrap.cc:654] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.376524 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 81024a75b31e45e098d108bae4cc17c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.381485 11753 tablet_bootstrap.cc:492] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.381659 11753 ts_tablet_manager.cc:1403] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.077s user 0.013s sys 0.008s
I20260925 01:50:17.382427 11753 raft_consensus.cc:359] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.382607 11753 raft_consensus.cc:385] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.382673 11753 raft_consensus.cc:740] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.382889 11753 consensus_queue.cc:260] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.383402 11753 ts_tablet_manager.cc:1434] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:17.386438 11753 tablet_bootstrap.cc:492] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.387873 11753 tablet_bootstrap.cc:654] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.389751 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet a0a50af9614341d49c4c690e2ec785b0 (table default.Table_2f3b719cb1fb4ea38cc4619423a15171 [id=0921cdbf570d44939373e1054ea46415]). Expected version 1 got 0
I20260925 01:50:17.391083 11946 ts_tablet_manager.cc:1929] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.391198 11946 log.cc:1199] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/abcb285ebc1a4bfd8317546823e01b09
I20260925 01:50:17.391505 11946 ts_tablet_manager.cc:1950] T abcb285ebc1a4bfd8317546823e01b09 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.392311 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1111) took 1574 ms. Trace:
I20260925 01:50:17.392393 11946 rpcz_store.cc:276] 0925 01:50:15.817671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.817738 (+ 67us) service_pool.cc:224] Handling call
0925 01:50:17.362933 (+1545195us) ts_tablet_manager.cc:1151] Deleting tablet abcb285ebc1a4bfd8317546823e01b09
0925 01:50:17.362943 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.369875 (+ 6932us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.391015 (+ 21140us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.392291 (+ 1276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1544967}
I20260925 01:50:17.392853 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet abcb285ebc1a4bfd8317546823e01b09 (table default.Table_62d80cb30e374cc1ad9618b1df6adc21 [id=c2a62f15ea544ec38d4fa1c67a1141a3]) successfully deleted
I20260925 01:50:17.394927 11946 tablet_replica.cc:333] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.395135 11946 raft_consensus.cc:2243] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.395277 11946 raft_consensus.cc:2272] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.395797 11946 ts_tablet_manager.cc:1916] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.396703 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet a0a50af9614341d49c4c690e2ec785b0 (table default.Table_2f3b719cb1fb4ea38cc4619423a15171 [id=0921cdbf570d44939373e1054ea46415]). Expected version 1 got 0
I20260925 01:50:17.400997 11753 tablet_bootstrap.cc:492] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.401136 11753 ts_tablet_manager.cc:1403] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.004s
I20260925 01:50:17.402237 11753 raft_consensus.cc:359] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.402405 11753 raft_consensus.cc:385] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.402456 11753 raft_consensus.cc:740] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.402688 11753 consensus_queue.cc:260] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.403244 11953 ts_tablet_manager.cc:1929] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.406564 13452 raft_consensus.cc:493] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.408073 11753 ts_tablet_manager.cc:1434] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260925 01:50:17.407720 13452 raft_consensus.cc:515] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:17.408349 11753 tablet_bootstrap.cc:492] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.408695 13452 leader_election.cc:290] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.409775 11314 leader_election.cc:343] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:50:17.410084 11753 tablet_bootstrap.cc:654] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.413523 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 681356bc659f4ca990cd2ffc0c10b533 with delete_type TABLET_DATA_DELETED (replaced by tablet 43b8e5a02efe40118ae75200a48ba0c1) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.415086 11946 ts_tablet_manager.cc:1929] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.415199 11946 log.cc:1199] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/70f4777a789a48a18cfadbfb9d49a708
I20260925 01:50:17.415496 11946 ts_tablet_manager.cc:1950] T 70f4777a789a48a18cfadbfb9d49a708 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.421808 11953 log.cc:1199] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a9068770de0b473488bd8ea4752fb15d
I20260925 01:50:17.422259 11953 ts_tablet_manager.cc:1950] T a9068770de0b473488bd8ea4752fb15d P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.423120 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 783) took 9105 ms. Trace:
I20260925 01:50:17.424059 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1112) took 1606 ms. Trace:
I20260925 01:50:17.424166 11946 rpcz_store.cc:276] 0925 01:50:15.817766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.817904 (+ 138us) service_pool.cc:224] Handling call
0925 01:50:17.394881 (+1576977us) ts_tablet_manager.cc:1151] Deleting tablet 70f4777a789a48a18cfadbfb9d49a708
0925 01:50:17.394891 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.411985 (+ 17094us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.415037 (+ 3052us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.424037 (+ 9000us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1576764}
I20260925 01:50:17.424640 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 70f4777a789a48a18cfadbfb9d49a708 (table default.Table_6071e9aeccf94c38b3a13b08027ad884 [id=b0b233e44e604e0c94e47a67f8a255f5]) successfully deleted
I20260925 01:50:17.425966 11946 tablet_replica.cc:333] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.426456 11946 raft_consensus.cc:2243] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.426909 11946 raft_consensus.cc:2272] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.427667 11946 ts_tablet_manager.cc:1916] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.432119 11753 tablet_bootstrap.cc:492] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.432305 11753 ts_tablet_manager.cc:1403] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260925 01:50:17.434988 13586 raft_consensus.cc:493] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.435124 13586 raft_consensus.cc:515] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.435717 13586 leader_election.cc:290] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.436551 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a82e0251ebb4500b628924c89bfe1b2" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.437242 11457 leader_election.cc:343] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.437624 11753 raft_consensus.cc:359] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.437855 11753 raft_consensus.cc:385] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.437963 11753 raft_consensus.cc:740] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.438263 11753 consensus_queue.cc:260] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.441519 13586 raft_consensus.cc:493] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.441639 13586 raft_consensus.cc:515] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.442239 13586 leader_election.cc:290] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.443094 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85db5688ef064053870a39a906ad9071" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.443671 11457 leader_election.cc:343] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.444156 11753 ts_tablet_manager.cc:1434] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:50:17.444504 11753 tablet_bootstrap.cc:492] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.454499 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet c2fe086048c04e0db797272e50f21c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.456439 11753 tablet_bootstrap.cc:654] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.423218 11953 rpcz_store.cc:276] 0925 01:50:08.318043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.319659 (+ 1616us) service_pool.cc:224] Handling call
0925 01:50:17.329448 (+9009789us) ts_tablet_manager.cc:1151] Deleting tablet a9068770de0b473488bd8ea4752fb15d
0925 01:50:17.329463 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.361327 (+ 31864us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.403159 (+ 41832us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.423098 (+ 19939us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9009644}
I20260925 01:50:17.458925 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a9068770de0b473488bd8ea4752fb15d (table default.Table_bb67fea9df444e16a94bb2a276fc99be [id=b527a6ca23af495195c09be2d49de223]) successfully deleted
I20260925 01:50:17.459308 11953 tablet_replica.cc:333] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.459532 11953 raft_consensus.cc:2243] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.459705 11953 raft_consensus.cc:2272] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.460285 11953 ts_tablet_manager.cc:1916] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.463336 11946 ts_tablet_manager.cc:1929] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.463466 11946 log.cc:1199] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/2fc2c21fb6104d08b37d1c1f19aa3bf3
I20260925 01:50:17.463779 11946 ts_tablet_manager.cc:1950] T 2fc2c21fb6104d08b37d1c1f19aa3bf3 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.464612 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1113) took 1646 ms. Trace:
I20260925 01:50:17.464710 11946 rpcz_store.cc:276] 0925 01:50:15.817843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.818157 (+ 314us) service_pool.cc:224] Handling call
0925 01:50:17.425913 (+1607756us) ts_tablet_manager.cc:1151] Deleting tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3
0925 01:50:17.425925 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.450855 (+ 24930us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.463272 (+ 12417us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.464590 (+ 1318us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1607594}
I20260925 01:50:17.465231 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 2fc2c21fb6104d08b37d1c1f19aa3bf3 (table default.Table_22a3f87d316e46268ed60c79ab7a9824 [id=f982909c932b49238735e89451d7ca08]) successfully deleted
I20260925 01:50:17.466795 11755 tablet_bootstrap.cc:492] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.466955 11755 ts_tablet_manager.cc:1403] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.100s user 0.002s sys 0.001s
I20260925 01:50:17.467679 11755 raft_consensus.cc:359] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.467862 11755 raft_consensus.cc:385] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.467979 11755 raft_consensus.cc:740] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.467993 11753 tablet_bootstrap.cc:492] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.468237 11753 ts_tablet_manager.cc:1403] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.001s
I20260925 01:50:17.468246 11755 consensus_queue.cc:260] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.468971 11753 raft_consensus.cc:359] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.469201 11753 raft_consensus.cc:385] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.469292 11753 raft_consensus.cc:740] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.469563 11753 consensus_queue.cc:260] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.472525 11753 ts_tablet_manager.cc:1434] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260925 01:50:17.472862 11753 tablet_bootstrap.cc:492] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.474702 11753 tablet_bootstrap.cc:654] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.482476 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet b4e5d28d466741a0a085a4f9938fffd1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.484148 11755 ts_tablet_manager.cc:1434] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260925 01:50:17.475044 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1114) took 1623 ms. Trace:
I20260925 01:50:17.485147 11946 rpcz_store.cc:276] 0925 01:50:15.851233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.851297 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:17.474889 (+1623592us) ts_tablet_manager.cc:1151] Deleting tablet 0226f482c8ff49ce976490e6aadfcee4
0925 01:50:17.474898 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.475024 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1599211}
I20260925 01:50:17.485610 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1116) took 1538 ms. Trace:
I20260925 01:50:17.485689 11946 rpcz_store.cc:276] 0925 01:50:15.947126 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:15.947196 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:17.485451 (+1538255us) ts_tablet_manager.cc:1151] Deleting tablet 679cbe0cc09b47938f60959d845d1767
0925 01:50:17.485464 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.485584 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1532549}
W20260925 01:50:17.485733 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 0226f482c8ff49ce976490e6aadfcee4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0226f482c8ff49ce976490e6aadfcee4 already in progress: creating tablet
W20260925 01:50:17.486313 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 679cbe0cc09b47938f60959d845d1767 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 679cbe0cc09b47938f60959d845d1767 already in progress: creating tablet
I20260925 01:50:17.487337 11946 tablet_replica.cc:333] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.487581 11946 raft_consensus.cc:2243] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.487752 11946 raft_consensus.cc:2272] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.494585 13452 raft_consensus.cc:493] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.494748 13452 raft_consensus.cc:515] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.495396 13452 leader_election.cc:290] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.496470 11314 leader_election.cc:343] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 31ffb404d93a4436ba9e624b45650fe1
I20260925 01:50:17.498706 11755 tablet_bootstrap.cc:492] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.499780 13452 raft_consensus.cc:493] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.499920 13452 raft_consensus.cc:515] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:17.500526 13452 leader_election.cc:290] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
W20260925 01:50:17.501411 11314 leader_election.cc:343] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 35b123ac1e894239875404438ed19927
I20260925 01:50:17.502190 11755 tablet_bootstrap.cc:654] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.504253 13452 raft_consensus.cc:493] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.504376 13452 raft_consensus.cc:515] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.505191 13452 leader_election.cc:290] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.506632 11314 leader_election.cc:343] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 9771b89303094974902c4ad1f1c8608e
I20260925 01:50:17.506835 11946 ts_tablet_manager.cc:1916] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.526650 13452 raft_consensus.cc:493] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.526873 13452 raft_consensus.cc:515] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.527725 13452 leader_election.cc:290] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.529218 11314 leader_election.cc:343] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: f2618c46630c4295949b36f3d0087941
I20260925 01:50:17.532222 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7f7ee517df483b83d1627cdb6f9433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.533560 11755 tablet_bootstrap.cc:492] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.533808 11755 ts_tablet_manager.cc:1403] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.004s
I20260925 01:50:17.535365 11753 tablet_bootstrap.cc:492] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.535516 11753 ts_tablet_manager.cc:1403] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.011s
I20260925 01:50:17.536181 11755 raft_consensus.cc:359] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:17.536197 11753 raft_consensus.cc:359] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.536365 11753 raft_consensus.cc:385] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.536417 11753 raft_consensus.cc:740] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.536512 11755 raft_consensus.cc:385] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.536609 11755 raft_consensus.cc:740] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.536942 11755 consensus_queue.cc:260] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:17.537873 11946 ts_tablet_manager.cc:1929] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.537992 11946 log.cc:1199] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5d37a05d2bcd4c94ba51fef8096f889d
I20260925 01:50:17.538585 11755 ts_tablet_manager.cc:1434] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260925 01:50:17.537743 11953 ts_tablet_manager.cc:1929] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.538832 11953 log.cc:1199] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/98ffeb9d70374afdb72a728d7b211d33
I20260925 01:50:17.539222 11953 ts_tablet_manager.cc:1950] T 98ffeb9d70374afdb72a728d7b211d33 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.541229 11946 ts_tablet_manager.cc:1950] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.544242 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet aaa2f7ef888846ec9667916ba47084db (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]). Expected version 1 got 0
I20260925 01:50:17.545703 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1118) took 1541 ms. Trace:
I20260925 01:50:17.545817 11946 rpcz_store.cc:276] 0925 01:50:16.004444 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.004705 (+ 261us) service_pool.cc:224] Handling call
0925 01:50:17.485911 (+1481206us) ts_tablet_manager.cc:1151] Deleting tablet 5d37a05d2bcd4c94ba51fef8096f889d
0925 01:50:17.485922 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.518498 (+ 32576us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.522051 (+ 3553us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.545675 (+ 23624us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1480885}
I20260925 01:50:17.546396 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5d37a05d2bcd4c94ba51fef8096f889d (table default.Table_28b35d15250242b4b53514812418ac09 [id=f410d9cb1dc743fa9d98fa3f04a60a5a]) successfully deleted
I20260925 01:50:17.546343 11753 consensus_queue.cc:260] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.551221 11753 ts_tablet_manager.cc:1434] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260925 01:50:17.551568 11753 tablet_bootstrap.cc:492] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.552340 11946 tablet_replica.cc:333] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.552556 11946 raft_consensus.cc:2243] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.552731 11946 raft_consensus.cc:2272] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.553329 11946 ts_tablet_manager.cc:1916] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.560051 11946 ts_tablet_manager.cc:1929] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.560228 11946 log.cc:1199] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/4930edeb2edd4e7494dbf1761b5d20c0
I20260925 01:50:17.560532 11946 ts_tablet_manager.cc:1950] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.564664 11753 tablet_bootstrap.cc:654] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.565362 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet e2ba874cb6a34ccd9e59cc9146280c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.566722 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 784) took 9247 ms. Trace:
I20260925 01:50:17.566817 11953 rpcz_store.cc:276] 0925 01:50:08.318812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.319915 (+ 1103us) service_pool.cc:224] Handling call
0925 01:50:17.459248 (+9139333us) ts_tablet_manager.cc:1151] Deleting tablet 98ffeb9d70374afdb72a728d7b211d33
0925 01:50:17.459259 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.464039 (+ 4780us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.537679 (+ 73640us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.566697 (+ 29018us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9139167}
I20260925 01:50:17.567394 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 98ffeb9d70374afdb72a728d7b211d33 (table default.Table_e310d52dc129451da019692eab3b9328 [id=61ee143cc6f943279e84913e502bbd63]) successfully deleted
I20260925 01:50:17.567533 11755 tablet_bootstrap.cc:492] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.568107 11953 tablet_replica.cc:333] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.568318 11953 raft_consensus.cc:2243] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.568466 11953 raft_consensus.cc:2272] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.568980 11953 ts_tablet_manager.cc:1916] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.573364 13452 raft_consensus.cc:493] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.573496 13452 raft_consensus.cc:515] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.574170 13452 leader_election.cc:290] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.575263 11314 leader_election.cc:343] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b61b1bf5a8d446918edc6d166b7712ef
I20260925 01:50:17.576964 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet aaa2f7ef888846ec9667916ba47084db (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]). Expected version 1 got 0
I20260925 01:50:17.583122 11953 ts_tablet_manager.cc:1929] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.583288 11953 log.cc:1199] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/95ac080782664fca8661c188ab822e89
I20260925 01:50:17.583645 11953 ts_tablet_manager.cc:1950] T 95ac080782664fca8661c188ab822e89 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.584519 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 789) took 9236 ms. Trace:
I20260925 01:50:17.586102 11953 rpcz_store.cc:276] 0925 01:50:08.347812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.347867 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:17.567104 (+9219237us) ts_tablet_manager.cc:1151] Deleting tablet 95ac080782664fca8661c188ab822e89
0925 01:50:17.568030 (+ 926us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.572262 (+ 4232us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.583062 (+ 10800us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.584498 (+ 1436us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9219004}
I20260925 01:50:17.586735 11755 tablet_bootstrap.cc:654] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.586782 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 95ac080782664fca8661c188ab822e89 (table default.Table_40519dcfbe2e470ca48f0351bf0ea7cd [id=9bdac40ff34c4ea8aa4fa8da91357cbf]) successfully deleted
I20260925 01:50:17.587308 11953 tablet_replica.cc:333] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.587574 11953 raft_consensus.cc:2243] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.587795 11953 raft_consensus.cc:2272] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.588958 11953 ts_tablet_manager.cc:1916] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.596124 11753 tablet_bootstrap.cc:492] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.596271 11753 ts_tablet_manager.cc:1403] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.003s
I20260925 01:50:17.596953 11753 raft_consensus.cc:359] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.597136 11753 raft_consensus.cc:385] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.597187 11753 raft_consensus.cc:740] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.597443 11753 consensus_queue.cc:260] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.603721 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 941fd8333f6d45878677e55ff6948bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.604641 11755 tablet_bootstrap.cc:492] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.604794 11755 ts_tablet_manager.cc:1403] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.001s
I20260925 01:50:17.605572 11755 raft_consensus.cc:359] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.605732 11755 raft_consensus.cc:385] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.605777 11755 raft_consensus.cc:740] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.606527 11755 consensus_queue.cc:260] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.607079 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1119) took 1595 ms. Trace:
I20260925 01:50:17.607170 11946 rpcz_store.cc:276] 0925 01:50:16.012003 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.012060 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:17.552285 (+1540225us) ts_tablet_manager.cc:1151] Deleting tablet 4930edeb2edd4e7494dbf1761b5d20c0
0925 01:50:17.552295 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.556738 (+ 4443us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.559986 (+ 3248us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.607058 (+ 47072us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540030}
I20260925 01:50:17.607589 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 4930edeb2edd4e7494dbf1761b5d20c0 (table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]) successfully deleted
I20260925 01:50:17.608047 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1123) took 1494 ms. Trace:
I20260925 01:50:17.608179 11946 rpcz_store.cc:276] 0925 01:50:16.114032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.123547 (+ 9515us) service_pool.cc:224] Handling call
0925 01:50:17.607924 (+1484377us) ts_tablet_manager.cc:1151] Deleting tablet 81c2d13ee77945f6a993ba99d57b5427
0925 01:50:17.607932 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.608030 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1484088}
W20260925 01:50:17.608924 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 81c2d13ee77945f6a993ba99d57b5427 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 81c2d13ee77945f6a993ba99d57b5427 already in progress: creating tablet
I20260925 01:50:17.609319 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1124) took 1473 ms. Trace:
I20260925 01:50:17.609443 11946 rpcz_store.cc:276] 0925 01:50:16.135426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.162577 (+ 27151us) service_pool.cc:224] Handling call
0925 01:50:17.609220 (+1446643us) ts_tablet_manager.cc:1151] Deleting tablet 83c69194c062411db10113b63f6be92c
0925 01:50:17.609229 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.609303 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1446424}
W20260925 01:50:17.610093 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 83c69194c062411db10113b63f6be92c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 83c69194c062411db10113b63f6be92c already in progress: creating tablet
I20260925 01:50:17.610502 11755 ts_tablet_manager.cc:1434] T 8afcf8f6d0e24472a3190059df032698 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 01:50:17.610816 11755 tablet_bootstrap.cc:492] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.612788 11755 tablet_bootstrap.cc:654] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.613232 11753 ts_tablet_manager.cc:1434] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260925 01:50:17.614764 13586 raft_consensus.cc:493] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.614898 13586 raft_consensus.cc:515] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.615504 13586 leader_election.cc:290] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.615988 11753 tablet_bootstrap.cc:492] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.618206 11753 tablet_bootstrap.cc:654] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.613606 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 8afcf8f6d0e24472a3190059df032698 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.618701 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a50af9614341d49c4c690e2ec785b0" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.620891 11457 leader_election.cc:343] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.627126 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1133) took 1330 ms. Trace:
I20260925 01:50:17.627298 11946 rpcz_store.cc:276] 0925 01:50:16.296854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.296941 (+ 87us) service_pool.cc:224] Handling call
0925 01:50:17.622576 (+1325635us) ts_tablet_manager.cc:1151] Deleting tablet fa4380a06af440308d98a9d29db76313
0925 01:50:17.626971 (+ 4395us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.627099 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288379}
W20260925 01:50:17.627967 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet fa4380a06af440308d98a9d29db76313 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa4380a06af440308d98a9d29db76313 already in progress: creating tablet
I20260925 01:50:17.630959 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1134) took 1257 ms. Trace:
I20260925 01:50:17.631052 11946 rpcz_store.cc:276] 0925 01:50:16.373525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.373599 (+ 74us) service_pool.cc:224] Handling call
0925 01:50:17.627679 (+1254080us) ts_tablet_manager.cc:1151] Deleting tablet a39d277b58664b5d9b06c22545da03c8
0925 01:50:17.630845 (+ 3166us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.630942 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1253838}
W20260925 01:50:17.631546 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet a39d277b58664b5d9b06c22545da03c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a39d277b58664b5d9b06c22545da03c8 already in progress: creating tablet
I20260925 01:50:17.631860 11953 ts_tablet_manager.cc:1929] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.631990 11953 log.cc:1199] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/06fca09010f841c5a7b58678560065f3
I20260925 01:50:17.632454 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1135) took 1225 ms. Trace:
I20260925 01:50:17.632575 11946 rpcz_store.cc:276] 0925 01:50:16.407440 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.407518 (+ 78us) service_pool.cc:224] Handling call
0925 01:50:17.632323 (+1224805us) ts_tablet_manager.cc:1151] Deleting tablet 035e48a1fb884aa8a2c0b7065d0c1a6e
0925 01:50:17.632334 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.632435 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1224553}
W20260925 01:50:17.633067 11665 catalog_manager.cc:5043] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 035e48a1fb884aa8a2c0b7065d0c1a6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 035e48a1fb884aa8a2c0b7065d0c1a6e already in progress: creating tablet
I20260925 01:50:17.633842 11946 tablet_replica.cc:333] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.634145 11946 raft_consensus.cc:2243] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.634370 11946 raft_consensus.cc:2272] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.634995 11946 ts_tablet_manager.cc:1916] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.636346 11953 ts_tablet_manager.cc:1950] T 06fca09010f841c5a7b58678560065f3 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.644820 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 790) took 9296 ms. Trace:
I20260925 01:50:17.644958 11953 rpcz_store.cc:276] 0925 01:50:08.348623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.348667 (+ 44us) service_pool.cc:224] Handling call
0925 01:50:17.587250 (+9238583us) ts_tablet_manager.cc:1151] Deleting tablet 06fca09010f841c5a7b58678560065f3
0925 01:50:17.587261 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.599115 (+ 11854us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.631789 (+ 32674us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.644788 (+ 12999us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9238413}
I20260925 01:50:17.645557 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 06fca09010f841c5a7b58678560065f3 (table default.Table_ef187190ed9e4b7d910df53df764f469 [id=4d572d97dbaa43e5879f88f200a962ba]) successfully deleted
I20260925 01:50:17.646047 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 791) took 9277 ms. Trace:
I20260925 01:50:17.646178 11953 rpcz_store.cc:276] 0925 01:50:08.368341 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.368401 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:17.645891 (+9277490us) ts_tablet_manager.cc:1151] Deleting tablet 2e839ce4c66c40eba5553a81e865a12a
0925 01:50:17.645903 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.646026 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9277242}
W20260925 01:50:17.646644 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2e839ce4c66c40eba5553a81e865a12a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e839ce4c66c40eba5553a81e865a12a already in progress: creating tablet
I20260925 01:50:17.647101 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 792) took 9260 ms. Trace:
I20260925 01:50:17.647184 11953 rpcz_store.cc:276] 0925 01:50:08.387114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.387174 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:17.646984 (+9259810us) ts_tablet_manager.cc:1151] Deleting tablet 7cb273ff7b084ffdb33b8ca9b9e136fe
0925 01:50:17.646993 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.647084 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9259585}
W20260925 01:50:17.647653 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 7cb273ff7b084ffdb33b8ca9b9e136fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cb273ff7b084ffdb33b8ca9b9e136fe already in progress: creating tablet
I20260925 01:50:17.648002 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 793) took 9251 ms. Trace:
I20260925 01:50:17.648079 11953 rpcz_store.cc:276] 0925 01:50:08.396393 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.396463 (+ 70us) service_pool.cc:224] Handling call
0925 01:50:17.647892 (+9251429us) ts_tablet_manager.cc:1151] Deleting tablet 854549ed223142429513c1d80c026793
0925 01:50:17.647900 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.647986 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9251241}
W20260925 01:50:17.648602 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 854549ed223142429513c1d80c026793 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 854549ed223142429513c1d80c026793 already in progress: creating tablet
I20260925 01:50:17.649003 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 794) took 9246 ms. Trace:
I20260925 01:50:17.649078 11953 rpcz_store.cc:276] 0925 01:50:08.402580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.402635 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:17.648855 (+9246220us) ts_tablet_manager.cc:1151] Deleting tablet 8a00b69e42e1465981d6c3eec217393f
0925 01:50:17.648864 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.648986 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9246012}
W20260925 01:50:17.649461 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8a00b69e42e1465981d6c3eec217393f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a00b69e42e1465981d6c3eec217393f already in progress: creating tablet
I20260925 01:50:17.649778 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 799) took 9080 ms. Trace:
I20260925 01:50:17.649852 11953 rpcz_store.cc:276] 0925 01:50:08.569605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.577039 (+ 7434us) service_pool.cc:224] Handling call
0925 01:50:17.649685 (+9072646us) ts_tablet_manager.cc:1151] Deleting tablet a92e93e5478846c7ac2eee8a8e76c7aa
0925 01:50:17.649693 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.649764 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9071696}
W20260925 01:50:17.650272 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a92e93e5478846c7ac2eee8a8e76c7aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a92e93e5478846c7ac2eee8a8e76c7aa already in progress: creating tablet
I20260925 01:50:17.650554 11953 tablet_replica.cc:333] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.650751 11953 raft_consensus.cc:2243] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.650905 11953 raft_consensus.cc:2272] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.651302 11755 tablet_bootstrap.cc:492] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.651506 11953 ts_tablet_manager.cc:1916] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.651804 11755 ts_tablet_manager.cc:1403] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.004s
I20260925 01:50:17.652763 11755 raft_consensus.cc:359] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.653008 11755 raft_consensus.cc:385] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.653098 11755 raft_consensus.cc:740] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.653482 11755 consensus_queue.cc:260] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.654973 11755 ts_tablet_manager.cc:1434] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260925 01:50:17.655949 11753 tablet_bootstrap.cc:492] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.656098 11753 ts_tablet_manager.cc:1403] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.007s
I20260925 01:50:17.660849 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e3ba459a81845699435c2e44f5c9f19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.656818 11753 raft_consensus.cc:359] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.661455 11753 raft_consensus.cc:385] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.661543 11753 raft_consensus.cc:740] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.664884 11755 tablet_bootstrap.cc:492] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.666870 11755 tablet_bootstrap.cc:654] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.662456 11753 consensus_queue.cc:260] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.676775 11946 ts_tablet_manager.cc:1929] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.676934 11946 log.cc:1199] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/252415635b5e4b3286948e91d421d6f1
I20260925 01:50:17.677234 11946 ts_tablet_manager.cc:1950] T 252415635b5e4b3286948e91d421d6f1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.679963 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7c9364671fcc42dba51569d14979f030 (table default.Table_7f7dafdc6f97469b84dfb97f6ae1ceb5 [id=8fcc310b81cc4e4fad99fd9a7df66be6]). Expected version 2 got 0
I20260925 01:50:17.684369 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1136) took 1198 ms. Trace:
I20260925 01:50:17.684487 11946 rpcz_store.cc:276] 0925 01:50:16.486213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.502117 (+ 15904us) service_pool.cc:224] Handling call
0925 01:50:17.633795 (+1131678us) ts_tablet_manager.cc:1151] Deleting tablet 252415635b5e4b3286948e91d421d6f1
0925 01:50:17.633803 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.644329 (+ 10526us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.676706 (+ 32377us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.684345 (+ 7639us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077912}
I20260925 01:50:17.684973 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 252415635b5e4b3286948e91d421d6f1 (table default.Table_89979b06d2f04faa8b7f18b057afdbf1 [id=b8aeef331373440ba0d32c79585f44b2]) successfully deleted
I20260925 01:50:17.684062 11953 ts_tablet_manager.cc:1929] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.685184 11953 log.cc:1199] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/1f778b87d307483b9edb17dce7355a65
I20260925 01:50:17.685540 11953 ts_tablet_manager.cc:1950] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.686265 11755 tablet_bootstrap.cc:492] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.686466 11755 ts_tablet_manager.cc:1403] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260925 01:50:17.686807 11753 ts_tablet_manager.cc:1434] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.031s user 0.001s sys 0.001s
I20260925 01:50:17.687354 11755 raft_consensus.cc:359] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.687605 11755 raft_consensus.cc:385] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.687697 11755 raft_consensus.cc:740] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.687988 11755 consensus_queue.cc:260] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.692396 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 798) took 9123 ms. Trace:
I20260925 01:50:17.692502 11953 rpcz_store.cc:276] 0925 01:50:08.569369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:08.585952 (+ 16583us) service_pool.cc:224] Handling call
0925 01:50:17.650505 (+9064553us) ts_tablet_manager.cc:1151] Deleting tablet 1f778b87d307483b9edb17dce7355a65
0925 01:50:17.650514 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.664419 (+ 13905us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.683982 (+ 19563us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.692374 (+ 8392us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9042202}
I20260925 01:50:17.692998 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 1f778b87d307483b9edb17dce7355a65 (table default.Table_78fa9227d15c432fb2a7b5f1bba2b14c [id=7403f961d61b4ab2b2042f88d1b80db0]) successfully deleted
I20260925 01:50:17.693912 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 816) took 8540 ms. Trace:
I20260925 01:50:17.694044 11953 rpcz_store.cc:276] 0925 01:50:09.153555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.154143 (+ 588us) service_pool.cc:224] Handling call
0925 01:50:17.693355 (+8539212us) ts_tablet_manager.cc:1151] Deleting tablet 5366f2487b444e12ad9d63d6825d5e97
0925 01:50:17.693783 (+ 428us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.693893 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8538998}
W20260925 01:50:17.694618 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5366f2487b444e12ad9d63d6825d5e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5366f2487b444e12ad9d63d6825d5e97 already in progress: creating tablet
I20260925 01:50:17.695094 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 813) took 8555 ms. Trace:
I20260925 01:50:17.695215 11953 rpcz_store.cc:276] 0925 01:50:09.139143 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.143939 (+ 4796us) service_pool.cc:224] Handling call
0925 01:50:17.694985 (+8551046us) ts_tablet_manager.cc:1151] Deleting tablet 5204f01643654d3a9a5e6909f6601bb5
0925 01:50:17.694996 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.695076 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8504341}
W20260925 01:50:17.695657 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5204f01643654d3a9a5e6909f6601bb5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5204f01643654d3a9a5e6909f6601bb5 already in progress: creating tablet
I20260925 01:50:17.696039 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 820) took 8501 ms. Trace:
I20260925 01:50:17.696146 11953 rpcz_store.cc:276] 0925 01:50:09.194708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.194776 (+ 68us) service_pool.cc:224] Handling call
0925 01:50:17.695940 (+8501164us) ts_tablet_manager.cc:1151] Deleting tablet 7809737ca3d24bfe8829f17d5e3215f5
0925 01:50:17.695949 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.696024 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8500985}
W20260925 01:50:17.696584 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 7809737ca3d24bfe8829f17d5e3215f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7809737ca3d24bfe8829f17d5e3215f5 already in progress: creating tablet
I20260925 01:50:17.700218 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 821) took 8505 ms. Trace:
I20260925 01:50:17.700345 11953 rpcz_store.cc:276] 0925 01:50:09.194839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.194891 (+ 52us) service_pool.cc:224] Handling call
0925 01:50:17.700115 (+8505224us) ts_tablet_manager.cc:1151] Deleting tablet 007ee8e3087c4a70b9c5d8436a31659f
0925 01:50:17.700123 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.700201 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8505046}
I20260925 01:50:17.700663 11946 tablet_replica.cc:333] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.700886 11946 raft_consensus.cc:2243] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.701061 11946 raft_consensus.cc:2272] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.701668 11946 ts_tablet_manager.cc:1916] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:17.702118 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 007ee8e3087c4a70b9c5d8436a31659f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007ee8e3087c4a70b9c5d8436a31659f already in progress: creating tablet
I20260925 01:50:17.702505 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 819) took 8507 ms. Trace:
I20260925 01:50:17.702615 11953 rpcz_store.cc:276] 0925 01:50:09.194624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.194904 (+ 280us) service_pool.cc:224] Handling call
0925 01:50:17.702404 (+8507500us) ts_tablet_manager.cc:1151] Deleting tablet e4d3293730684400a84f1ca62bb6a95d
0925 01:50:17.702413 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.702490 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8507313}
W20260925 01:50:17.703090 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e4d3293730684400a84f1ca62bb6a95d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4d3293730684400a84f1ca62bb6a95d already in progress: creating tablet
I20260925 01:50:17.704290 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 7c9364671fcc42dba51569d14979f030 (table default.Table_7f7dafdc6f97469b84dfb97f6ae1ceb5 [id=8fcc310b81cc4e4fad99fd9a7df66be6]). Expected version 2 got 0
I20260925 01:50:17.704592 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 817) took 8510 ms. Trace:
I20260925 01:50:17.705196 11953 rpcz_store.cc:276] 0925 01:50:09.194379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.198113 (+ 3734us) service_pool.cc:224] Handling call
0925 01:50:17.704495 (+8506382us) ts_tablet_manager.cc:1151] Deleting tablet 52c716eb26d04a33b4c3b3c56a7fbac6
0925 01:50:17.704503 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.704577 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8506194}
I20260925 01:50:17.705741 11753 tablet_bootstrap.cc:492] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.706005 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 830) took 8226 ms. Trace:
I20260925 01:50:17.706180 11953 rpcz_store.cc:276] 0925 01:50:09.479842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.490211 (+ 10369us) service_pool.cc:224] Handling call
0925 01:50:17.705894 (+8215683us) ts_tablet_manager.cc:1151] Deleting tablet 4cd34fa172904e51ade794892c580248
0925 01:50:17.705904 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.705989 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8215460}
I20260925 01:50:17.706682 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 831) took 7978 ms. Trace:
W20260925 01:50:17.705699 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 52c716eb26d04a33b4c3b3c56a7fbac6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c716eb26d04a33b4c3b3c56a7fbac6 already in progress: creating tablet
W20260925 01:50:17.707026 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 4cd34fa172904e51ade794892c580248 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4cd34fa172904e51ade794892c580248 already in progress: creating tablet
I20260925 01:50:17.708134 11946 ts_tablet_manager.cc:1929] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.708244 11946 log.cc:1199] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/d3aadd649e4b4f489bfe4b0eea13ede8
I20260925 01:50:17.708087 11953 rpcz_store.cc:276] 0925 01:50:09.728742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.728801 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:17.706595 (+7977794us) ts_tablet_manager.cc:1151] Deleting tablet 8b2eed649c6f447d8f9af98637061af1
0925 01:50:17.706603 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.706669 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7977548}
W20260925 01:50:17.708673 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 8b2eed649c6f447d8f9af98637061af1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b2eed649c6f447d8f9af98637061af1 already in progress: creating tablet
I20260925 01:50:17.709079 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 832) took 7979 ms. Trace:
I20260925 01:50:17.709187 11953 rpcz_store.cc:276] 0925 01:50:09.729551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.729604 (+ 53us) service_pool.cc:224] Handling call
0925 01:50:17.708981 (+7979377us) ts_tablet_manager.cc:1151] Deleting tablet db1339652d744cda9215d84e846d1e8e
0925 01:50:17.708990 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.709065 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7979153}
W20260925 01:50:17.709674 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet db1339652d744cda9215d84e846d1e8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db1339652d744cda9215d84e846d1e8e already in progress: creating tablet
I20260925 01:50:17.700451 11755 ts_tablet_manager.cc:1434] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260925 01:50:17.710213 11755 tablet_bootstrap.cc:492] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.714270 11753 tablet_bootstrap.cc:654] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.716794 11755 tablet_bootstrap.cc:654] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.716807 13751 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:50:17.717196 13751 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:50:17.714448 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 833) took 7979 ms. Trace:
I20260925 01:50:17.722920 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:50:17.726356 11953 rpcz_store.cc:276] 0925 01:50:09.734869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.734915 (+ 46us) service_pool.cc:224] Handling call
0925 01:50:17.714265 (+7979350us) ts_tablet_manager.cc:1151] Deleting tablet 86f3f75784af42f6b14b919815ab1890
0925 01:50:17.714278 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.714429 (+ 151us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7979018}
W20260925 01:50:17.726830 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 86f3f75784af42f6b14b919815ab1890 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f3f75784af42f6b14b919815ab1890 already in progress: creating tablet
I20260925 01:50:17.728097 13452 raft_consensus.cc:493] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.728273 13452 raft_consensus.cc:515] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.729080 13452 leader_election.cc:290] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.730480 11314 leader_election.cc:343] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 81024a75b31e45e098d108bae4cc17c9
I20260925 01:50:17.730954 13751 leader_election.cc:290] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ec2f98d6295c4f8ead68b46f01e73d37 (127.10.159.253:42889)
I20260925 01:50:17.731401 11953 tablet_replica.cc:333] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.731603 11953 raft_consensus.cc:2243] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.731751 11953 raft_consensus.cc:2272] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.732276 11953 ts_tablet_manager.cc:1916] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.740365 11753 tablet_bootstrap.cc:492] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.740465 11953 ts_tablet_manager.cc:1929] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.740573 11753 ts_tablet_manager.cc:1403] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.003s
I20260925 01:50:17.740676 11953 log.cc:1199] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/c7944aa1ac8f4c5d8ea3aa2acae41257
I20260925 01:50:17.741132 11953 ts_tablet_manager.cc:1950] T c7944aa1ac8f4c5d8ea3aa2acae41257 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.741818 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 834) took 8005 ms. Trace:
I20260925 01:50:17.741806 11753 raft_consensus.cc:359] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.744778 11753 raft_consensus.cc:385] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.744879 11753 raft_consensus.cc:740] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.745247 11753 consensus_queue.cc:260] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.748180 11946 ts_tablet_manager.cc:1950] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:17.752784 10879 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 11160: Timed out: CheckLeaks RPC to 127.10.159.193:44813 timed out after 1.000s (SENT)
I20260925 01:50:17.752997 10879 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAIg11R/build/asan/bin/kudu with pid 11160
I20260925 01:50:17.754866 11753 ts_tablet_manager.cc:1434] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260925 01:50:17.756327 11753 tablet_bootstrap.cc:492] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.758203 11753 tablet_bootstrap.cc:654] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.752130 11755 tablet_bootstrap.cc:492] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.758504 11755 ts_tablet_manager.cc:1403] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.004s
I20260925 01:50:17.759369 11755 raft_consensus.cc:359] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.759624 11755 raft_consensus.cc:385] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.759725 11755 raft_consensus.cc:740] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.760057 11755 consensus_queue.cc:260] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.768616 11755 ts_tablet_manager.cc:1434] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:50:17.769047 11755 tablet_bootstrap.cc:492] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.770615 11953 rpcz_store.cc:276] 0925 01:50:09.736027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.736082 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:17.727400 (+7991318us) ts_tablet_manager.cc:1151] Deleting tablet c7944aa1ac8f4c5d8ea3aa2acae41257
0925 01:50:17.731357 (+ 3957us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.737367 (+ 6010us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.740374 (+ 3007us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.741802 (+ 1428us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7991108}
I20260925 01:50:17.771265 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet c7944aa1ac8f4c5d8ea3aa2acae41257 (table default.Table_467dcbd96d384165bd59850e07759dae [id=454ea19fdacb465b93f5761ffcdf4ff2]) successfully deleted
I20260925 01:50:17.772526 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 5048a0fca2e64ffa9f19000f48a4c090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.774251 11953 tablet_replica.cc:333] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.774523 11953 raft_consensus.cc:2243] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.774708 11953 raft_consensus.cc:2272] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.778713 11755 tablet_bootstrap.cc:654] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.779649 11953 ts_tablet_manager.cc:1916] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.787575 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1138) took 1103 ms. Trace:
I20260925 01:50:17.793859 13051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca2cee7752c249f68a372ef5c6a18bff" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" is_pre_election: true
I20260925 01:50:17.794934 12261 leader_election.cc:304] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca2cee7752c249f68a372ef5c6a18bff; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ec2f98d6295c4f8ead68b46f01e73d37
I20260925 01:50:17.796397 11755 tablet_bootstrap.cc:492] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.796650 11755 ts_tablet_manager.cc:1403] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.004s
I20260925 01:50:17.797026 13751 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 01:50:17.797307 11946 rpcz_store.cc:276] 0925 01:50:16.684227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.695051 (+ 10824us) service_pool.cc:224] Handling call
0925 01:50:17.700608 (+1005557us) ts_tablet_manager.cc:1151] Deleting tablet d3aadd649e4b4f489bfe4b0eea13ede8
0925 01:50:17.700621 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.705004 (+ 4383us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.708081 (+ 3077us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.787537 (+ 79456us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":995287}
I20260925 01:50:17.797698 11755 raft_consensus.cc:359] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.797864 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet d3aadd649e4b4f489bfe4b0eea13ede8 (table default.Table_27cae369e3864093b7c94613cec41e94 [id=8063be59104347b1aa72aa8fe6e3fd20]) successfully deleted
I20260925 01:50:17.797955 11755 raft_consensus.cc:385] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.798187 11755 raft_consensus.cc:740] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.798358 11946 tablet_replica.cc:333] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.798539 11755 consensus_queue.cc:260] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.798628 11946 raft_consensus.cc:2243] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.798804 11946 raft_consensus.cc:2272] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.799302 11755 ts_tablet_manager.cc:1434] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:17.799494 11946 ts_tablet_manager.cc:1916] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.799670 11755 tablet_bootstrap.cc:492] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.801481 11755 tablet_bootstrap.cc:654] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.803187 13586 raft_consensus.cc:493] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.803318 13586 raft_consensus.cc:515] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.803574 11753 tablet_bootstrap.cc:492] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.803714 11753 ts_tablet_manager.cc:1403] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.018s
I20260925 01:50:17.803983 13586 leader_election.cc:290] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.804406 11753 raft_consensus.cc:359] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.804554 11753 raft_consensus.cc:385] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.804610 11753 raft_consensus.cc:740] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.804834 11753 consensus_queue.cc:260] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.804829 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ff8a661fba41bab36966b10d4202c4" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:17.806488 11753 ts_tablet_manager.cc:1434] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260925 01:50:17.805119 11953 ts_tablet_manager.cc:1929] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.807020 11953 log.cc:1199] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/a07f37b8469a497ba3fe504cb21105d2
I20260925 01:50:17.807440 11953 ts_tablet_manager.cc:1950] T a07f37b8469a497ba3fe504cb21105d2 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.808274 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 835) took 8070 ms. Trace:
I20260925 01:50:17.808422 11953 rpcz_store.cc:276] 0925 01:50:09.737502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.737574 (+ 72us) service_pool.cc:224] Handling call
0925 01:50:17.774173 (+8036599us) ts_tablet_manager.cc:1151] Deleting tablet a07f37b8469a497ba3fe504cb21105d2
0925 01:50:17.774197 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.793957 (+ 19760us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.805071 (+ 11114us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.808253 (+ 3182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17152,"tablet-delete.queue_time_us":8036409}
I20260925 01:50:17.808904 11953 tablet_replica.cc:333] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
W20260925 01:50:17.809052 11457 leader_election.cc:343] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.809113 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet a07f37b8469a497ba3fe504cb21105d2 (table default.Table_a3c9e904392e436babfab378a07cf3a6 [id=13d7f920892e4b7d8befdde8d52affbb]) successfully deleted
I20260925 01:50:17.809262 11953 raft_consensus.cc:2243] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.809402 13757 raft_consensus.cc:493] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.809484 11953 raft_consensus.cc:2272] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.809521 13757 raft_consensus.cc:515] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:17.810094 11953 ts_tablet_manager.cc:1916] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.812402 11753 tablet_bootstrap.cc:492] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.812963 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa2f7ef888846ec9667916ba47084db" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:17.813177 11522 raft_consensus.cc:2393] T aaa2f7ef888846ec9667916ba47084db P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:50:17.814203 13757 leader_election.cc:290] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:17.816982 11753 tablet_bootstrap.cc:654] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.818719 11755 tablet_bootstrap.cc:492] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.818871 11755 ts_tablet_manager.cc:1403] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.002s
I20260925 01:50:17.820048 11755 raft_consensus.cc:359] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.820227 11755 raft_consensus.cc:385] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.820279 11755 raft_consensus.cc:740] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.820533 11755 consensus_queue.cc:260] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.821238 11755 ts_tablet_manager.cc:1434] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:17.823925 11953 ts_tablet_manager.cc:1929] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.824048 11953 log.cc:1199] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/5d23c5d52faa4b6da2996fabb16bd74a
I20260925 01:50:17.824394 11953 ts_tablet_manager.cc:1950] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.825168 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 836) took 8086 ms. Trace:
I20260925 01:50:17.825269 11953 rpcz_store.cc:276] 0925 01:50:09.739125 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.739184 (+ 59us) service_pool.cc:224] Handling call
0925 01:50:17.808847 (+8069663us) ts_tablet_manager.cc:1151] Deleting tablet 5d23c5d52faa4b6da2996fabb16bd74a
0925 01:50:17.808860 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.813187 (+ 4327us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.823861 (+ 10674us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.825143 (+ 1282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43,"tablet-delete.queue_time_us":8069455}
I20260925 01:50:17.825421 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet cdd615a0405742fcb472d92829a8d7c7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ef025c076394333b416b6613f9116d6) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.825620 13759 raft_consensus.cc:493] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.825752 13759 raft_consensus.cc:515] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.826524 13759 leader_election.cc:290] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:17.827529 11946 ts_tablet_manager.cc:1929] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.827659 11946 log.cc:1199] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/85db5688ef064053870a39a906ad9071
I20260925 01:50:17.827979 11946 ts_tablet_manager.cc:1950] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.828161 11755 tablet_bootstrap.cc:492] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.829509 13586 raft_consensus.cc:493] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.829641 13586 raft_consensus.cc:515] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.830090 11755 tablet_bootstrap.cc:654] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.830372 13586 leader_election.cc:290] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.831190 11953 tablet_replica.cc:333] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.831396 11953 raft_consensus.cc:2243] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.831382 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 5d23c5d52faa4b6da2996fabb16bd74a (table default.Table_82ebda3635eb4fdbb40fd316f06241b8 [id=afe7e3c8eceb40f5b1b0c3809f94e503]) successfully deleted
I20260925 01:50:17.831580 11953 raft_consensus.cc:2272] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.831843 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b110516abb45d1880d0e0e33e20174" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.832338 11457 leader_election.cc:343] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.832362 11946 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49304 (request call id 1144) took 1020 ms. Trace:
I20260925 01:50:17.832446 11946 rpcz_store.cc:276] 0925 01:50:16.811711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:16.845103 (+ 33392us) service_pool.cc:224] Handling call
0925 01:50:17.798282 (+953179us) ts_tablet_manager.cc:1151] Deleting tablet 85db5688ef064053870a39a906ad9071
0925 01:50:17.798298 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.803483 (+ 5185us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.808730 (+ 5247us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.832346 (+ 23616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920,"tablet-delete.queue_time_us":952987}
I20260925 01:50:17.832618 11953 ts_tablet_manager.cc:1916] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.832894 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 85db5688ef064053870a39a906ad9071 (table default.Table_ddbaaa8ae6ef4cada7027949173feba5 [id=559aa97ecdd74867a638ecc2be209a89]) successfully deleted
W20260925 01:50:17.832945 11314 leader_election.cc:343] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 86c8c3bba9614539bfe3018461ad21f8
I20260925 01:50:17.834028 11946 tablet_replica.cc:333] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.834687 11946 raft_consensus.cc:2243] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.835178 11946 raft_consensus.cc:2272] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.836160 11946 ts_tablet_manager.cc:1916] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.837015 11753 tablet_bootstrap.cc:492] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.838187 11753 ts_tablet_manager.cc:1403] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.005s
I20260925 01:50:17.839052 11753 raft_consensus.cc:359] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.839288 11753 raft_consensus.cc:385] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.839378 11753 raft_consensus.cc:740] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.839654 11753 consensus_queue.cc:260] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.844625 11755 tablet_bootstrap.cc:492] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.844779 11755 ts_tablet_manager.cc:1403] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.006s
I20260925 01:50:17.844935 11753 ts_tablet_manager.cc:1434] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260925 01:50:17.845237 11753 tablet_bootstrap.cc:492] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.845562 11755 raft_consensus.cc:359] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.845741 11755 raft_consensus.cc:385] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.845943 11755 raft_consensus.cc:740] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.846216 11755 consensus_queue.cc:260] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.846786 11755 ts_tablet_manager.cc:1434] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260925 01:50:17.847047 11755 tablet_bootstrap.cc:492] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.848724 11755 tablet_bootstrap.cc:654] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.849220 11753 tablet_bootstrap.cc:654] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.850914 11953 ts_tablet_manager.cc:1929] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.851025 11953 log.cc:1199] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/5b11c6526dbc4177b3a54b3c952bbd31
I20260925 01:50:17.851368 11953 ts_tablet_manager.cc:1950] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.852397 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 837) took 8112 ms. Trace:
I20260925 01:50:17.852504 11953 rpcz_store.cc:276] 0925 01:50:09.739979 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.740025 (+ 46us) service_pool.cc:224] Handling call
0925 01:50:17.831142 (+8091117us) ts_tablet_manager.cc:1151] Deleting tablet 5b11c6526dbc4177b3a54b3c952bbd31
0925 01:50:17.831153 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.840056 (+ 8903us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.850857 (+ 10801us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.852380 (+ 1523us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8090958}
I20260925 01:50:17.852908 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 838) took 8071 ms. Trace:
I20260925 01:50:17.852977 11953 rpcz_store.cc:276] 0925 01:50:09.781654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:09.781697 (+ 43us) service_pool.cc:224] Handling call
0925 01:50:17.852783 (+8071086us) ts_tablet_manager.cc:1151] Deleting tablet f4533c3500a3431ca6ef5f23b0cf6830
0925 01:50:17.852792 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.852891 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8054488}
I20260925 01:50:17.853281 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 862) took 7717 ms. Trace:
I20260925 01:50:17.853340 11953 rpcz_store.cc:276] 0925 01:50:10.135473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.138139 (+ 2666us) service_pool.cc:224] Handling call
0925 01:50:17.853175 (+7715036us) ts_tablet_manager.cc:1151] Deleting tablet 0258eac5971842878c62326952115490
0925 01:50:17.853184 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.853267 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7714836}
I20260925 01:50:17.853637 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 865) took 7717 ms. Trace:
I20260925 01:50:17.853710 11953 rpcz_store.cc:276] 0925 01:50:10.136193 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.138368 (+ 2175us) service_pool.cc:224] Handling call
0925 01:50:17.853542 (+7715174us) ts_tablet_manager.cc:1151] Deleting tablet f8ffc45058774a878d4b802400feecb7
0925 01:50:17.853550 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.853623 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7715041}
I20260925 01:50:17.854027 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 866) took 7717 ms. Trace:
I20260925 01:50:17.854106 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 5b11c6526dbc4177b3a54b3c952bbd31 (table default.Table_3dbfc023733e4f1ba765a6ad09ad8de8 [id=751698529dcb4a9c8d8806958926ecde]) successfully deleted
I20260925 01:50:17.854127 11953 rpcz_store.cc:276] 0925 01:50:10.136451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.138515 (+ 2064us) service_pool.cc:224] Handling call
0925 01:50:17.853938 (+7715423us) ts_tablet_manager.cc:1151] Deleting tablet 532e290a0db34fbfab0328ca8f8d1e6c
0925 01:50:17.853946 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.854011 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7715286}
W20260925 01:50:17.854383 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f4533c3500a3431ca6ef5f23b0cf6830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4533c3500a3431ca6ef5f23b0cf6830 already in progress: creating tablet
I20260925 01:50:17.854415 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 859) took 7719 ms. Trace:
I20260925 01:50:17.854498 11953 rpcz_store.cc:276] 0925 01:50:10.134754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.146116 (+ 11362us) service_pool.cc:224] Handling call
0925 01:50:17.854325 (+7708209us) ts_tablet_manager.cc:1151] Deleting tablet bb9ce40cb55d4f90b3c333b55bc5fe18
0925 01:50:17.854333 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.854401 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7707258}
W20260925 01:50:17.854579 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 0258eac5971842878c62326952115490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0258eac5971842878c62326952115490 already in progress: creating tablet
I20260925 01:50:17.854799 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 864) took 7718 ms. Trace:
I20260925 01:50:17.854866 11953 rpcz_store.cc:276] 0925 01:50:10.135931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.146116 (+ 10185us) service_pool.cc:224] Handling call
0925 01:50:17.854711 (+7708595us) ts_tablet_manager.cc:1151] Deleting tablet 3ac251aa75344cf8ac29dd30c893d84b
0925 01:50:17.854719 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.854786 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7700487}
I20260925 01:50:17.855155 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 879) took 7651 ms. Trace:
I20260925 01:50:17.855218 11953 rpcz_store.cc:276] 0925 01:50:10.203805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.225380 (+ 21575us) service_pool.cc:224] Handling call
0925 01:50:17.855071 (+7629691us) ts_tablet_manager.cc:1151] Deleting tablet 3f7e203f023745f0b9b44085b0943c6d
0925 01:50:17.855079 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.855142 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7609410}
I20260925 01:50:17.855552 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 885) took 7387 ms. Trace:
W20260925 01:50:17.855908 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f8ffc45058774a878d4b802400feecb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8ffc45058774a878d4b802400feecb7 already in progress: creating tablet
W20260925 01:50:17.856113 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 532e290a0db34fbfab0328ca8f8d1e6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 532e290a0db34fbfab0328ca8f8d1e6c already in progress: creating tablet
W20260925 01:50:17.856276 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet bb9ce40cb55d4f90b3c333b55bc5fe18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bb9ce40cb55d4f90b3c333b55bc5fe18 already in progress: creating tablet
W20260925 01:50:17.856426 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 3ac251aa75344cf8ac29dd30c893d84b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ac251aa75344cf8ac29dd30c893d84b already in progress: creating tablet
W20260925 01:50:17.856616 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 3f7e203f023745f0b9b44085b0943c6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f7e203f023745f0b9b44085b0943c6d already in progress: creating tablet
I20260925 01:50:17.855610 11953 rpcz_store.cc:276] 0925 01:50:10.467684 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.467746 (+ 62us) service_pool.cc:224] Handling call
0925 01:50:17.855462 (+7387716us) ts_tablet_manager.cc:1151] Deleting tablet 3ce8d023311b4a91adfebd6c5fedf1bd
0925 01:50:17.855471 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.855539 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7387355}
I20260925 01:50:17.858979 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 886) took 7387 ms. Trace:
I20260925 01:50:17.859050 11953 rpcz_store.cc:276] 0925 01:50:10.471992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.478736 (+ 6744us) service_pool.cc:224] Handling call
0925 01:50:17.858874 (+7380138us) ts_tablet_manager.cc:1151] Deleting tablet fe3627bfb342448591ccaf3d7ab23c4a
0925 01:50:17.858882 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.858964 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7379909}
I20260925 01:50:17.859321 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 887) took 7380 ms. Trace:
I20260925 01:50:17.859378 11953 rpcz_store.cc:276] 0925 01:50:10.479147 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.481816 (+ 2669us) service_pool.cc:224] Handling call
0925 01:50:17.859236 (+7377420us) ts_tablet_manager.cc:1151] Deleting tablet 9a4219ce09e54d268c55c19f7b5cbc7d
0925 01:50:17.859245 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.859308 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7377095}
I20260925 01:50:17.859673 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 888) took 7320 ms. Trace:
I20260925 01:50:17.859737 11953 rpcz_store.cc:276] 0925 01:50:10.539233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.542348 (+ 3115us) service_pool.cc:224] Handling call
0925 01:50:17.859577 (+7317229us) ts_tablet_manager.cc:1151] Deleting tablet 2c93bb7a34f94deaa65f8b588c604b81
0925 01:50:17.859586 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.859659 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7316577}
I20260925 01:50:17.859962 11953 tablet_replica.cc:333] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.860152 11953 raft_consensus.cc:2243] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.860307 11953 raft_consensus.cc:2272] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.860839 11953 ts_tablet_manager.cc:1916] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:17.863027 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 3ce8d023311b4a91adfebd6c5fedf1bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ce8d023311b4a91adfebd6c5fedf1bd already in progress: creating tablet
W20260925 01:50:17.863233 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet fe3627bfb342448591ccaf3d7ab23c4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe3627bfb342448591ccaf3d7ab23c4a already in progress: creating tablet
W20260925 01:50:17.863382 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9a4219ce09e54d268c55c19f7b5cbc7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a4219ce09e54d268c55c19f7b5cbc7d already in progress: creating tablet
W20260925 01:50:17.863535 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 2c93bb7a34f94deaa65f8b588c604b81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c93bb7a34f94deaa65f8b588c604b81 already in progress: creating tablet
I20260925 01:50:17.864027 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 329a5af9fb654d4c894e1cf4fd636c13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.864064 11755 tablet_bootstrap.cc:492] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.864213 11755 ts_tablet_manager.cc:1403] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.005s
I20260925 01:50:17.857169 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 236db241476a4a609869aad539fee426 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.864972 11755 raft_consensus.cc:359] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.865155 11755 raft_consensus.cc:385] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.865217 11755 raft_consensus.cc:740] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.865465 11755 consensus_queue.cc:260] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.866000 11755 ts_tablet_manager.cc:1434] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260925 01:50:17.866784 11755 tablet_bootstrap.cc:492] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.871600 11755 tablet_bootstrap.cc:654] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.873910 11672 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet 602af3d6e7bb44f8a316691019f85c25 (table default.Table_6d10c1c6aa904d2d97f8d65665f6b3a8 [id=a58f0d622f6a4d59997065e3cc28f2d7]). Expected version 2 got 0
I20260925 01:50:17.874264 11672 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet cc4a51356880486a928181ee701f74d0 (table default.Table_4ad3881ff5874f4594e9c336a16513e4 [id=ad62203df2f049f2988e6c7ad5b5188d]). Expected version 2 got 0
I20260925 01:50:17.875554 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f19bccf3c5540cb828ec7bfc89a1c17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:51 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.877295 11953 ts_tablet_manager.cc:1929] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.877400 11953 log.cc:1199] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/d3150980bb72435886486156aa98d342
I20260925 01:50:17.880746 11953 ts_tablet_manager.cc:1950] T d3150980bb72435886486156aa98d342 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.881534 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 889) took 7315 ms. Trace:
I20260925 01:50:17.881642 11953 rpcz_store.cc:276] 0925 01:50:10.566226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.566319 (+ 93us) service_pool.cc:224] Handling call
0925 01:50:17.859922 (+7293603us) ts_tablet_manager.cc:1151] Deleting tablet d3150980bb72435886486156aa98d342
0925 01:50:17.859931 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.874252 (+ 14321us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.877248 (+ 2996us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.881516 (+ 4268us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7176696}
I20260925 01:50:17.882040 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 890) took 7299 ms. Trace:
I20260925 01:50:17.882148 11953 rpcz_store.cc:276] 0925 01:50:10.582990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:10.583828 (+ 838us) service_pool.cc:224] Handling call
0925 01:50:17.881915 (+7298087us) ts_tablet_manager.cc:1151] Deleting tablet dcbe8d08a1ff4c97a2f9a40d706f4281
0925 01:50:17.881923 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.882024 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7197852}
I20260925 01:50:17.882206 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet d3150980bb72435886486156aa98d342 (table default.Table_2428d63259334c4e96044516c1560465 [id=374d5a46f2b2482598aec3f5cc801aef]) successfully deleted
I20260925 01:50:17.882484 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 908) took 6673 ms. Trace:
I20260925 01:50:17.882560 11953 rpcz_store.cc:276] 0925 01:50:11.208794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.210487 (+ 1693us) service_pool.cc:224] Handling call
0925 01:50:17.882367 (+6671880us) ts_tablet_manager.cc:1151] Deleting tablet 681356bc659f4ca990cd2ffc0c10b533
0925 01:50:17.882377 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.882468 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6671653}
W20260925 01:50:17.882797 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet dcbe8d08a1ff4c97a2f9a40d706f4281 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcbe8d08a1ff4c97a2f9a40d706f4281 already in progress: creating tablet
W20260925 01:50:17.883421 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 681356bc659f4ca990cd2ffc0c10b533 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 681356bc659f4ca990cd2ffc0c10b533 already in progress: creating tablet
I20260925 01:50:17.885236 11946 ts_tablet_manager.cc:1929] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.885366 11946 log.cc:1199] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/47b62644673447239feb0f8f851012ef
I20260925 01:50:17.885367 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 911) took 6538 ms. Trace:
I20260925 01:50:17.885453 11953 rpcz_store.cc:276] 0925 01:50:11.347201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.348067 (+ 866us) service_pool.cc:224] Handling call
0925 01:50:17.885197 (+6537130us) ts_tablet_manager.cc:1151] Deleting tablet 61c1181b38a247e79bd7a6355950881e
0925 01:50:17.885251 (+ 54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.885350 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6534483}
I20260925 01:50:17.885682 11946 ts_tablet_manager.cc:1950] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
W20260925 01:50:17.886034 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 61c1181b38a247e79bd7a6355950881e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61c1181b38a247e79bd7a6355950881e already in progress: creating tablet
I20260925 01:50:17.886756 11753 tablet_bootstrap.cc:492] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.886889 11753 ts_tablet_manager.cc:1403] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.001s
I20260925 01:50:17.887575 11753 raft_consensus.cc:359] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.887742 11753 raft_consensus.cc:385] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.887794 11753 raft_consensus.cc:740] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.888031 11753 consensus_queue.cc:260] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.895190 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.899350 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 912) took 6552 ms. Trace:
I20260925 01:50:17.899462 11753 ts_tablet_manager.cc:1434] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:50:17.899458 11953 rpcz_store.cc:276] 0925 01:50:11.347294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.348339 (+ 1045us) service_pool.cc:224] Handling call
0925 01:50:17.885707 (+6537368us) ts_tablet_manager.cc:1151] Deleting tablet dceeedf3471d45508f025e7a4c7f73f2
0925 01:50:17.899226 (+ 13519us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.899329 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6537229}
I20260925 01:50:17.899840 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 913) took 6552 ms. Trace:
W20260925 01:50:17.900012 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet dceeedf3471d45508f025e7a4c7f73f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dceeedf3471d45508f025e7a4c7f73f2 already in progress: creating tablet
I20260925 01:50:17.901840 11753 tablet_bootstrap.cc:492] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.903568 11753 tablet_bootstrap.cc:654] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.905324 13586 raft_consensus.cc:493] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.905457 13586 raft_consensus.cc:515] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.906116 13586 leader_election.cc:290] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.907022 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9c41bc8a5de4cf1922e12f4d52ac0f6" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.907594 11457 leader_election.cc:343] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.914618 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 47b62644673447239feb0f8f851012ef (table default.Table_f8b12242c3e44c009dd3fd05771e971f [id=57961ea65d474c928bf94f669e0159fa]) successfully deleted
I20260925 01:50:17.915050 11946 tablet_replica.cc:333] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.917822 11755 tablet_bootstrap.cc:492] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.917973 11755 ts_tablet_manager.cc:1403] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.017s
I20260925 01:50:17.918212 11946 raft_consensus.cc:2243] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.918426 11946 raft_consensus.cc:2272] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.918766 11755 raft_consensus.cc:359] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.918936 11755 raft_consensus.cc:385] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.918999 11755 raft_consensus.cc:740] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.919240 11755 consensus_queue.cc:260] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.919483 11946 ts_tablet_manager.cc:1916] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.922155 11953 rpcz_store.cc:276] 0925 01:50:11.347369 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.348506 (+ 1137us) service_pool.cc:224] Handling call
0925 01:50:17.899732 (+6551226us) ts_tablet_manager.cc:1151] Deleting tablet e5bc61637d944b60ba9e703e9894174c
0925 01:50:17.899743 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.899824 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6551114}
W20260925 01:50:17.922674 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e5bc61637d944b60ba9e703e9894174c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5bc61637d944b60ba9e703e9894174c already in progress: creating tablet
I20260925 01:50:17.923235 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 915) took 6575 ms. Trace:
I20260925 01:50:17.923326 11953 rpcz_store.cc:276] 0925 01:50:11.347527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.351202 (+ 3675us) service_pool.cc:224] Handling call
0925 01:50:17.923110 (+6571908us) ts_tablet_manager.cc:1151] Deleting tablet 1b4f58554cb84a08a3fdf14cb279ca56
0925 01:50:17.923120 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.923217 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6571754}
W20260925 01:50:17.923766 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1b4f58554cb84a08a3fdf14cb279ca56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b4f58554cb84a08a3fdf14cb279ca56 already in progress: creating tablet
I20260925 01:50:17.924101 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 914) took 6576 ms. Trace:
I20260925 01:50:17.924165 11755 ts_tablet_manager.cc:1434] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:50:17.924463 11755 tablet_bootstrap.cc:492] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.926200 11755 tablet_bootstrap.cc:654] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.927420 11753 tablet_bootstrap.cc:492] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.927609 11753 ts_tablet_manager.cc:1403] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260925 01:50:17.928030 11678 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e7b6bde824d74acfaaffc23a0b05db8b (table default.Table_c0c2a440fcfd4cdc8f97e52a83a31318 [id=2a9ff32ac39e45a898876d49c1332249]). Expected version 1 got 0
I20260925 01:50:17.928485 11753 raft_consensus.cc:359] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.928705 11753 raft_consensus.cc:385] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.928786 11753 raft_consensus.cc:740] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.929031 11753 consensus_queue.cc:260] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.924165 11953 rpcz_store.cc:276] 0925 01:50:11.347450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.353111 (+ 5661us) service_pool.cc:224] Handling call
0925 01:50:17.924003 (+6570892us) ts_tablet_manager.cc:1151] Deleting tablet dc00e20861c54760ac8409c54abd1795
0925 01:50:17.924012 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.924087 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6570736}
W20260925 01:50:17.929571 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet dc00e20861c54760ac8409c54abd1795 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc00e20861c54760ac8409c54abd1795 already in progress: creating tablet
I20260925 01:50:17.929647 11753 ts_tablet_manager.cc:1434] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:17.929952 11753 tablet_bootstrap.cc:492] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.931979 11753 tablet_bootstrap.cc:654] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.933182 13757 raft_consensus.cc:493] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.933300 13757 raft_consensus.cc:515] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.933914 13757 leader_election.cc:290] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.940573 11314 leader_election.cc:343] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: b4e5d28d466741a0a085a4f9938fffd1
I20260925 01:50:17.949177 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 909) took 6602 ms. Trace:
I20260925 01:50:17.949294 11953 rpcz_store.cc:276] 0925 01:50:11.346988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.391252 (+ 44264us) service_pool.cc:224] Handling call
0925 01:50:17.929357 (+6538105us) ts_tablet_manager.cc:1151] Deleting tablet 03232387650b450c97c41701b306ac77
0925 01:50:17.949046 (+ 19689us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.949150 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6537864}
I20260925 01:50:17.949688 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 925) took 6054 ms. Trace:
I20260925 01:50:17.949774 11953 rpcz_store.cc:276] 0925 01:50:11.895084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.928687 (+ 33603us) service_pool.cc:224] Handling call
0925 01:50:17.949578 (+6020891us) ts_tablet_manager.cc:1151] Deleting tablet b81a0f0e096f4bdaaedb2122c3487079
0925 01:50:17.949587 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.949671 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6020637}
W20260925 01:50:17.949859 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 03232387650b450c97c41701b306ac77 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03232387650b450c97c41701b306ac77 already in progress: creating tablet
I20260925 01:50:17.950088 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 926) took 6041 ms. Trace:
I20260925 01:50:17.950165 11953 rpcz_store.cc:276] 0925 01:50:11.909027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:11.909149 (+ 122us) service_pool.cc:224] Handling call
0925 01:50:17.949975 (+6040826us) ts_tablet_manager.cc:1151] Deleting tablet f30fbaa9db5144debf9cc5124c9bf9bd
0925 01:50:17.949983 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.950047 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5966903}
I20260925 01:50:17.950410 11953 tablet_replica.cc:333] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.950613 11946 ts_tablet_manager.cc:1929] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.950628 11953 raft_consensus.cc:2243] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:17.950636 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet b81a0f0e096f4bdaaedb2122c3487079 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b81a0f0e096f4bdaaedb2122c3487079 already in progress: creating tablet
I20260925 01:50:17.950731 11946 log.cc:1199] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/49b110516abb45d1880d0e0e33e20174
I20260925 01:50:17.950821 11953 raft_consensus.cc:2272] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:17.950853 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet f30fbaa9db5144debf9cc5124c9bf9bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f30fbaa9db5144debf9cc5124c9bf9bd already in progress: creating tablet
I20260925 01:50:17.951032 11946 ts_tablet_manager.cc:1950] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.951431 11953 ts_tablet_manager.cc:1916] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.951916 11753 tablet_bootstrap.cc:492] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.952054 11753 ts_tablet_manager.cc:1403] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260925 01:50:17.952777 11753 raft_consensus.cc:359] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.952926 11753 raft_consensus.cc:385] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.952967 11753 raft_consensus.cc:740] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.953183 11753 consensus_queue.cc:260] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.954757 11672 catalog_manager.cc:5938] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027) does not have the latest schema for tablet e7b6bde824d74acfaaffc23a0b05db8b (table default.Table_c0c2a440fcfd4cdc8f97e52a83a31318 [id=2a9ff32ac39e45a898876d49c1332249]). Expected version 1 got 0
I20260925 01:50:17.957873 11953 ts_tablet_manager.cc:1929] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260925 01:50:17.957994 11953 log.cc:1199] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/e95fb28febd94a26ba9682fb9a462872
I20260925 01:50:17.958530 11753 ts_tablet_manager.cc:1434] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:50:17.958801 11753 tablet_bootstrap.cc:492] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:17.959944 11755 tablet_bootstrap.cc:492] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:17.960068 11755 ts_tablet_manager.cc:1403] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.011s
I20260925 01:50:17.960500 11753 tablet_bootstrap.cc:654] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.960814 11755 raft_consensus.cc:359] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:17.960976 11755 raft_consensus.cc:385] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:17.961026 11755 raft_consensus.cc:740] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:17.961228 11755 consensus_queue.cc:260] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:17.961812 11946 tablet_replica.cc:333] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.961913 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 49b110516abb45d1880d0e0e33e20174 (table default.Table_3d10755c25e9452c8175928253480e9e [id=829de5b617c449de81f9b1c224dbf0bd]) successfully deleted
I20260925 01:50:17.961992 11946 raft_consensus.cc:2243] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.962159 11946 raft_consensus.cc:2272] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.962618 11946 ts_tablet_manager.cc:1916] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.963899 11953 ts_tablet_manager.cc:1950] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.964037 13586 raft_consensus.cc:493] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.964161 13586 raft_consensus.cc:515] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.964346 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 927) took 5957 ms. Trace:
I20260925 01:50:17.964479 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 007ee8e3087c4a70b9c5d8436a31659f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:17.964440 11953 rpcz_store.cc:276] 0925 01:50:12.006532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.011160 (+ 4628us) service_pool.cc:224] Handling call
0925 01:50:17.950369 (+5939209us) ts_tablet_manager.cc:1151] Deleting tablet e95fb28febd94a26ba9682fb9a462872
0925 01:50:17.950379 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.954795 (+ 4416us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.957820 (+ 3025us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.964329 (+ 6509us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5938950}
I20260925 01:50:17.964769 11953 tablet_replica.cc:333] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.964807 13586 leader_election.cc:290] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.964942 11953 raft_consensus.cc:2243] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.965021 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet e95fb28febd94a26ba9682fb9a462872 (table default.Table_bc57955da3db41a0aefb397290d813d2 [id=50af6373aee0495788c89142a4d5c9ff]) successfully deleted
I20260925 01:50:17.965377 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "236db241476a4a609869aad539fee426" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.965873 11457 leader_election.cc:343] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.965905 11953 raft_consensus.cc:2272] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.966408 11953 ts_tablet_manager.cc:1916] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.971246 11755 ts_tablet_manager.cc:1434] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260925 01:50:17.971545 11755 tablet_bootstrap.cc:492] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:17.975973 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet c28a226deca04da6a7a3f7a2b60598bd (table default.Table_7c7221346e01453b94b67caf6ad2263e [id=1fbb7357f1f14c38bcaef36bfed118e5]). Expected version 1 got 0
I20260925 01:50:17.976931 13586 raft_consensus.cc:493] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.977056 13586 raft_consensus.cc:515] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:17.977639 13586 leader_election.cc:290] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:17.981645 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2fe086048c04e0db797272e50f21c91" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
W20260925 01:50:17.982475 11457 leader_election.cc:343] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:17.983070 13452 raft_consensus.cc:493] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:17.983223 13452 raft_consensus.cc:515] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:17.983824 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet a8055cc9b06045449e6133298c8074e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:53 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:17.983824 13452 leader_election.cc:290] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:17.984763 11314 leader_election.cc:343] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: ae948bf42ae34a7ab72112d5f1f02585
I20260925 01:50:17.985283 11755 tablet_bootstrap.cc:654] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:17.994882 11946 ts_tablet_manager.cc:1929] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.995031 11946 log.cc:1199] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/681356bc659f4ca990cd2ffc0c10b533
I20260925 01:50:17.995419 11946 ts_tablet_manager.cc:1950] T 681356bc659f4ca990cd2ffc0c10b533 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:17.996636 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 681356bc659f4ca990cd2ffc0c10b533 (table default.Table_8d514818f2024dce89bf6d1480c69b09 [id=0a48dd4feb2542deaa4dacfa997da5e3]) successfully deleted
I20260925 01:50:17.997146 11946 tablet_replica.cc:333] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:17.997431 11946 raft_consensus.cc:2243] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:17.997673 11946 raft_consensus.cc:2272] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:17.998168 11953 ts_tablet_manager.cc:1929] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:17.998286 11953 log.cc:1199] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/3d398851fb194c61a0a3b2c60c7a5e8b
I20260925 01:50:17.998459 11946 ts_tablet_manager.cc:1916] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:17.998597 11953 ts_tablet_manager.cc:1950] T 3d398851fb194c61a0a3b2c60c7a5e8b P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:17.999384 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 928) took 5966 ms. Trace:
I20260925 01:50:17.999478 11953 rpcz_store.cc:276] 0925 01:50:12.033021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.035427 (+ 2406us) service_pool.cc:224] Handling call
0925 01:50:17.964724 (+5929297us) ts_tablet_manager.cc:1151] Deleting tablet 3d398851fb194c61a0a3b2c60c7a5e8b
0925 01:50:17.964733 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:17.969479 (+ 4746us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.998106 (+ 28627us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:17.999362 (+ 1256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":813,"tablet-delete.queue_time_us":5929069}
I20260925 01:50:17.999809 11953 tablet_replica.cc:333] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:17.999971 11753 tablet_bootstrap.cc:492] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:17.999948 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 3d398851fb194c61a0a3b2c60c7a5e8b (table default.Table_4ef3129ce4d545c0a2dae74dbc7798f0 [id=13bb30253d2c46e8aadf3c0065334d43]) successfully deleted
I20260925 01:50:18.000000 11953 raft_consensus.cc:2243] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 LEADER]: Raft consensus shutting down.
I20260925 01:50:18.000106 11753 ts_tablet_manager.cc:1403] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
I20260925 01:50:18.000267 11953 raft_consensus.cc:2272] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.000809 11953 ts_tablet_manager.cc:1916] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.000922 11753 raft_consensus.cc:359] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.001108 11753 raft_consensus.cc:385] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.001166 11753 raft_consensus.cc:740] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.001688 11755 tablet_bootstrap.cc:492] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:18.001804 11755 ts_tablet_manager.cc:1403] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260925 01:50:18.001648 11753 consensus_queue.cc:260] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.002455 11755 raft_consensus.cc:359] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.002599 11755 raft_consensus.cc:385] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.002643 11755 raft_consensus.cc:740] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.002856 11755 consensus_queue.cc:260] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.006819 11953 ts_tablet_manager.cc:1929] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260925 01:50:18.006913 11953 log.cc:1199] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/29f28e49791744428729279a79b6c9f1
I20260925 01:50:18.007251 11953 ts_tablet_manager.cc:1950] T 29f28e49791744428729279a79b6c9f1 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:18.008040 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 929) took 5959 ms. Trace:
I20260925 01:50:18.008114 11953 rpcz_store.cc:276] 0925 01:50:12.048958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.049022 (+ 64us) service_pool.cc:224] Handling call
0925 01:50:17.999764 (+5950742us) ts_tablet_manager.cc:1151] Deleting tablet 29f28e49791744428729279a79b6c9f1
0925 01:50:17.999774 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.003855 (+ 4081us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.006770 (+ 2915us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.008024 (+ 1254us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5950539}
I20260925 01:50:18.011610 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 29f28e49791744428729279a79b6c9f1 (table default.Table_c4b146df79f340bf9b1dc7663cdbbcaf [id=f8317c3550b14fe3abf468ea0d755b88]) successfully deleted
I20260925 01:50:18.011695 11755 ts_tablet_manager.cc:1434] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260925 01:50:18.011909 11753 ts_tablet_manager.cc:1434] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:50:18.011976 11755 tablet_bootstrap.cc:492] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:18.012228 11753 tablet_bootstrap.cc:492] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.012496 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 930) took 5908 ms. Trace:
I20260925 01:50:18.012622 11953 rpcz_store.cc:276] 0925 01:50:12.103723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.103780 (+ 57us) service_pool.cc:224] Handling call
0925 01:50:18.012373 (+5908593us) ts_tablet_manager.cc:1151] Deleting tablet 6091ed7d816a46958a6de343fe682292
0925 01:50:18.012381 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.012480 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5908386}
I20260925 01:50:18.013991 11753 tablet_bootstrap.cc:654] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.017122 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet e40083a885974e3595ec2fb5b16d4a5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:40776
W20260925 01:50:18.017953 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 6091ed7d816a46958a6de343fe682292 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6091ed7d816a46958a6de343fe682292 already in progress: creating tablet
I20260925 01:50:18.018453 11953 tablet_replica.cc:333] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:18.018754 11953 raft_consensus.cc:2243] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.022234 11953 raft_consensus.cc:2272] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.022419 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 5695f3af46974cb6a662f8788f9543e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.022838 11953 ts_tablet_manager.cc:1916] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.019591 11755 tablet_bootstrap.cc:654] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.030153 11755 tablet_bootstrap.cc:492] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:18.030297 11755 ts_tablet_manager.cc:1403] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260925 01:50:18.031040 11755 raft_consensus.cc:359] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.031215 11755 raft_consensus.cc:385] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.031267 11755 raft_consensus.cc:740] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
W20260925 01:50:18.032814 12961 connection.cc:573] server connection from 127.10.159.193:49947 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 01:50:18.034314 13586 raft_consensus.cc:493] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.034466 13586 raft_consensus.cc:515] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.035163 13586 leader_election.cc:290] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:18.035246 11665 connection.cc:573] client connection to 127.10.159.193:44813 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:18.035364 11665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 8 similar messages]
I20260925 01:50:18.031556 11755 consensus_queue.cc:260] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.035629 11753 tablet_bootstrap.cc:492] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.035727 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941fd8333f6d45878677e55ff6948bbf" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:18.035790 11753 ts_tablet_manager.cc:1403] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
W20260925 01:50:18.036350 11457 leader_election.cc:343] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
I20260925 01:50:18.036767 11753 raft_consensus.cc:359] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.037019 11753 raft_consensus.cc:385] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.037101 11753 raft_consensus.cc:740] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.037424 11753 consensus_queue.cc:260] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.039969 11953 ts_tablet_manager.cc:1929] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.040138 11953 log.cc:1199] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/ae948bf42ae34a7ab72112d5f1f02585
I20260925 01:50:18.040504 11953 ts_tablet_manager.cc:1950] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
W20260925 01:50:18.041304 11455 connection.cc:573] server connection from 127.10.159.193:59155 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 01:50:18.041790 13452 raft_consensus.cc:493] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.041891 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 931) took 5499 ms. Trace:
I20260925 01:50:18.041915 13452 raft_consensus.cc:515] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.041970 11953 rpcz_store.cc:276] 0925 01:50:12.542194 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.542257 (+ 63us) service_pool.cc:224] Handling call
0925 01:50:18.018405 (+5476148us) ts_tablet_manager.cc:1151] Deleting tablet ae948bf42ae34a7ab72112d5f1f02585
0925 01:50:18.018414 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.026138 (+ 7724us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.039897 (+ 13759us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.041876 (+ 1979us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5475936}
I20260925 01:50:18.042447 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet ae948bf42ae34a7ab72112d5f1f02585 (table default.Table_405242f491234df4b8b961f90612941e [id=8bd966f720a046bf8c2eb5501db20fa0]) successfully deleted
I20260925 01:50:18.042558 13452 leader_election.cc:290] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.044081 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7b6bde824d74acfaaffc23a0b05db8b" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:18.044320 11522 raft_consensus.cc:2393] T e7b6bde824d74acfaaffc23a0b05db8b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aac4ec033f794d7a90b52aa4e0b6155d in current term 1: Already voted for candidate b93565e796c94a3699eb1824383bbaeb in this term.
I20260925 01:50:18.044495 13452 raft_consensus.cc:493] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.044611 13452 raft_consensus.cc:515] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.045156 13452 leader_election.cc:290] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:18.045572 11456 connection.cc:573] client connection to 127.10.159.193:44813 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 01:50:18.045697 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 932) took 5485 ms. Trace:
W20260925 01:50:18.045712 11456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 01:50:18.045773 11953 rpcz_store.cc:276] 0925 01:50:12.559925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.560194 (+ 269us) service_pool.cc:224] Handling call
0925 01:50:18.045566 (+5485372us) ts_tablet_manager.cc:1151] Deleting tablet 1cd17f1ecead409ab7b54c2120476a3b
0925 01:50:18.045576 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.045680 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5485171}
I20260925 01:50:18.046721 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 937) took 5455 ms. Trace:
W20260925 01:50:18.046845 11314 connection.cc:769] client connection to 127.10.159.193:44813 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20260925 01:50:18.047138 11314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: sendmsg error: Connection reset by peer (error 104)
W20260925 01:50:18.046326 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1cd17f1ecead409ab7b54c2120476a3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cd17f1ecead409ab7b54c2120476a3b already in progress: creating tablet
I20260925 01:50:18.047834 13452 raft_consensus.cc:493] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.047986 13452 raft_consensus.cc:515] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.048795 13452 leader_election.cc:290] T 602af3d6e7bb44f8a316691019f85c25 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.048897 13586 raft_consensus.cc:493] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.049019 13586 raft_consensus.cc:515] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.049666 13586 leader_election.cc:290] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:18.051976 11755 ts_tablet_manager.cc:1434] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260925 01:50:18.052307 11755 tablet_bootstrap.cc:492] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:18.046957 11953 rpcz_store.cc:276] 0925 01:50:12.590779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.595766 (+ 4987us) service_pool.cc:224] Handling call
0925 01:50:18.046516 (+5450750us) ts_tablet_manager.cc:1151] Deleting tablet d28dc51fc345487ba74c56b9b8f1ad42
0925 01:50:18.046528 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.046677 (+ 149us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5450550}
W20260925 01:50:18.064343 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d28dc51fc345487ba74c56b9b8f1ad42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d28dc51fc345487ba74c56b9b8f1ad42 already in progress: creating tablet
I20260925 01:50:18.064438 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 11298
I20260925 01:50:18.065033 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 939) took 5474 ms. Trace:
I20260925 01:50:18.065231 11953 rpcz_store.cc:276] 0925 01:50:12.590959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.596403 (+ 5444us) service_pool.cc:224] Handling call
0925 01:50:18.064861 (+5468458us) ts_tablet_manager.cc:1151] Deleting tablet a8d3b4ec14d5457eb0d0d364904e755d
0925 01:50:18.064876 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.065007 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5468303}
W20260925 01:50:18.065963 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet a8d3b4ec14d5457eb0d0d364904e755d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8d3b4ec14d5457eb0d0d364904e755d already in progress: creating tablet
I20260925 01:50:18.066031 11753 ts_tablet_manager.cc:1434] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260925 01:50:18.066548 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 942) took 5460 ms. Trace:
I20260925 01:50:18.066709 11953 rpcz_store.cc:276] 0925 01:50:12.606409 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.606488 (+ 79us) service_pool.cc:224] Handling call
0925 01:50:18.066390 (+5459902us) ts_tablet_manager.cc:1151] Deleting tablet e1480131c1e74536b5f3fa54764dc4f3
0925 01:50:18.066404 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.066525 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5459696}
W20260925 01:50:18.067355 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet e1480131c1e74536b5f3fa54764dc4f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1480131c1e74536b5f3fa54764dc4f3 already in progress: creating tablet
I20260925 01:50:18.054026 11755 tablet_bootstrap.cc:654] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.068454 13586 raft_consensus.cc:493] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.068606 13586 raft_consensus.cc:515] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.069069 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 943) took 5445 ms. Trace:
I20260925 01:50:18.069168 11953 rpcz_store.cc:276] 0925 01:50:12.623740 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.623795 (+ 55us) service_pool.cc:224] Handling call
0925 01:50:18.068921 (+5445126us) ts_tablet_manager.cc:1151] Deleting tablet fdc26312580742a8a01b897e551a3a3d
0925 01:50:18.068933 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.069047 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5444940}
I20260925 01:50:18.069299 13586 leader_election.cc:290] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:18.069715 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet fdc26312580742a8a01b897e551a3a3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdc26312580742a8a01b897e551a3a3d already in progress: creating tablet
I20260925 01:50:18.070736 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 953) took 5342 ms. Trace:
I20260925 01:50:18.070847 11953 rpcz_store.cc:276] 0925 01:50:12.728400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:12.728475 (+ 75us) service_pool.cc:224] Handling call
0925 01:50:18.069990 (+5341515us) ts_tablet_manager.cc:1151] Deleting tablet 03487a3fa9574fd583d9c95d0624203c
0925 01:50:18.070004 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.070713 (+ 709us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5341291}
W20260925 01:50:18.071357 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 03487a3fa9574fd583d9c95d0624203c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03487a3fa9574fd583d9c95d0624203c already in progress: creating tablet
I20260925 01:50:18.072340 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 958) took 4982 ms. Trace:
I20260925 01:50:18.072508 11953 rpcz_store.cc:276] 0925 01:50:13.090104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.090160 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:18.072206 (+4982046us) ts_tablet_manager.cc:1151] Deleting tablet 915b1621cea64c03bd486ef32e815f5f
0925 01:50:18.072219 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.072318 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4981826}
W20260925 01:50:18.073083 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 915b1621cea64c03bd486ef32e815f5f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 915b1621cea64c03bd486ef32e815f5f already in progress: creating tablet
I20260925 01:50:18.073518 11953 tablet_replica.cc:333] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:18.073828 11953 raft_consensus.cc:2243] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.074110 11953 raft_consensus.cc:2272] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.074936 11953 ts_tablet_manager.cc:1916] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.076097 11370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5695f3af46974cb6a662f8788f9543e0" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:18.077041 11362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd615a0405742fcb472d92829a8d7c7" candidate_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" is_pre_election: true
I20260925 01:50:18.077332 13452 raft_consensus.cc:493] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.077453 13452 raft_consensus.cc:515] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.077745 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "602af3d6e7bb44f8a316691019f85c25" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:18.077953 13452 leader_election.cc:290] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
W20260925 01:50:18.078677 11314 leader_election.cc:343] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 5048a0fca2e64ffa9f19000f48a4c090
I20260925 01:50:18.078850 11420 generic_service.cc:196] Checking for leaks (request via RPC)
W20260925 01:50:18.080236 11457 leader_election.cc:343] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:18.080610 11457 leader_election.cc:343] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Illegal state: must be running to vote when last-logged opid is not known
W20260925 01:50:18.075672 13776 negotiation.cc:336] Failed RPC negotiation. Trace:
0925 01:50:18.054874 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.10.159.193:44813 (local address 127.10.159.194:44895)
0925 01:50:18.075437 (+ 20563us) negotiation.cc:107] Waiting for socket to connect
0925 01:50:18.075536 (+ 99us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":20436,"thread_start_us":20348,"threads_started":1}
W20260925 01:50:18.081732 11456 leader_election.cc:336] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.081902 11456 leader_election.cc:304] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.082377 13586 raft_consensus.cc:2749] T a0a50af9614341d49c4c690e2ec785b0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.082816 11456 consensus_peers.cc:597] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.082908 11456 consensus_peers.cc:597] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.082975 11456 leader_election.cc:336] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.083050 11456 leader_election.cc:304] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.083457 13586 raft_consensus.cc:2749] T 35ff8a661fba41bab36966b10d4202c4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.083803 11456 leader_election.cc:336] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.083920 11456 leader_election.cc:304] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.084146 11456 raft_consensus.cc:2686] T 49b110516abb45d1880d0e0e33e20174 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.084903 11456 consensus_peers.cc:597] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.085011 11456 consensus_peers.cc:597] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:18.085115 11753 tablet_bootstrap.cc:492] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:18.085238 11456 leader_election.cc:336] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.085336 11456 leader_election.cc:304] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.086280 11456 leader_election.cc:336] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.086486 11456 leader_election.cc:304] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.086692 13586 raft_consensus.cc:2749] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.087227 11456 raft_consensus.cc:2686] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.087476 11456 leader_election.cc:336] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.087625 11456 leader_election.cc:304] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.087865 13586 raft_consensus.cc:2749] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.087975 11456 leader_election.cc:336] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.088084 11456 leader_election.cc:304] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.088394 13586 raft_consensus.cc:2749] T b9c41bc8a5de4cf1922e12f4d52ac0f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.088762 11946 ts_tablet_manager.cc:1929] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.088871 11946 log.cc:1199] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/c2fe086048c04e0db797272e50f21c91
W20260925 01:50:18.090221 11456 leader_election.cc:336] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
W20260925 01:50:18.090831 11665 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.AlterSchema -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 55460us
I20260925 01:50:18.091415 11753 tablet_bootstrap.cc:654] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.099434 11456 leader_election.cc:304] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.099959 13586 raft_consensus.cc:2749] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.100435 11456 leader_election.cc:336] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.100865 11456 leader_election.cc:304] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.101366 13586 raft_consensus.cc:2749] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.102265 11456 leader_election.cc:336] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.103633 11456 leader_election.cc:304] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.103852 11456 raft_consensus.cc:2686] T 85db5688ef064053870a39a906ad9071 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.104429 11456 consensus_peers.cc:597] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.104604 11456 leader_election.cc:336] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.104732 11456 leader_election.cc:304] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.104930 11456 raft_consensus.cc:2686] T d3aadd649e4b4f489bfe4b0eea13ede8 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.105441 11456 consensus_peers.cc:597] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.105600 11456 consensus_peers.cc:597] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.105717 11456 consensus_peers.cc:597] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.108119 11665 catalog_manager.cc:4790] TS b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): CreateTablet RPC failed for tablet 1bd4701a82e5458f957e5a2760deec64: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
W20260925 01:50:18.109550 11456 leader_election.cc:336] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.110958 11753 tablet_bootstrap.cc:492] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.110958 11946 ts_tablet_manager.cc:1950] T c2fe086048c04e0db797272e50f21c91 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.111339 11753 ts_tablet_manager.cc:1403] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.004s
I20260925 01:50:18.112069 11946 tablet_replica.cc:333] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.112076 11753 raft_consensus.cc:359] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.112624 11753 raft_consensus.cc:385] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.112718 11753 raft_consensus.cc:740] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.113008 11753 consensus_queue.cc:260] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.112108 11456 leader_election.cc:304] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.113562 11456 raft_consensus.cc:2686] T 4930edeb2edd4e7494dbf1761b5d20c0 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.114117 11456 leader_election.cc:336] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.114279 11456 leader_election.cc:304] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.115217 11946 raft_consensus.cc:2243] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.115363 11946 raft_consensus.cc:2272] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.115832 11946 ts_tablet_manager.cc:1916] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.122857 13784 raft_consensus.cc:2749] T 64ce95e571524d6ea6c98087bc08d4b9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.122942 11456 leader_election.cc:336] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.123284 11456 leader_election.cc:304] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.123937 11456 raft_consensus.cc:2686] T 5d37a05d2bcd4c94ba51fef8096f889d P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.124485 11456 consensus_peers.cc:597] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:18.123782 11753 ts_tablet_manager.cc:1434] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260925 01:50:18.139434 11753 tablet_bootstrap.cc:492] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:18.143229 11456 consensus_peers.cc:597] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.152735 11456 consensus_peers.cc:597] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.152851 11456 leader_election.cc:336] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.152933 11456 leader_election.cc:304] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.153164 13586 raft_consensus.cc:2749] T d07df8063b2e4971a12af229585cfe44 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.153245 11456 leader_election.cc:336] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.153326 11456 leader_election.cc:304] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.149081 11946 ts_tablet_manager.cc:1929] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.153538 13586 raft_consensus.cc:2749] T d5edd719563c4f009fc840aa6fdda04a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.153620 11946 log.cc:1199] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/9f7f7ee517df483b83d1627cdb6f9433
W20260925 01:50:18.153795 11456 consensus_peers.cc:597] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:18.145543 11753 tablet_bootstrap.cc:654] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.153978 11946 ts_tablet_manager.cc:1950] T 9f7f7ee517df483b83d1627cdb6f9433 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.155014 11946 tablet_replica.cc:333] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.155308 11946 raft_consensus.cc:2243] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:18.153967 11456 leader_election.cc:336] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.155699 11456 leader_election.cc:304] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.155969 11946 raft_consensus.cc:2272] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.156613 11946 ts_tablet_manager.cc:1916] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.161406 11753 tablet_bootstrap.cc:492] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
W20260925 01:50:18.156085 11456 raft_consensus.cc:2686] T 47b62644673447239feb0f8f851012ef P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:18.161563 11753 ts_tablet_manager.cc:1403] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
W20260925 01:50:18.162151 11456 leader_election.cc:336] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.162241 11753 raft_consensus.cc:359] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.162405 11753 raft_consensus.cc:385] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.162468 11753 raft_consensus.cc:740] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.162343 11456 leader_election.cc:304] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.162715 13586 raft_consensus.cc:493] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.162684 11753 consensus_queue.cc:260] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.162847 13586 raft_consensus.cc:515] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.163164 11753 ts_tablet_manager.cc:1434] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:18.163406 13586 leader_election.cc:290] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:18.163487 11753 tablet_bootstrap.cc:492] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.164049 13586 raft_consensus.cc:2749] T 9a82e0251ebb4500b628924c89bfe1b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.165050 11753 tablet_bootstrap.cc:654] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.183000 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet c2fe086048c04e0db797272e50f21c91 (table default.Table_e297a48065794637b13d401d13c54906 [id=1091c7fd09f344db898a0a98d6ea8bd3]) successfully deleted
I20260925 01:50:18.185141 11753 tablet_bootstrap.cc:492] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.185747 11487 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cac299e4f8e4c9d90f244cd8719005a with delete_type TABLET_DATA_DELETED (replaced by tablet dfc41da6d8be47818cc2f68cd2558c7a) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.187047 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet d12d2cf8c4744858bf0967eeec72f381 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:55 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.189318 11753 ts_tablet_manager.cc:1403] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.011s
I20260925 01:50:18.192054 11753 raft_consensus.cc:359] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.192337 11753 raft_consensus.cc:385] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.192433 11753 raft_consensus.cc:740] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.187956 11946 ts_tablet_manager.cc:1929] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260925 01:50:18.188171 11456 leader_election.cc:336] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.192800 11753 consensus_queue.cc:260] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.193171 11946 log.cc:1199] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e2ba874cb6a34ccd9e59cc9146280c17
I20260925 01:50:18.193559 11946 ts_tablet_manager.cc:1950] T e2ba874cb6a34ccd9e59cc9146280c17 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.194109 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a773feeb51349a084efedfd338eafe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.203153 11753 ts_tablet_manager.cc:1434] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:50:18.204816 13586 raft_consensus.cc:493] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.204957 13586 raft_consensus.cc:515] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.205565 13586 leader_election.cc:290] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:18.207150 11456 leader_election.cc:336] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.207911 11753 tablet_bootstrap.cc:492] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.209296 11753 tablet_bootstrap.cc:654] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.216821 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 9f7f7ee517df483b83d1627cdb6f9433 (table default.Table_3ee0ad1909f644498b594873c3d11c23 [id=48a879b2086842449b425f4930f1c5a7]) successfully deleted
I20260925 01:50:18.217628 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f7e203f023745f0b9b44085b0943c6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.220557 11946 tablet_replica.cc:333] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.221006 11946 raft_consensus.cc:2243] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260925 01:50:18.221026 11665 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet 9a82e0251ebb4500b628924c89bfe1b2 (table default.Table_e2f3327250404a46bf3cc196408fb2a6 [id=d991f187447f4aedb17ee797607351f5], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9a82e0251ebb4500b628924c89bfe1b2 consensus state has no leader
I20260925 01:50:18.221190 11946 raft_consensus.cc:2272] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.221205 11753 tablet_bootstrap.cc:492] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.221382 11753 ts_tablet_manager.cc:1403] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260925 01:50:18.221901 11946 ts_tablet_manager.cc:1916] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.222375 11753 raft_consensus.cc:359] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.222569 11753 raft_consensus.cc:385] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.222616 11753 raft_consensus.cc:740] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.222806 11753 consensus_queue.cc:260] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.223234 11753 ts_tablet_manager.cc:1434] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:18.223498 11753 tablet_bootstrap.cc:492] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.224861 11753 tablet_bootstrap.cc:654] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.230439 11946 ts_tablet_manager.cc:1929] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.230618 11946 log.cc:1199] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/941fd8333f6d45878677e55ff6948bbf
I20260925 01:50:18.230988 11946 ts_tablet_manager.cc:1950] T 941fd8333f6d45878677e55ff6948bbf P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.232270 11753 tablet_bootstrap.cc:492] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.232417 11753 ts_tablet_manager.cc:1403] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260925 01:50:18.233109 11753 raft_consensus.cc:359] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.233289 11753 raft_consensus.cc:385] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.233345 11753 raft_consensus.cc:740] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.233541 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e2ba874cb6a34ccd9e59cc9146280c17 (table default.Table_a4b81d45884b4b448624e0ce194da08b [id=2cdf410d9ffc49b2b86ef10deb041799]) successfully deleted
I20260925 01:50:18.233565 11753 consensus_queue.cc:260] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.234139 11753 ts_tablet_manager.cc:1434] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:18.234279 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 915b1621cea64c03bd486ef32e815f5f with delete_type TABLET_DATA_DELETED (replaced by tablet f093df623d384a41b466758e99284f3e) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.237728 11753 tablet_bootstrap.cc:492] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.239346 11753 tablet_bootstrap.cc:654] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.239408 11946 tablet_replica.cc:333] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.239596 11946 raft_consensus.cc:2243] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.239790 11946 raft_consensus.cc:2272] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.240572 11946 ts_tablet_manager.cc:1916] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.247092 11946 ts_tablet_manager.cc:1929] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.247213 11946 log.cc:1199] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/cdd615a0405742fcb472d92829a8d7c7
I20260925 01:50:18.247284 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b2eed649c6f447d8f9af98637061af1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:09 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.247517 11946 ts_tablet_manager.cc:1950] T cdd615a0405742fcb472d92829a8d7c7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.247476 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 941fd8333f6d45878677e55ff6948bbf (table default.Table_e2f7a1b5f1b94e3b87dcaa2cab95bc6a [id=35b3f2605340482a97104b0fd975275f]) successfully deleted
I20260925 01:50:18.255175 11946 tablet_replica.cc:333] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.255139 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet cdd615a0405742fcb472d92829a8d7c7 (table default.Table_68b05a96deb14f4eaddad7c1cf98a651 [id=5dc5a14f4ab54258a830c761642e174e]) successfully deleted
I20260925 01:50:18.255221 11753 tablet_bootstrap.cc:492] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.255391 11946 raft_consensus.cc:2243] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.255632 11753 ts_tablet_manager.cc:1403] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20260925 01:50:18.255642 11946 raft_consensus.cc:2272] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.256361 11753 raft_consensus.cc:359] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.256469 11946 ts_tablet_manager.cc:1916] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.256582 11753 raft_consensus.cc:385] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.256690 11753 raft_consensus.cc:740] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.257378 11753 consensus_queue.cc:260] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.257882 11753 ts_tablet_manager.cc:1434] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:18.260509 11753 tablet_bootstrap.cc:492] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.262013 11753 tablet_bootstrap.cc:654] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.271914 11946 ts_tablet_manager.cc:1929] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.272055 11946 log.cc:1199] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/236db241476a4a609869aad539fee426
I20260925 01:50:18.276455 11946 ts_tablet_manager.cc:1950] T 236db241476a4a609869aad539fee426 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.277683 11946 tablet_replica.cc:333] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.277941 11946 raft_consensus.cc:2243] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.278218 11946 raft_consensus.cc:2272] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.278946 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 236db241476a4a609869aad539fee426 (table default.Table_8d20c9d9083d44d1a86ba727ee87b628 [id=65132a4f011d4ca587b173124a9688ff]) successfully deleted
I20260925 01:50:18.279372 11946 ts_tablet_manager.cc:1916] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.279466 11753 tablet_bootstrap.cc:492] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.279604 11753 ts_tablet_manager.cc:1403] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260925 01:50:18.280341 11753 raft_consensus.cc:359] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.280514 11753 raft_consensus.cc:385] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.280572 11753 raft_consensus.cc:740] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.280761 11753 consensus_queue.cc:260] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.287581 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e112a4ce48f40a196f655379c758c9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.288630 11946 ts_tablet_manager.cc:1929] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.288810 11946 log.cc:1199] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/09a79f0bd7374dabb2edc5ddf5fc8e41
I20260925 01:50:18.289175 11946 ts_tablet_manager.cc:1950] T 09a79f0bd7374dabb2edc5ddf5fc8e41 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.292564 11753 ts_tablet_manager.cc:1434] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260925 01:50:18.296598 11946 tablet_replica.cc:333] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.296855 11946 raft_consensus.cc:2243] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.297079 11946 raft_consensus.cc:2272] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.297706 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 09a79f0bd7374dabb2edc5ddf5fc8e41 (table default.Table_ca11a48fdf91477da5a1262664f1bb58 [id=e895a550479a4427ae79ecd31d1cc4e0]) successfully deleted
I20260925 01:50:18.299332 11753 tablet_bootstrap.cc:492] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.301182 11753 tablet_bootstrap.cc:654] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.303483 13785 raft_consensus.cc:493] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.303653 13785 raft_consensus.cc:515] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.304363 13785 leader_election.cc:290] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:18.304440 11946 ts_tablet_manager.cc:1916] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:18.306890 11456 leader_election.cc:336] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.310629 11946 ts_tablet_manager.cc:1929] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.310745 11946 log.cc:1199] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/007ee8e3087c4a70b9c5d8436a31659f
I20260925 01:50:18.311034 11946 ts_tablet_manager.cc:1950] T 007ee8e3087c4a70b9c5d8436a31659f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.317580 11946 tablet_replica.cc:333] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.317826 11946 raft_consensus.cc:2243] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.317986 11946 raft_consensus.cc:2272] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.318840 11753 tablet_bootstrap.cc:492] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.318993 11753 ts_tablet_manager.cc:1403] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.013s
I20260925 01:50:18.319722 11753 raft_consensus.cc:359] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.319904 11753 raft_consensus.cc:385] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.319968 11753 raft_consensus.cc:740] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.320168 11753 consensus_queue.cc:260] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.320657 11753 ts_tablet_manager.cc:1434] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:18.320923 11753 tablet_bootstrap.cc:492] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.322638 11753 tablet_bootstrap.cc:654] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.322639 13784 raft_consensus.cc:493] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.322940 13784 raft_consensus.cc:515] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.323632 13784 leader_election.cc:290] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:18.324011 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 007ee8e3087c4a70b9c5d8436a31659f (table default.Table_cf2d103c478e4c228e3e9e3156096833 [id=7fccae87a777448ea12742e2375ca799]) successfully deleted
I20260925 01:50:18.324150 11946 ts_tablet_manager.cc:1916] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:18.325577 11456 leader_election.cc:336] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.330406 11946 ts_tablet_manager.cc:1929] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.330552 11946 log.cc:1199] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/5695f3af46974cb6a662f8788f9543e0
I20260925 01:50:18.330890 11946 ts_tablet_manager.cc:1950] T 5695f3af46974cb6a662f8788f9543e0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.332114 11753 tablet_bootstrap.cc:492] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.332255 11753 ts_tablet_manager.cc:1403] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260925 01:50:18.332973 11753 raft_consensus.cc:359] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.333143 11753 raft_consensus.cc:385] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.333196 11753 raft_consensus.cc:740] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.333390 11753 consensus_queue.cc:260] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.333899 11753 ts_tablet_manager.cc:1434] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:18.337011 11946 tablet_replica.cc:333] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.337235 11946 raft_consensus.cc:2243] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.337397 11946 raft_consensus.cc:2272] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.337611 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet a86ac7e553854304ba7b3b1d38c86c53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:56 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.337764 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 5695f3af46974cb6a662f8788f9543e0 (table default.Table_ee607bb78c5e460d97313b3352e1e93f [id=8e08c5d291b14de4bfa817fd20ddbfd3]) successfully deleted
I20260925 01:50:18.338852 11946 ts_tablet_manager.cc:1916] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.343309 11753 tablet_bootstrap.cc:492] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.345180 11753 tablet_bootstrap.cc:654] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.349213 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet e457c4ab4e814fc4be11ced6ca69284f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.356292 11946 ts_tablet_manager.cc:1929] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.356432 11946 log.cc:1199] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/1cac299e4f8e4c9d90f244cd8719005a
I20260925 01:50:18.357465 11946 ts_tablet_manager.cc:1950] T 1cac299e4f8e4c9d90f244cd8719005a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.359042 11753 tablet_bootstrap.cc:492] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.359130 11946 tablet_replica.cc:333] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.359194 11753 ts_tablet_manager.cc:1403] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.003s
I20260925 01:50:18.359598 11946 raft_consensus.cc:2243] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.359781 11946 raft_consensus.cc:2272] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.360296 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 1cac299e4f8e4c9d90f244cd8719005a (table default.Table_48c989f6fa584f9da88833a6fd98bb7e [id=9f3c01bf46474e3cba73aed29d40d458]) successfully deleted
I20260925 01:50:18.360247 11753 raft_consensus.cc:359] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.360369 11946 ts_tablet_manager.cc:1916] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.360412 11753 raft_consensus.cc:385] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.360464 11753 raft_consensus.cc:740] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.360707 11753 consensus_queue.cc:260] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.366277 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5c44007cb7eb4263a9209cb3989d4a25 (table default.Table_38133c6cf6c2446cac65d84dc214f99e [id=6495ac23936e4b829bbcd9d3218358d4]). Expected version 1 got 0
I20260925 01:50:18.370795 11753 ts_tablet_manager.cc:1434] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:50:18.376276 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 5c44007cb7eb4263a9209cb3989d4a25 (table default.Table_38133c6cf6c2446cac65d84dc214f99e [id=6495ac23936e4b829bbcd9d3218358d4]). Expected version 1 got 0
I20260925 01:50:18.373062 11946 ts_tablet_manager.cc:1929] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.378118 11946 log.cc:1199] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/d12d2cf8c4744858bf0967eeec72f381
I20260925 01:50:18.378468 11946 ts_tablet_manager.cc:1950] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.373332 11753 tablet_bootstrap.cc:492] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.379177 11946 tablet_replica.cc:333] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.379359 11946 raft_consensus.cc:2243] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.379505 11946 raft_consensus.cc:2272] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.380266 11946 ts_tablet_manager.cc:1916] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.380549 11753 tablet_bootstrap.cc:654] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.380759 13586 raft_consensus.cc:493] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.380893 13586 raft_consensus.cc:515] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.381467 13586 leader_election.cc:290] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:18.382223 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet d12d2cf8c4744858bf0967eeec72f381 (table default.Table_55f4b9d844104a95a649ebdd7d7def2b [id=c67ff8cea6124dd787124b925d489d7c]) successfully deleted
W20260925 01:50:18.383291 11456 leader_election.cc:336] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.389312 11946 ts_tablet_manager.cc:1929] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.389446 11946 log.cc:1199] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/6a773feeb51349a084efedfd338eafe0
I20260925 01:50:18.389755 11946 ts_tablet_manager.cc:1950] T 6a773feeb51349a084efedfd338eafe0 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.391124 11753 tablet_bootstrap.cc:492] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.391258 11946 tablet_replica.cc:333] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.391469 11946 raft_consensus.cc:2243] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.391608 11946 raft_consensus.cc:2272] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.391270 11753 ts_tablet_manager.cc:1403] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.007s
I20260925 01:50:18.392181 11946 ts_tablet_manager.cc:1916] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.392632 11753 raft_consensus.cc:359] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.392828 11753 raft_consensus.cc:385] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.392884 11753 raft_consensus.cc:740] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.393100 11753 consensus_queue.cc:260] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.393970 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 6a773feeb51349a084efedfd338eafe0 (table default.Table_e6ae26fb382848328c1929063046a7b7 [id=7f537c3bad194458839dd31897b10910]) successfully deleted
I20260925 01:50:18.395522 11753 ts_tablet_manager.cc:1434] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260925 01:50:18.398268 11753 tablet_bootstrap.cc:492] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.400110 11753 tablet_bootstrap.cc:654] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.407536 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b75b12794fa4f4fa53156c212632cdc) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.410408 11946 ts_tablet_manager.cc:1929] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.410535 11946 log.cc:1199] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/3f7e203f023745f0b9b44085b0943c6d
I20260925 01:50:18.410840 11946 ts_tablet_manager.cc:1950] T 3f7e203f023745f0b9b44085b0943c6d P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.412557 11753 tablet_bootstrap.cc:492] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.412693 11753 ts_tablet_manager.cc:1403] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260925 01:50:18.413430 11753 raft_consensus.cc:359] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.413604 11753 raft_consensus.cc:385] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.413658 11753 raft_consensus.cc:740] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.413861 11753 consensus_queue.cc:260] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.421550 11946 tablet_replica.cc:333] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.421766 11946 raft_consensus.cc:2243] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.421928 11946 raft_consensus.cc:2272] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.424981 11946 ts_tablet_manager.cc:1916] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.431594 11946 ts_tablet_manager.cc:1929] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.431737 11946 log.cc:1199] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/915b1621cea64c03bd486ef32e815f5f
I20260925 01:50:18.432111 11946 ts_tablet_manager.cc:1950] T 915b1621cea64c03bd486ef32e815f5f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.433383 11753 ts_tablet_manager.cc:1434] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20260925 01:50:18.433694 11753 tablet_bootstrap.cc:492] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.435714 11753 tablet_bootstrap.cc:654] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.437319 11946 tablet_replica.cc:333] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.437530 11946 raft_consensus.cc:2243] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.437685 11946 raft_consensus.cc:2272] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.438299 11946 ts_tablet_manager.cc:1916] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.438894 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 11a0a886d73442bd9753df870acf63f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.438935 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 3f7e203f023745f0b9b44085b0943c6d (table default.Table_0a5bd932fcc142468b4c60bc7084337e [id=5f56ea42234d47e5b8c03859194a9f6c]) successfully deleted
I20260925 01:50:18.439177 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 915b1621cea64c03bd486ef32e815f5f (table default.Table_83cb911831d14ec1a87189952a773203 [id=6d2a03b0b54f40aebaac877c5a1b7ad6]) successfully deleted
I20260925 01:50:18.449005 11946 ts_tablet_manager.cc:1929] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.449190 11946 log.cc:1199] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/8b2eed649c6f447d8f9af98637061af1
I20260925 01:50:18.450413 11946 ts_tablet_manager.cc:1950] T 8b2eed649c6f447d8f9af98637061af1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.452957 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 8b2eed649c6f447d8f9af98637061af1 (table default.Table_6ec641e1915b414b80f52f871e36af6f [id=053ed5044aeb435797c6e74e3eb77336]) successfully deleted
I20260925 01:50:18.453318 11946 tablet_replica.cc:333] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.453547 11946 raft_consensus.cc:2243] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.453706 11946 raft_consensus.cc:2272] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.454537 11946 ts_tablet_manager.cc:1916] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.458114 13782 raft_consensus.cc:493] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.458251 13782 raft_consensus.cc:515] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.458823 13782 leader_election.cc:290] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:18.461109 11456 leader_election.cc:336] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.462265 11753 tablet_bootstrap.cc:492] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.462402 11753 ts_tablet_manager.cc:1403] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.005s
I20260925 01:50:18.463178 11753 raft_consensus.cc:359] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.463364 11753 raft_consensus.cc:385] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.463431 11753 raft_consensus.cc:740] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.463524 11946 ts_tablet_manager.cc:1929] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.463626 11946 log.cc:1199] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/9e112a4ce48f40a196f655379c758c9c
I20260925 01:50:18.463708 11753 consensus_queue.cc:260] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.464056 11946 ts_tablet_manager.cc:1950] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.471438 11946 tablet_replica.cc:333] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.471678 11946 raft_consensus.cc:2243] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.471864 11946 raft_consensus.cc:2272] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.472500 11946 ts_tablet_manager.cc:1916] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.473951 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 9e112a4ce48f40a196f655379c758c9c (table default.Table_8e5d86dc0f4d4b34b354608684b3b584 [id=749d99fadae243929e14d85b1505b225]) successfully deleted
I20260925 01:50:18.479164 11753 ts_tablet_manager.cc:1434] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260925 01:50:18.479524 11753 tablet_bootstrap.cc:492] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.485486 11946 ts_tablet_manager.cc:1929] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.485635 11946 log.cc:1199] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/a86ac7e553854304ba7b3b1d38c86c53
I20260925 01:50:18.486018 11946 ts_tablet_manager.cc:1950] T a86ac7e553854304ba7b3b1d38c86c53 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.487761 11753 tablet_bootstrap.cc:654] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.493659 11946 tablet_replica.cc:333] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.493856 11946 raft_consensus.cc:2243] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.494012 11946 raft_consensus.cc:2272] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.494778 11946 ts_tablet_manager.cc:1916] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.497195 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet a86ac7e553854304ba7b3b1d38c86c53 (table default.Table_3656d1af0d574a22a269b272ff601b97 [id=d9a25d66d3c54ed5bde8bf8875ece64e]) successfully deleted
I20260925 01:50:18.501133 11946 ts_tablet_manager.cc:1929] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.501262 11946 log.cc:1199] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/e457c4ab4e814fc4be11ced6ca69284f
I20260925 01:50:18.501561 11946 ts_tablet_manager.cc:1950] T e457c4ab4e814fc4be11ced6ca69284f P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.506661 11753 tablet_bootstrap.cc:492] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.506800 11753 ts_tablet_manager.cc:1403] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.002s
I20260925 01:50:18.507683 11753 raft_consensus.cc:359] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.507853 11753 raft_consensus.cc:385] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.507915 11753 raft_consensus.cc:740] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.508165 11753 consensus_queue.cc:260] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.514572 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet b8e57874af21422ba2364603c6df04d1 (table default.Table_f226421d7bef40f38eb7b5256c57e830 [id=e0da2945f8eb4b67bb72c89936ef62c2]). Expected version 1 got 0
I20260925 01:50:18.516098 11753 ts_tablet_manager.cc:1434] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260925 01:50:18.516489 11753 tablet_bootstrap.cc:492] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.526116 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet b8e57874af21422ba2364603c6df04d1 (table default.Table_f226421d7bef40f38eb7b5256c57e830 [id=e0da2945f8eb4b67bb72c89936ef62c2]). Expected version 1 got 0
I20260925 01:50:18.527839 11946 tablet_replica.cc:333] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.528054 11946 raft_consensus.cc:2243] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.528208 11946 raft_consensus.cc:2272] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.528676 11753 tablet_bootstrap.cc:654] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.529488 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet e457c4ab4e814fc4be11ced6ca69284f (table default.Table_e99b81ca19e74a4d9f6a5cb474507f7f [id=92235f8276db4fcbbede78ce463904d6]) successfully deleted
I20260925 01:50:18.534324 11946 ts_tablet_manager.cc:1916] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.541374 11946 ts_tablet_manager.cc:1929] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.541504 11946 log.cc:1199] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/85ae2fbcec1d41dda3e0b32ce09a32f2
I20260925 01:50:18.541850 11946 ts_tablet_manager.cc:1950] T 85ae2fbcec1d41dda3e0b32ce09a32f2 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.544670 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 85ae2fbcec1d41dda3e0b32ce09a32f2 (table default.Table_2f72d02df1f14430b93be79f75e09cba [id=818ef8f0b2ca46c8b49358df930297c1]) successfully deleted
I20260925 01:50:18.547303 11753 tablet_bootstrap.cc:492] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.547475 11753 ts_tablet_manager.cc:1403] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.006s
I20260925 01:50:18.548286 11753 raft_consensus.cc:359] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.548472 11753 raft_consensus.cc:385] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.548528 11753 raft_consensus.cc:740] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.548808 11753 consensus_queue.cc:260] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.559849 11753 ts_tablet_manager.cc:1434] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260925 01:50:18.562250 11946 tablet_replica.cc:333] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.562469 11946 raft_consensus.cc:2243] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.562636 11946 raft_consensus.cc:2272] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.563459 11946 ts_tablet_manager.cc:1916] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.571408 11753 tablet_bootstrap.cc:492] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.573341 11753 tablet_bootstrap.cc:654] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.579128 11753 tablet_bootstrap.cc:492] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.579304 11753 ts_tablet_manager.cc:1403] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260925 01:50:18.579937 11753 raft_consensus.cc:359] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.580101 11753 raft_consensus.cc:385] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.580157 11753 raft_consensus.cc:740] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.580410 11753 consensus_queue.cc:260] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.589322 11753 ts_tablet_manager.cc:1434] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:50:18.592478 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet bf8bd1bfa4db4706b545829d6d26b660 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:02 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.608599 11753 tablet_bootstrap.cc:492] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.609938 11753 tablet_bootstrap.cc:654] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.611557 11753 tablet_bootstrap.cc:492] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.611703 11753 ts_tablet_manager.cc:1403] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:18.612270 11753 raft_consensus.cc:359] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.612428 11753 raft_consensus.cc:385] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.612485 11753 raft_consensus.cc:740] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.612723 11753 consensus_queue.cc:260] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.620677 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet c4a069c2d1ee4475817dc26becc3ebb6 (table default.Table_c3edb1c0f4574f5680329efd13e9a3cb [id=bf059f47d27842bb9b375e7e38df29c4]). Expected version 1 got 0
I20260925 01:50:18.621592 11753 ts_tablet_manager.cc:1434] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260925 01:50:18.630223 11753 tablet_bootstrap.cc:492] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.630399 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet c4a069c2d1ee4475817dc26becc3ebb6 (table default.Table_c3edb1c0f4574f5680329efd13e9a3cb [id=bf059f47d27842bb9b375e7e38df29c4]). Expected version 1 got 0
I20260925 01:50:18.632082 11753 tablet_bootstrap.cc:654] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.635326 11946 ts_tablet_manager.cc:1929] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.635444 11946 log.cc:1199] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/11a0a886d73442bd9753df870acf63f7
I20260925 01:50:18.635728 11946 ts_tablet_manager.cc:1950] T 11a0a886d73442bd9753df870acf63f7 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.636946 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 11a0a886d73442bd9753df870acf63f7 (table default.Table_1f9796971bef489fbaf53b6c189ec489 [id=689b9d8195ed4803b7b206fb83fced6b]) successfully deleted
I20260925 01:50:18.637336 11946 tablet_replica.cc:333] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.637578 11946 raft_consensus.cc:2243] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.637781 11946 raft_consensus.cc:2272] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.638633 11946 ts_tablet_manager.cc:1916] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.645056 11753 tablet_bootstrap.cc:492] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.645207 11753 ts_tablet_manager.cc:1403] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260925 01:50:18.645634 11946 ts_tablet_manager.cc:1929] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.645800 11946 log.cc:1199] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/bf8bd1bfa4db4706b545829d6d26b660
I20260925 01:50:18.645954 11753 raft_consensus.cc:359] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.646189 11753 raft_consensus.cc:385] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.646255 11753 raft_consensus.cc:740] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.646298 11946 ts_tablet_manager.cc:1950] T bf8bd1bfa4db4706b545829d6d26b660 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.647473 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet bf8bd1bfa4db4706b545829d6d26b660 (table default.Table_4795a346170948d996e3f9d6abec0c9d [id=90af291faed84d1b82125a6724d58bd8]) successfully deleted
I20260925 01:50:18.650249 11753 consensus_queue.cc:260] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.650899 11753 ts_tablet_manager.cc:1434] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260925 01:50:18.667964 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet b948d000f8314491b02244bdce37ba33 with delete_type TABLET_DATA_DELETED (replaced by tablet 1dcb755b54004ffdbd9aac6594b4d26f) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.670415 13803 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:50:18.670799 13803 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:50:18.671087 11753 tablet_bootstrap.cc:492] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.672040 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:50:18.672809 11753 tablet_bootstrap.cc:654] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.673386 13803 leader_election.cc:290] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:50:18.673718 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:50:18.674418 12952 leader_election.cc:304] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:50:18.674877 13803 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 01:50:18.679008 11946 tablet_replica.cc:333] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.679271 11946 raft_consensus.cc:2243] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.679461 11946 raft_consensus.cc:2272] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.679936 11753 tablet_bootstrap.cc:492] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.680081 11753 ts_tablet_manager.cc:1403] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.004s
I20260925 01:50:18.680222 11946 ts_tablet_manager.cc:1916] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.680830 11753 raft_consensus.cc:359] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.681000 11753 raft_consensus.cc:385] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.681049 11753 raft_consensus.cc:740] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.681281 11753 consensus_queue.cc:260] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.689905 11946 ts_tablet_manager.cc:1929] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.690079 11946 log.cc:1199] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/b948d000f8314491b02244bdce37ba33
I20260925 01:50:18.691263 11753 ts_tablet_manager.cc:1434] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260925 01:50:18.693027 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f7639fd1f1149a7973eba0c77bd7065 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:59 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.702963 11946 ts_tablet_manager.cc:1950] T b948d000f8314491b02244bdce37ba33 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.709501 11753 tablet_bootstrap.cc:492] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.711843 11753 tablet_bootstrap.cc:654] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.711784 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:18.718473 11946 tablet_replica.cc:333] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.718421 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet b948d000f8314491b02244bdce37ba33 (table default.Table_d12ae3dd5f37487295db3494777287c3 [id=c507bd8e7910476782a4b5e21f56d40c]) successfully deleted
I20260925 01:50:18.718820 11946 raft_consensus.cc:2243] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.719069 11946 raft_consensus.cc:2272] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.719852 11946 ts_tablet_manager.cc:1916] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.720284 11753 tablet_bootstrap.cc:492] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.720409 11753 ts_tablet_manager.cc:1403] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260925 01:50:18.720983 11753 raft_consensus.cc:359] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.721143 11753 raft_consensus.cc:385] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.721199 11753 raft_consensus.cc:740] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.721442 11753 consensus_queue.cc:260] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.721915 11753 ts_tablet_manager.cc:1434] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260925 01:50:18.723999 11753 tablet_bootstrap.cc:492] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.726379 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23 (table default.Table_bed8402d21684713ae4ef26319f8d2b2 [id=a2c6f33156564ca9bade24ce9a650e2d]). Expected version 2 got 0
I20260925 01:50:18.726596 11753 tablet_bootstrap.cc:654] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.732399 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet ad0a13f4c9af48aa8b2b18cbb5c00c23 (table default.Table_bed8402d21684713ae4ef26319f8d2b2 [id=a2c6f33156564ca9bade24ce9a650e2d]). Expected version 2 got 0
I20260925 01:50:18.741772 13586 raft_consensus.cc:493] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.741950 13586 raft_consensus.cc:515] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.742580 13586 leader_election.cc:290] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:18.744452 11456 leader_election.cc:336] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.746145 11946 ts_tablet_manager.cc:1929] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.746258 11946 log.cc:1199] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/9f7639fd1f1149a7973eba0c77bd7065
I20260925 01:50:18.749086 11946 ts_tablet_manager.cc:1950] T 9f7639fd1f1149a7973eba0c77bd7065 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.750161 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 9f7639fd1f1149a7973eba0c77bd7065 (table default.Table_f78a88f277724061b29c49a4de82da50 [id=84f07f46e27249ffbbfe65bae8e07c98]) successfully deleted
I20260925 01:50:18.751768 11753 tablet_bootstrap.cc:492] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.751917 11753 ts_tablet_manager.cc:1403] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.028s user 0.013s sys 0.013s
I20260925 01:50:18.752552 11753 raft_consensus.cc:359] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:18.752714 11753 raft_consensus.cc:385] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.752763 11753 raft_consensus.cc:740] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.752961 11753 consensus_queue.cc:260] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:18.753420 11753 ts_tablet_manager.cc:1434] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260925 01:50:18.753726 11753 tablet_bootstrap.cc:492] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.755352 11753 tablet_bootstrap.cc:654] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.759013 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 246aafd66334407895ce235e4b2ca7f4 (table default.Table_ba88e1dc63f041d3b76e16919a4d6f95 [id=1e8d3bfbc5bb4df7837d4178665e79eb]). Expected version 2 got 0
I20260925 01:50:18.763935 11753 tablet_bootstrap.cc:492] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.764102 11753 ts_tablet_manager.cc:1403] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260925 01:50:18.764916 11753 raft_consensus.cc:359] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.765092 11753 raft_consensus.cc:385] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.765143 11753 raft_consensus.cc:740] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.765345 11753 consensus_queue.cc:260] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.765833 11753 ts_tablet_manager.cc:1434] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260925 01:50:18.766139 11753 tablet_bootstrap.cc:492] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.767840 11753 tablet_bootstrap.cc:654] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.777642 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 774d14d5c7884f4e96662779b3100056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:00 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.778102 13452 raft_consensus.cc:493] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.779346 13759 raft_consensus.cc:493] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.779476 13757 raft_consensus.cc:493] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.779572 13757 raft_consensus.cc:515] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:18.779541 13759 raft_consensus.cc:515] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.780143 13757 leader_election.cc:290] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.780264 13757 raft_consensus.cc:493] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.779292 13452 raft_consensus.cc:515] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.780274 13759 leader_election.cc:290] T e9462215644a41ccb2f269f64e35392a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.781160 13759 raft_consensus.cc:493] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:18.781255 13759 raft_consensus.cc:515] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:18.083436 11314 leader_election.cc:336] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.784029 11314 leader_election.cc:304] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.784258 11314 raft_consensus.cc:2686] T e95fb28febd94a26ba9682fb9a462872 P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.784935 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 701440us
W20260925 01:50:18.785089 11314 leader_election.cc:336] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.785172 11314 leader_election.cc:304] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.785422 11314 leader_election.cc:336] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.785501 11314 leader_election.cc:304] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.785713 11314 leader_election.cc:336] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.785781 11314 leader_election.cc:304] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.780375 13757 raft_consensus.cc:515] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.787892 13757 leader_election.cc:290] T 15376374d9f2401fb9bb83d2f0acf7b3 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.788048 13757 raft_consensus.cc:2749] T f46004be36b543a395a783a13b1b14cf P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.788188 13757 raft_consensus.cc:2749] T b97f703869d4471cb940ef654203ec2b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.788304 13757 raft_consensus.cc:2749] T 0c01195f07b84b359a974fab5ed52582 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.788944 13759 leader_election.cc:290] T e1001e66d2984d9187443adcc42e5856 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.790957 13452 leader_election.cc:290] T 818a792969a245f5b0fe5f80128206ba P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.793156 11953 ts_tablet_manager.cc:1929] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.793273 11953 log.cc:1199] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/1f1d2d998d834c21ab83694daae37520
I20260925 01:50:18.793613 11953 ts_tablet_manager.cc:1950] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:18.794167 11946 tablet_replica.cc:333] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.794478 11946 raft_consensus.cc:2243] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.794731 11946 raft_consensus.cc:2272] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.798581 11946 ts_tablet_manager.cc:1916] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.809290 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 959) took 5648 ms. Trace:
I20260925 01:50:18.809461 11953 rpcz_store.cc:276] 0925 01:50:13.161124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.161212 (+ 88us) service_pool.cc:224] Handling call
0925 01:50:18.073458 (+4912246us) ts_tablet_manager.cc:1151] Deleting tablet 1f1d2d998d834c21ab83694daae37520
0925 01:50:18.073470 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.079473 (+ 6003us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.793091 (+713618us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.809250 (+ 16159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4912045}
I20260925 01:50:18.810133 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 960) took 5637 ms. Trace:
W20260925 01:50:18.810293 11755 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.740s user 0.008s sys 0.012s
W20260925 01:50:18.810415 11755 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.740s user 0.008s sys 0.012s
I20260925 01:50:18.810237 11953 rpcz_store.cc:276] 0925 01:50:13.172719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.172922 (+ 203us) service_pool.cc:224] Handling call
0925 01:50:18.809934 (+5637012us) ts_tablet_manager.cc:1151] Deleting tablet d08b978d9b2945ffa966e2237bddd48c
0925 01:50:18.809948 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.810110 (+ 162us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5636780}
I20260925 01:50:18.813772 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 962) took 5632 ms. Trace:
I20260925 01:50:18.816587 11755 tablet_bootstrap.cc:492] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:18.816784 11755 ts_tablet_manager.cc:1403] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.765s user 0.010s sys 0.012s
I20260925 01:50:18.813900 11953 rpcz_store.cc:276] 0925 01:50:13.180992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.181052 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:18.813587 (+5632535us) ts_tablet_manager.cc:1151] Deleting tablet d0edb8007afa42c6af8b289ff9cea830
0925 01:50:18.813604 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.813745 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5632320}
I20260925 01:50:18.817551 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 961) took 5636 ms. Trace:
I20260925 01:50:18.817658 11953 rpcz_store.cc:276] 0925 01:50:13.180882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.181330 (+ 448us) service_pool.cc:224] Handling call
0925 01:50:18.817389 (+5636059us) ts_tablet_manager.cc:1151] Deleting tablet 5276072bbeca403fb06566b4a43489a0
0925 01:50:18.817402 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.817529 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5635903}
I20260925 01:50:18.837518 11755 raft_consensus.cc:359] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.837816 11755 raft_consensus.cc:385] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.837890 11755 raft_consensus.cc:740] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
W20260925 01:50:18.838376 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 52657.6us
W20260925 01:50:18.839222 11314 leader_election.cc:336] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.839766 11314 leader_election.cc:304] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.840507 11314 consensus_peers.cc:597] T 3d3626880758447e9aa85f8f9070d4e3 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:18.841454 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 1f1d2d998d834c21ab83694daae37520 (table default.Table_5c6b4a2e548d46b9a0d5685f61b90692 [id=36cb077a30f0467fbf5b6a71b7af648d]) successfully deleted
W20260925 01:50:18.841939 11314 leader_election.cc:336] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
W20260925 01:50:18.842362 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d08b978d9b2945ffa966e2237bddd48c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d08b978d9b2945ffa966e2237bddd48c already in progress: creating tablet
W20260925 01:50:18.842785 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet d0edb8007afa42c6af8b289ff9cea830 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0edb8007afa42c6af8b289ff9cea830 already in progress: creating tablet
I20260925 01:50:18.843061 11314 leader_election.cc:304] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.843402 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 5276072bbeca403fb06566b4a43489a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5276072bbeca403fb06566b4a43489a0 already in progress: creating tablet
W20260925 01:50:18.843698 11314 raft_consensus.cc:2686] T 5d23c5d52faa4b6da2996fabb16bd74a P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:18.844156 11946 ts_tablet_manager.cc:1929] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.841800 13810 raft_consensus.cc:493] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.844290 11946 log.cc:1199] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/774d14d5c7884f4e96662779b3100056
I20260925 01:50:18.844444 13810 raft_consensus.cc:515] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:18.844623 11946 ts_tablet_manager.cc:1950] T 774d14d5c7884f4e96662779b3100056 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.845228 13810 leader_election.cc:290] T a8055cc9b06045449e6133298c8074e1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:18.840770 13811 raft_consensus.cc:2749] T 406d31139e1e441aa6fe204168486e28 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.845616 11314 leader_election.cc:336] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.846017 11314 leader_election.cc:304] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.846388 11314 leader_election.cc:336] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.846575 11755 consensus_queue.cc:260] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.847327 11755 ts_tablet_manager.cc:1434] T 7347b31f782c4508b004c7523dc11dbb P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.030s user 0.002s sys 0.002s
I20260925 01:50:18.846585 13811 raft_consensus.cc:2749] T fce91b00d3a14e6398abacad61ff5b0f P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.846612 11314 leader_election.cc:304] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.848399 11314 raft_consensus.cc:2686] T 1f1d2d998d834c21ab83694daae37520 P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.849001 11314 leader_election.cc:336] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.849180 11314 leader_election.cc:304] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.849404 11314 raft_consensus.cc:2686] T 1f778b87d307483b9edb17dce7355a65 P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.849972 11314 consensus_peers.cc:597] T f0157a45817246cfaa0b016afdbd59cb P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20260925 01:50:18.850153 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 774d14d5c7884f4e96662779b3100056 (table default.Table_b548583918934673acadda748a1d2aff [id=34f36265a4914e14a2ec3d326b2c4be8]) successfully deleted
I20260925 01:50:18.852046 11753 tablet_bootstrap.cc:492] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.852181 11753 ts_tablet_manager.cc:1403] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.086s user 0.028s sys 0.054s
I20260925 01:50:18.852929 11753 raft_consensus.cc:359] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.853104 11753 raft_consensus.cc:385] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.853165 11753 raft_consensus.cc:740] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.853417 11753 consensus_queue.cc:260] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:18.855262 11314 consensus_peers.cc:597] T 437bbb14fd264180887c0f5aa2ce80ea P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.855433 11314 leader_election.cc:336] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.855571 11314 leader_election.cc:304] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.855767 11314 raft_consensus.cc:2686] T 5b11c6526dbc4177b3a54b3c952bbd31 P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.856315 11314 leader_election.cc:336] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.856493 11314 leader_election.cc:304] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.856598 11753 ts_tablet_manager.cc:1434] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260925 01:50:18.856802 13810 raft_consensus.cc:2749] T 31ffb404d93a4436ba9e624b45650fe1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.856907 11753 tablet_bootstrap.cc:492] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:18.857249 11314 consensus_peers.cc:597] T f6e9bc6f6c7346bfadbd79b8d494641e P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.857429 11314 leader_election.cc:336] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.857568 11314 leader_election.cc:304] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.857810 13810 raft_consensus.cc:2749] T b4e5d28d466741a0a085a4f9938fffd1 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.858421 11314 leader_election.cc:336] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.858700 11753 tablet_bootstrap.cc:654] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.858675 11314 leader_election.cc:304] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.858978 11314 raft_consensus.cc:2686] T ae948bf42ae34a7ab72112d5f1f02585 P aac4ec033f794d7a90b52aa4e0b6155d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:18.859534 11314 leader_election.cc:336] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.859694 11314 leader_election.cc:304] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.860085 13810 raft_consensus.cc:3060] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:18.860342 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.860918 11946 tablet_replica.cc:333] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:18.861109 11946 raft_consensus.cc:2243] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.861256 11946 raft_consensus.cc:2272] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.861987 11946 ts_tablet_manager.cc:1916] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.863564 13810 raft_consensus.cc:2749] T e7b6bde824d74acfaaffc23a0b05db8b P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:18.864267 11314 leader_election.cc:336] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.864426 11314 leader_election.cc:304] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.864734 11314 leader_election.cc:336] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.850696 11755 tablet_bootstrap.cc:492] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:18.866694 11755 tablet_bootstrap.cc:654] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:18.852068 13452 raft_consensus.cc:493] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.867671 13452 raft_consensus.cc:515] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.868278 13452 leader_election.cc:290] T 0e3ba459a81845699435c2e44f5c9f19 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.852316 13808 raft_consensus.cc:493] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.868541 11946 ts_tablet_manager.cc:1929] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.868507 13808 raft_consensus.cc:515] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.868635 11946 log.cc:1199] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/262ea578b7ea4ffa87bd5b8d398e6e2a
I20260925 01:50:18.868917 11946 ts_tablet_manager.cc:1950] T 262ea578b7ea4ffa87bd5b8d398e6e2a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:18.869154 13808 leader_election.cc:290] T cc4a51356880486a928181ee701f74d0 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.852811 13759 raft_consensus.cc:493] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.869323 13759 raft_consensus.cc:515] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.869797 13759 leader_election.cc:290] T 4f19bccf3c5540cb828ec7bfc89a1c17 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.853472 13757 raft_consensus.cc:493] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.870133 13757 raft_consensus.cc:515] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.870639 13757 leader_election.cc:290] T 0749a0ae58df4ff8b74a86f072332fad P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.853622 13811 raft_consensus.cc:493] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.872015 13811 raft_consensus.cc:515] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.872491 13811 leader_election.cc:290] T e40083a885974e3595ec2fb5b16d4a5d P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.872709 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 262ea578b7ea4ffa87bd5b8d398e6e2a (table default.Table_4dc36be8fb15447789f574e806bbb81e [id=e67d9889ab8b4a0aaba249b2af705cba]) successfully deleted
I20260925 01:50:18.864902 13810 raft_consensus.cc:2749] T 5048a0fca2e64ffa9f19000f48a4c090 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.850143 11953 tablet_replica.cc:333] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: stopping tablet replica
I20260925 01:50:18.874199 11755 tablet_bootstrap.cc:492] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:18.874337 11755 ts_tablet_manager.cc:1403] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.003s
I20260925 01:50:18.874372 11953 raft_consensus.cc:2243] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:18.880270 11755 raft_consensus.cc:359] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.880616 11755 raft_consensus.cc:385] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.880743 11755 raft_consensus.cc:740] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.881115 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:13 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:18.881412 11755 consensus_queue.cc:260] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.882165 11755 ts_tablet_manager.cc:1434] T 728157ec17ed4df5a4a8559df6c1ac78 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260925 01:50:18.882531 11755 tablet_bootstrap.cc:492] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:18.884604 11755 tablet_bootstrap.cc:654] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:18.885138 11665 catalog_manager.cc:5030] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): delete failed for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a because the tablet was not found. No further retry: Not found: Tablet not found: 262ea578b7ea4ffa87bd5b8d398e6e2a
I20260925 01:50:18.884936 11953 raft_consensus.cc:2272] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:18.885811 11358 tablet_service.cc:1558] Processing DeleteTablet for tablet 0749a0ae58df4ff8b74a86f072332fad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:54 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:18.886023 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 7347b31f782c4508b004c7523dc11dbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:52 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:18.888765 11953 ts_tablet_manager.cc:1916] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:18.894534 11314 leader_election.cc:304] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.894878 11314 leader_election.cc:336] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.894982 11314 leader_election.cc:304] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.895323 11314 consensus_peers.cc:597] T efaaf48f816640e4a36627275d3ce8c9 P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.895407 11314 leader_election.cc:336] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.895473 11314 leader_election.cc:304] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.895709 11314 consensus_peers.cc:597] T 176e572f77e242d799c334820579268d P aac4ec033f794d7a90b52aa4e0b6155d -> Peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Couldn't send request to peer b93565e796c94a3699eb1824383bbaeb. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:18.895778 11314 leader_election.cc:336] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.895838 11314 leader_election.cc:304] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.896101 11314 leader_election.cc:336] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.896180 11314 leader_election.cc:304] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.896409 11314 leader_election.cc:336] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.896479 11314 leader_election.cc:304] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:18.896693 11314 leader_election.cc:336] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection reset by peer (error 104)
I20260925 01:50:18.896760 11314 leader_election.cc:304] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aac4ec033f794d7a90b52aa4e0b6155d; no voters: 514f31e4c2e54d9aaf6d4dd771d153b9, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:18.897601 13757 raft_consensus.cc:2749] T 86c8c3bba9614539bfe3018461ad21f8 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.897799 13757 raft_consensus.cc:3060] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Advancing to term 1
I20260925 01:50:18.899412 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 728157ec17ed4df5a4a8559df6c1ac78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:18.900254 11755 tablet_bootstrap.cc:492] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:18.900384 11755 ts_tablet_manager.cc:1403] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260925 01:50:18.900879 13757 raft_consensus.cc:2749] T aaa2f7ef888846ec9667916ba47084db P aac4ec033f794d7a90b52aa4e0b6155d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.901036 13759 raft_consensus.cc:2749] T 81024a75b31e45e098d108bae4cc17c9 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.901823 13759 raft_consensus.cc:2749] T 35b123ac1e894239875404438ed19927 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.901120 13811 raft_consensus.cc:2749] T b61b1bf5a8d446918edc6d166b7712ef P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.901196 13808 raft_consensus.cc:2749] T f2618c46630c4295949b36f3d0087941 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.901274 13452 raft_consensus.cc:2749] T 9771b89303094974902c4ad1f1c8608e P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:18.901221 11755 raft_consensus.cc:359] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.903973 11755 raft_consensus.cc:385] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.908895 11755 raft_consensus.cc:740] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.909396 11755 consensus_queue.cc:260] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.912822 13586 raft_consensus.cc:493] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.913035 13586 raft_consensus.cc:515] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.914034 13586 leader_election.cc:290] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:18.916705 11456 leader_election.cc:336] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.924300 11755 ts_tablet_manager.cc:1434] T 5e6715233be44b9aad5210d17500f59d P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260925 01:50:18.924795 11755 tablet_bootstrap.cc:492] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:18.926230 13586 raft_consensus.cc:493] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.926420 13586 raft_consensus.cc:515] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:18.927152 13586 leader_election.cc:290] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:18.929045 11755 tablet_bootstrap.cc:654] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:18.929481 11456 leader_election.cc:336] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:18.930506 11953 ts_tablet_manager.cc:1929] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:18.931910 11953 log.cc:1199] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-1/wal/wals/04f412cbebe04a629070aecf2753287c
I20260925 01:50:18.932370 11953 ts_tablet_manager.cc:1950] T 04f412cbebe04a629070aecf2753287c P aac4ec033f794d7a90b52aa4e0b6155d: Deleting consensus metadata
I20260925 01:50:18.933084 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 963) took 5726 ms. Trace:
I20260925 01:50:18.933264 11953 rpcz_store.cc:276] 0925 01:50:13.206941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.206995 (+ 54us) service_pool.cc:224] Handling call
0925 01:50:18.817955 (+5610960us) ts_tablet_manager.cc:1151] Deleting tablet 04f412cbebe04a629070aecf2753287c
0925 01:50:18.817966 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.892164 (+ 74198us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.930424 (+ 38260us) tablet_metadata.cc:665] Metadata flushed
0925 01:50:18.933058 (+ 2634us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5209,"tablet-delete.queue_time_us":5610727}
I20260925 01:50:18.934463 11666 catalog_manager.cc:5063] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): tablet 04f412cbebe04a629070aecf2753287c (table default.Table_74c3e602a0454e0e8b4e734dc8dea4c6 [id=34ad0afe75be4b6b97e619d27ca2da1a]) successfully deleted
I20260925 01:50:18.935163 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 964) took 5678 ms. Trace:
I20260925 01:50:18.935330 11953 rpcz_store.cc:276] 0925 01:50:13.256656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.256716 (+ 60us) service_pool.cc:224] Handling call
0925 01:50:18.934981 (+5678265us) ts_tablet_manager.cc:1151] Deleting tablet 38249392c0df4d50b0e09f3671f92800
0925 01:50:18.934996 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.935138 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5678015}
W20260925 01:50:18.936041 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 38249392c0df4d50b0e09f3671f92800 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38249392c0df4d50b0e09f3671f92800 already in progress: creating tablet
I20260925 01:50:18.936714 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 976) took 5195 ms. Trace:
I20260925 01:50:18.936882 11953 rpcz_store.cc:276] 0925 01:50:13.741788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.742128 (+ 340us) service_pool.cc:224] Handling call
0925 01:50:18.936560 (+5194432us) ts_tablet_manager.cc:1151] Deleting tablet 313ef1a795454be38e6ab617c3b21bf5
0925 01:50:18.936574 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.936692 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5194227}
W20260925 01:50:18.937523 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 313ef1a795454be38e6ab617c3b21bf5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 313ef1a795454be38e6ab617c3b21bf5 already in progress: creating tablet
I20260925 01:50:18.938045 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 977) took 5196 ms. Trace:
I20260925 01:50:18.938211 11953 rpcz_store.cc:276] 0925 01:50:13.741926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.742202 (+ 276us) service_pool.cc:224] Handling call
0925 01:50:18.937908 (+5195706us) ts_tablet_manager.cc:1151] Deleting tablet 9e86bd9a65dd46f09d87ddd831552b59
0925 01:50:18.937922 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.938024 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5195427}
W20260925 01:50:18.938791 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 9e86bd9a65dd46f09d87ddd831552b59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e86bd9a65dd46f09d87ddd831552b59 already in progress: creating tablet
I20260925 01:50:18.939312 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 978) took 5197 ms. Trace:
I20260925 01:50:18.939455 11953 rpcz_store.cc:276] 0925 01:50:13.742027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.742496 (+ 469us) service_pool.cc:224] Handling call
0925 01:50:18.939179 (+5196683us) ts_tablet_manager.cc:1151] Deleting tablet 262ea578b7ea4ffa87bd5b8d398e6e2a
0925 01:50:18.939192 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.939291 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5196496}
W20260925 01:50:18.940058 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 262ea578b7ea4ffa87bd5b8d398e6e2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 262ea578b7ea4ffa87bd5b8d398e6e2a already in progress: creating tablet
I20260925 01:50:18.940567 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 979) took 5198 ms. Trace:
I20260925 01:50:18.941028 11953 rpcz_store.cc:276] 0925 01:50:13.742455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.742511 (+ 56us) service_pool.cc:224] Handling call
0925 01:50:18.940435 (+5197924us) ts_tablet_manager.cc:1151] Deleting tablet 71a64863f0744f44943113d7c60806b7
0925 01:50:18.940447 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.940546 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5197676}
W20260925 01:50:18.947943 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 71a64863f0744f44943113d7c60806b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71a64863f0744f44943113d7c60806b7 already in progress: creating tablet
I20260925 01:50:18.948734 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 970) took 5296 ms. Trace:
I20260925 01:50:18.949331 11953 rpcz_store.cc:276] 0925 01:50:13.652636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.652734 (+ 98us) service_pool.cc:224] Handling call
0925 01:50:18.948551 (+5295817us) ts_tablet_manager.cc:1151] Deleting tablet 1b0d592dcd7a4a119befea22c35f5b2d
0925 01:50:18.948567 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.948708 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5205415}
W20260925 01:50:18.950338 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1b0d592dcd7a4a119befea22c35f5b2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b0d592dcd7a4a119befea22c35f5b2d already in progress: creating tablet
I20260925 01:50:18.950973 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 984) took 5048 ms. Trace:
I20260925 01:50:18.951478 11953 rpcz_store.cc:276] 0925 01:50:13.902796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.902861 (+ 65us) service_pool.cc:224] Handling call
0925 01:50:18.950805 (+5047944us) ts_tablet_manager.cc:1151] Deleting tablet fb9339ab8dcb4ecca41fef9e9552009e
0925 01:50:18.950819 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.950949 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5047671}
W20260925 01:50:18.952497 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet fb9339ab8dcb4ecca41fef9e9552009e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb9339ab8dcb4ecca41fef9e9552009e already in progress: creating tablet
I20260925 01:50:18.953307 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 986) took 5050 ms. Trace:
I20260925 01:50:18.953454 11953 rpcz_store.cc:276] 0925 01:50:13.903001 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:13.903639 (+ 638us) service_pool.cc:224] Handling call
0925 01:50:18.952875 (+5049236us) ts_tablet_manager.cc:1151] Deleting tablet 1cac299e4f8e4c9d90f244cd8719005a
0925 01:50:18.953171 (+ 296us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.953284 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5005901}
W20260925 01:50:18.955108 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1cac299e4f8e4c9d90f244cd8719005a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1cac299e4f8e4c9d90f244cd8719005a already in progress: creating tablet
I20260925 01:50:18.954618 11755 tablet_bootstrap.cc:492] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d: No bootstrap required, opened a new log
I20260925 01:50:18.955623 11755 ts_tablet_manager.cc:1403] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.004s
I20260925 01:50:18.956735 11755 raft_consensus.cc:359] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.957093 11755 raft_consensus.cc:385] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.957863 11755 raft_consensus.cc:740] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac4ec033f794d7a90b52aa4e0b6155d, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.958343 11755 consensus_queue.cc:260] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.959255 11355 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e6715233be44b9aad5210d17500f59d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:49:57 UTC) from {username='slave'} at 127.0.0.1:40776
I20260925 01:50:18.965680 11755 ts_tablet_manager.cc:1434] T 9c4f1e725fe84552943563aa95687842 P aac4ec033f794d7a90b52aa4e0b6155d: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260925 01:50:18.966112 11755 tablet_bootstrap.cc:492] T 33967e5e11524b78bb86ce7a3e2e16ad P aac4ec033f794d7a90b52aa4e0b6155d: Bootstrap starting.
I20260925 01:50:18.968549 11755 tablet_bootstrap.cc:654] T 33967e5e11524b78bb86ce7a3e2e16ad P aac4ec033f794d7a90b52aa4e0b6155d: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:18.970427 11314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.10.159.193:44813, user_credentials={real_user=slave}} blocked reactor thread for 73727.1us
W20260925 01:50:18.971136 11314 leader_election.cc:343] T 329a5af9fb654d4c894e1cf4fd636c13 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): Not found: Tablet not found: 329a5af9fb654d4c894e1cf4fd636c13
I20260925 01:50:18.979493 13815 raft_consensus.cc:493] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:18.979517 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9462215644a41ccb2f269f64e35392a" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:18.979681 13815 raft_consensus.cc:515] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.980540 13815 leader_election.cc:290] T b91957f62d8044ea8f6a3464c84b9e10 P aac4ec033f794d7a90b52aa4e0b6155d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589)
I20260925 01:50:18.981089 11522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1001e66d2984d9187443adcc42e5856" candidate_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" is_pre_election: true
I20260925 01:50:18.981523 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 1020) took 4570 ms. Trace:
I20260925 01:50:18.981618 11953 rpcz_store.cc:276] 0925 01:50:14.411175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.502291 (+ 91116us) service_pool.cc:224] Handling call
0925 01:50:18.981385 (+4479094us) ts_tablet_manager.cc:1151] Deleting tablet 0b0ce45b63c44b46a26a84dbc1eff4dc
0925 01:50:18.981399 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.981503 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4466870}
W20260925 01:50:18.982161 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 0b0ce45b63c44b46a26a84dbc1eff4dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b0ce45b63c44b46a26a84dbc1eff4dc already in progress: creating tablet
I20260925 01:50:18.982620 11953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40776 (request call id 1023) took 4503 ms. Trace:
I20260925 01:50:18.982702 11953 rpcz_store.cc:276] 0925 01:50:14.478830 (+ 0us) service_pool.cc:167] Inserting onto call queue
0925 01:50:14.512767 (+ 33937us) service_pool.cc:224] Handling call
0925 01:50:18.982508 (+4469741us) ts_tablet_manager.cc:1151] Deleting tablet 1f97bbad6b7348caaed4d745343b811c
0925 01:50:18.982520 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0925 01:50:18.982603 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4469469}
W20260925 01:50:18.983136 11666 catalog_manager.cc:5043] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): delete failed for tablet 1f97bbad6b7348caaed4d745343b811c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f97bbad6b7348caaed4d745343b811c already in progress: creating tablet
I20260925 01:50:18.983479 10879 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAIg11R/build/asan/bin/kudu with pid 11298
I20260925 01:50:18.986652 11753 tablet_bootstrap.cc:492] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:18.986805 11753 ts_tablet_manager.cc:1403] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.130s user 0.036s sys 0.065s
I20260925 01:50:18.987640 11753 raft_consensus.cc:359] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.987813 11753 raft_consensus.cc:385] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:18.987874 11753 raft_consensus.cc:740] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:18.988131 11753 consensus_queue.cc:260] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:18.988772 11753 ts_tablet_manager.cc:1434] T 92fec7ce0a494d47ba27dd61c2a87608 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260925 01:50:18.989477 11753 tablet_bootstrap.cc:492] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:18.991268 11753 tablet_bootstrap.cc:654] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.003106 11753 tablet_bootstrap.cc:492] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.003233 11753 ts_tablet_manager.cc:1403] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20260925 01:50:19.003803 11753 raft_consensus.cc:359] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:19.003932 11753 raft_consensus.cc:385] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.003966 11753 raft_consensus.cc:740] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.004171 11753 consensus_queue.cc:260] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:19.004662 11753 ts_tablet_manager.cc:1434] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260925 01:50:19.005841 11753 tablet_bootstrap.cc:492] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:19.007714 11753 tablet_bootstrap.cc:654] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.008715 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 92fec7ce0a494d47ba27dd61c2a87608 (table default.Table_2c38f715e8564985b59a1312f1f31cc3 [id=d842b240e7ff478e85ea733618cc41a7]). Expected version 1 got 0
I20260925 01:50:19.016294 11672 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 92fec7ce0a494d47ba27dd61c2a87608 (table default.Table_2c38f715e8564985b59a1312f1f31cc3 [id=d842b240e7ff478e85ea733618cc41a7]). Expected version 1 got 0
I20260925 01:50:19.020185 11753 tablet_bootstrap.cc:492] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.020347 11753 ts_tablet_manager.cc:1403] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20260925 01:50:19.021250 11753 raft_consensus.cc:359] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.021449 11753 raft_consensus.cc:385] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.021512 11753 raft_consensus.cc:740] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.021739 11753 consensus_queue.cc:260] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.022379 11753 ts_tablet_manager.cc:1434] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260925 01:50:19.023013 11753 tablet_bootstrap.cc:492] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:19.025173 11753 tablet_bootstrap.cc:654] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.030155 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet 1e1c0285c79b4e1280f3aa732e297c57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:06 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:19.030429 11946 tablet_replica.cc:333] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:19.030710 11946 raft_consensus.cc:2243] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:19.030908 11946 raft_consensus.cc:2272] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260925 01:50:19.038792 11753 tablet_bootstrap.cc:492] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.038967 11753 ts_tablet_manager.cc:1403] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.007s
I20260925 01:50:19.039815 11753 raft_consensus.cc:359] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:19.040025 11753 raft_consensus.cc:385] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.040086 11753 raft_consensus.cc:740] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.040217 11946 ts_tablet_manager.cc:1916] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260925 01:50:19.040307 11753 consensus_queue.cc:260] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:19.045892 11946 ts_tablet_manager.cc:1929] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:19.046021 11946 log.cc:1199] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/1e1c0285c79b4e1280f3aa732e297c57
I20260925 01:50:19.046387 11946 ts_tablet_manager.cc:1950] T 1e1c0285c79b4e1280f3aa732e297c57 P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:19.048483 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet 1e1c0285c79b4e1280f3aa732e297c57 (table default.Table_7d5f8540137149d6ac35dd7be073315f [id=8c320f9189d249d2831a3faa49cc9d6f]) successfully deleted
I20260925 01:50:19.048681 11753 ts_tablet_manager.cc:1434] T 6c886579e1eb4cac958514f7dc53b7b8 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260925 01:50:19.055542 11753 tablet_bootstrap.cc:492] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:19.057328 11753 tablet_bootstrap.cc:654] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.059514 11753 tablet_bootstrap.cc:492] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.059648 11753 ts_tablet_manager.cc:1403] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260925 01:50:19.060302 11753 raft_consensus.cc:359] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.060454 11753 raft_consensus.cc:385] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.060510 11753 raft_consensus.cc:740] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.060704 11753 consensus_queue.cc:260] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.061327 11753 ts_tablet_manager.cc:1434] T 914763e1d863493e866e29323e0fb01c P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:19.062356 11753 tablet_bootstrap.cc:492] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:19.064574 11753 tablet_bootstrap.cc:654] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.067067 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 914763e1d863493e866e29323e0fb01c (table default.Table_85893e01123542caa87b171d439ef1cc [id=335ea453e88348fc9b1ae1298a0e0b85]). Expected version 1 got 0
I20260925 01:50:19.082193 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 914763e1d863493e866e29323e0fb01c (table default.Table_85893e01123542caa87b171d439ef1cc [id=335ea453e88348fc9b1ae1298a0e0b85]). Expected version 1 got 0
W20260925 01:50:19.086686 11457 connection.cc:573] server connection from 127.10.159.194:49135 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:19.086786 11665 connection.cc:573] server connection from 127.10.159.194:58253 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:19.086936 11457 connection.cc:573] client connection to 127.10.159.194:35027 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:19.087664 13780 negotiation.cc:336] Failed RPC negotiation. Trace:
0925 01:50:19.083242 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.10.159.194:35027 (local address 127.0.0.1:54276)
0925 01:50:19.084450 (+ 1208us) negotiation.cc:107] Waiting for socket to connect
0925 01:50:19.084488 (+ 38us) client_negotiation.cc:175] Beginning negotiation
0925 01:50:19.084650 (+ 162us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0925 01:50:19.087522 (+ 2872us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1057}
I20260925 01:50:19.088032 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 11431
I20260925 01:50:19.089130 11753 tablet_bootstrap.cc:492] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.089303 11753 ts_tablet_manager.cc:1403] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.027s user 0.013s sys 0.005s
I20260925 01:50:19.090225 11753 raft_consensus.cc:359] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.090415 11753 raft_consensus.cc:385] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.090488 11753 raft_consensus.cc:740] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.090786 11753 consensus_queue.cc:260] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.091342 11753 ts_tablet_manager.cc:1434] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260925 01:50:19.091464 11457 leader_election.cc:336] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.091588 11457 leader_election.cc:304] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.091655 11753 tablet_bootstrap.cc:492] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:19.091922 11457 consensus_peers.cc:597] T e7f421bb962e407c8b459eaad6e45b61 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.092006 11457 consensus_peers.cc:597] T 6386bd0cb4894068985fe152299f0b47 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.092056 11457 leader_election.cc:336] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.092118 11457 leader_election.cc:304] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.092339 13586 raft_consensus.cc:2749] T 23dc2ece3d624baa8d5d45ec6b67c6f6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:19.092526 13586 raft_consensus.cc:2749] T 7c9364671fcc42dba51569d14979f030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:19.092826 11457 leader_election.cc:336] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.092824 13782 raft_consensus.cc:493] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:19.092955 11457 leader_election.cc:304] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.093001 13782 raft_consensus.cc:515] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
W20260925 01:50:19.093099 11457 raft_consensus.cc:2686] T d12d2cf8c4744858bf0967eeec72f381 P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:19.093588 13782 leader_election.cc:290] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:19.093616 11457 consensus_peers.cc:597] T 4ad9d992f7ed4021a7e472dd38ad2c2e P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.093711 11457 leader_election.cc:336] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.093797 11457 leader_election.cc:304] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.094013 13782 raft_consensus.cc:2749] T 082ec0b4620044b2843b45279b7716d9 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:19.094089 11457 consensus_peers.cc:597] T e4683df170284c228a08df5422e37d16 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.094179 11457 leader_election.cc:336] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.094249 11457 leader_election.cc:304] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.094461 13782 raft_consensus.cc:2749] T 246aafd66334407895ce235e4b2ca7f4 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:19.094533 11457 consensus_peers.cc:597] T 2feaab143fae4312915579fdb2ff1e40 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.094872 11457 consensus_peers.cc:597] T 60c40e2db5e2434192a359f50c02fe13 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.095099 11457 consensus_peers.cc:597] T 1c29e410731842aeb64ab8eeb4ccc3ca P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.095247 11457 consensus_peers.cc:597] T e26b1dc65fc84629a72029519919ae23 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.095371 11457 leader_election.cc:336] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.095508 11457 leader_election.cc:304] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.095732 13782 raft_consensus.cc:2749] T ad0a13f4c9af48aa8b2b18cbb5c00c23 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:19.096019 11457 consensus_peers.cc:597] T f1d3077f21374d969626972654c7e5e1 P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.096194 11457 consensus_peers.cc:597] T b60706e2087b4ec7b63f6747534a4b0f P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.096321 11457 consensus_peers.cc:597] T 7da55c488da540048a94324fa347c1ef P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.096434 11457 leader_election.cc:336] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.096565 11457 leader_election.cc:304] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.096807 13782 raft_consensus.cc:2749] T c28a226deca04da6a7a3f7a2b60598bd P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 01:50:19.097131 11457 consensus_peers.cc:597] T 41c4a23d974f4daea7a274eccd661d5c P 514f31e4c2e54d9aaf6d4dd771d153b9 -> Peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Couldn't send request to peer aac4ec033f794d7a90b52aa4e0b6155d. Status: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 01:50:19.097285 11457 leader_election.cc:336] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.097405 11457 leader_election.cc:304] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:19.097595 11457 raft_consensus.cc:2686] T 9e112a4ce48f40a196f655379c758c9c P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260925 01:50:19.098237 11457 leader_election.cc:336] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.098408 11457 leader_election.cc:304] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
I20260925 01:50:19.098706 13782 raft_consensus.cc:2749] T 27a0aab75efb4d6e803ae6e335fe592a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 01:50:19.100201 11753 tablet_bootstrap.cc:654] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.101631 11488 tablet_service.cc:1558] Processing DeleteTablet for tablet db217278aa27439587768291c4ca7e3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-25 01:50:03 UTC) from {username='slave'} at 127.0.0.1:49304
I20260925 01:50:19.101892 11946 tablet_replica.cc:333] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: stopping tablet replica
I20260925 01:50:19.102151 11946 raft_consensus.cc:2243] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260925 01:50:19.102321 11946 raft_consensus.cc:2272] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260925 01:50:19.102473 11457 leader_election.cc:336] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.103065 11946 ts_tablet_manager.cc:1916] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260925 01:50:19.104358 11456 leader_election.cc:336] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813): Network error: Client connection negotiation failed: client connection to 127.10.159.193:44813: connect: Connection refused (error 111)
I20260925 01:50:19.104496 11456 leader_election.cc:304] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514f31e4c2e54d9aaf6d4dd771d153b9; no voters: aac4ec033f794d7a90b52aa4e0b6155d, b93565e796c94a3699eb1824383bbaeb
W20260925 01:50:19.104724 11456 raft_consensus.cc:2686] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 01:50:19.105283 11753 tablet_bootstrap.cc:492] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.105399 11753 ts_tablet_manager.cc:1403] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.001s
I20260925 01:50:19.106386 11753 raft_consensus.cc:359] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.106562 11753 raft_consensus.cc:385] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.106618 11753 raft_consensus.cc:740] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.106855 11753 consensus_queue.cc:260] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.107254 11753 ts_tablet_manager.cc:1434] T 34c9661fe2914111ad322eff99c42030 P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260925 01:50:19.107560 11753 tablet_bootstrap.cc:492] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:19.109303 11666 catalog_manager.cc:4790] TS aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e6b97d37704f4a0d88457d124bb4f259: Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.109563 11753 tablet_bootstrap.cc:654] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.119342 11946 ts_tablet_manager.cc:1929] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260925 01:50:19.119518 11946 log.cc:1199] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting WAL directory at /tmp/dist-test-taskAIg11R/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1790300977005479-10879-0/minicluster-data/ts-2/wal/wals/db217278aa27439587768291c4ca7e3a
I20260925 01:50:19.119951 11946 ts_tablet_manager.cc:1950] T db217278aa27439587768291c4ca7e3a P 514f31e4c2e54d9aaf6d4dd771d153b9: Deleting consensus metadata
I20260925 01:50:19.126631 11564 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 01:50:19.127473 11665 catalog_manager.cc:5063] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589): tablet db217278aa27439587768291c4ca7e3a (table default.Table_d21e6c10f3a34da9aa36f6f3201df482 [id=f59e487e166d48368b58911e23c8600f]) successfully deleted
W20260925 01:50:19.242409 11667 catalog_manager.cc:4845] Async tablet task AlterTable RPC for tablet fb49118851664ee59be43122bb8d9b27 (table default.Table_edc5e2ecf3d240d7a989ed4b671a85e7 [id=ca2645e742b847cc94f9514d7ffb8620], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fb49118851664ee59be43122bb8d9b27 consensus state has no leader
I20260925 01:50:19.603351 13782 raft_consensus.cc:493] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.605038 13782 raft_consensus.cc:515] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.606079 13782 leader_election.cc:290] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.606253 13782 raft_consensus.cc:493] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:19.606381 13782 raft_consensus.cc:515] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.606868 11753 tablet_bootstrap.cc:492] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.607031 13782 leader_election.cc:290] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.607192 13782 raft_consensus.cc:493] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:19.607052 11753 ts_tablet_manager.cc:1403] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.500s user 0.015s sys 0.017s
I20260925 01:50:19.607318 13782 raft_consensus.cc:515] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.608166 13782 leader_election.cc:290] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.608335 13782 raft_consensus.cc:493] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.608500 13782 raft_consensus.cc:515] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:19.608548 11753 raft_consensus.cc:359] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.609007 11753 raft_consensus.cc:385] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.609124 11753 raft_consensus.cc:740] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.609468 11753 consensus_queue.cc:260] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.610131 11753 ts_tablet_manager.cc:1434] T 2b1e462c544f4c04a148e273f545570d P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260925 01:50:19.609143 13782 leader_election.cc:290] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.621678 11753 tablet_bootstrap.cc:492] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:19.626808 11753 tablet_bootstrap.cc:654] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.629171 13833 raft_consensus.cc:493] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:19.629946 13586 raft_consensus.cc:493] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:19.630116 13831 raft_consensus.cc:493] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.630307 13586 raft_consensus.cc:515] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.630554 13829 raft_consensus.cc:493] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:19.630674 13829 raft_consensus.cc:515] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:19.631250 13829 leader_election.cc:290] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:19.631381 13829 raft_consensus.cc:493] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.631685 13586 leader_election.cc:290] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.631954 13586 raft_consensus.cc:493] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.632277 13586 raft_consensus.cc:515] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:19.630306 13831 raft_consensus.cc:515] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:19.633073 13586 leader_election.cc:290] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.633234 13831 leader_election.cc:290] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.633255 13586 raft_consensus.cc:493] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.633493 13586 raft_consensus.cc:515] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.634173 13586 leader_election.cc:290] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.630117 13833 raft_consensus.cc:515] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.631495 13829 raft_consensus.cc:515] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.635609 13829 leader_election.cc:290] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.635115 13833 leader_election.cc:290] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.646549 13829 raft_consensus.cc:493] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 01:50:19.646664 13782 raft_consensus.cc:493] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.646798 13833 raft_consensus.cc:493] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.646837 13782 raft_consensus.cc:515] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.646924 13833 raft_consensus.cc:515] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.647004 13829 raft_consensus.cc:515] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.647421 13833 leader_election.cc:290] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.647605 11753 tablet_bootstrap.cc:492] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.647605 13829 leader_election.cc:290] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.647423 13782 leader_election.cc:290] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.647779 11753 ts_tablet_manager.cc:1403] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.001s
I20260925 01:50:19.648808 11753 raft_consensus.cc:359] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.649158 11753 raft_consensus.cc:385] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.649258 11753 raft_consensus.cc:740] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.649550 11753 consensus_queue.cc:260] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.650261 11753 ts_tablet_manager.cc:1434] T 22a335062caa48139e1cd4bca7bd4e2b P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260925 01:50:19.650666 11753 tablet_bootstrap.cc:492] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
I20260925 01:50:19.653052 11753 tablet_bootstrap.cc:654] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
I20260925 01:50:19.654191 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 2b1e462c544f4c04a148e273f545570d (table default.Table_4ac6f82f8b014d6d8c31810a615b7cd8 [id=f318edf82c57433098a317160c89b7db]). Expected version 1 got 0
I20260925 01:50:19.660219 13838 raft_consensus.cc:493] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.660435 13838 raft_consensus.cc:515] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:19.661394 13838 leader_election.cc:290] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
W20260925 01:50:19.662814 11457 leader_election.cc:336] T 5c44007cb7eb4263a9209cb3989d4a25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.666317 11457 leader_election.cc:336] T e87128b8baef4f9d80341f6980da519d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.666594 11457 leader_election.cc:336] T c4a069c2d1ee4475817dc26becc3ebb6 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.666805 11457 leader_election.cc:336] T 9b4f4321544a4f1d9de2e50aa5d7b42a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.667003 11457 leader_election.cc:336] T dfee952102744ef8b287965330d7cd97 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.671438 11457 leader_election.cc:336] T 5ef1b5f18d074016a6dea82da8e2d2b2 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.671772 11457 leader_election.cc:336] T 3e12ffab16844f50be47dadcfbb3793f P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.671984 11457 leader_election.cc:336] T 793722fd5d3f4d108d85276c0925e627 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.672186 11457 leader_election.cc:336] T 48bd9071170d4f6f9ac4039020de5c00 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.672392 11457 leader_election.cc:336] T 9feb00f881ed4518a32e08d170080a46 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.672613 11457 leader_election.cc:336] T e9462215644a41ccb2f269f64e35392a P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.672811 11457 leader_election.cc:336] T b8e57874af21422ba2364603c6df04d1 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.673456 11457 leader_election.cc:336] T 60411b0feafe4fef9c4fdc364163f1df P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.673666 11457 leader_election.cc:336] T 602af3d6e7bb44f8a316691019f85c25 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
W20260925 01:50:19.673846 11457 leader_election.cc:336] T bdf7f544827d4bca97aa6b63c0c48c0d P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.674019 11753 tablet_bootstrap.cc:492] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9: No bootstrap required, opened a new log
I20260925 01:50:19.674224 11753 ts_tablet_manager.cc:1403] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.009s
I20260925 01:50:19.674350 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 2b1e462c544f4c04a148e273f545570d (table default.Table_4ac6f82f8b014d6d8c31810a615b7cd8 [id=f318edf82c57433098a317160c89b7db]). Expected version 1 got 0
I20260925 01:50:19.674520 13838 raft_consensus.cc:493] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.674669 13838 raft_consensus.cc:515] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
I20260925 01:50:19.675000 11753 raft_consensus.cc:359] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.675174 11753 raft_consensus.cc:385] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 01:50:19.675068 11678 catalog_manager.cc:5938] TS 514f31e4c2e54d9aaf6d4dd771d153b9 (127.10.159.195:45589) does not have the latest schema for tablet 41c4a23d974f4daea7a274eccd661d5c (table default.Table_1629f46770b141d289c5bbd8855f4acc [id=feac90fd577e419186eb948cfe3def8e]). Expected version 1 got 0
I20260925 01:50:19.675266 11753 raft_consensus.cc:740] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514f31e4c2e54d9aaf6d4dd771d153b9, State: Initialized, Role: FOLLOWER
I20260925 01:50:19.675292 13838 leader_election.cc:290] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.676057 13834 raft_consensus.cc:493] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.676241 13834 raft_consensus.cc:515] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } }
I20260925 01:50:19.676955 13834 leader_election.cc:290] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:19.677376 13834 raft_consensus.cc:493] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.677523 13834 raft_consensus.cc:515] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:19.677659 11457 leader_election.cc:336] T ec82ac4f3b4d48fbbb33c21f5630d749 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.678182 13834 leader_election.cc:290] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027), b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813)
I20260925 01:50:19.678383 13834 raft_consensus.cc:493] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b93565e796c94a3699eb1824383bbaeb)
I20260925 01:50:19.678519 13834 raft_consensus.cc:515] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } }
W20260925 01:50:19.678679 11457 leader_election.cc:336] T df5dcf3b6d134065be92ec6ea8caffc7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.679112 13834 leader_election.cc:290] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b93565e796c94a3699eb1824383bbaeb (127.10.159.193:44813), aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027)
I20260925 01:50:19.679404 11753 consensus_queue.cc:260] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b93565e796c94a3699eb1824383bbaeb" member_type: VOTER last_known_addr { host: "127.10.159.193" port: 44813 } } peers { permanent_uuid: "514f31e4c2e54d9aaf6d4dd771d153b9" member_type: VOTER last_known_addr { host: "127.10.159.195" port: 45589 } } peers { permanent_uuid: "aac4ec033f794d7a90b52aa4e0b6155d" member_type: VOTER last_known_addr { host: "127.10.159.194" port: 35027 } }
I20260925 01:50:19.680100 11753 ts_tablet_manager.cc:1434] T 3541e17b47bc47f5b69add361877a2bf P 514f31e4c2e54d9aaf6d4dd771d153b9: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260925 01:50:19.680379 11753 tablet_bootstrap.cc:492] T 6599a18283614e759cf3886d72c8250b P 514f31e4c2e54d9aaf6d4dd771d153b9: Bootstrap starting.
W20260925 01:50:19.681144 11457 leader_election.cc:336] T 5ad258cd4788477ea5f9e34ebcab95c7 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.682387 11753 tablet_bootstrap.cc:654] T 6599a18283614e759cf3886d72c8250b P 514f31e4c2e54d9aaf6d4dd771d153b9: Neither blocks nor log segments found. Creating new log.
W20260925 01:50:19.683053 11457 leader_election.cc:336] T e1001e66d2984d9187443adcc42e5856 P 514f31e4c2e54d9aaf6d4dd771d153b9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aac4ec033f794d7a90b52aa4e0b6155d (127.10.159.194:35027): Network error: Client connection negotiation failed: client connection to 127.10.159.194:35027: connect: Connection refused (error 111)
I20260925 01:50:19.696727 10879 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAIg11R/build/asan/bin/kudu with pid 11431
I20260925 01:50:19.720819 13844 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:50:19.721009 13844 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252" port: 44823 } }
I20260925 01:50:19.721834 13844 leader_election.cc:290] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17a1694989f748dfa9cdb2c10f3f1de5 (127.10.159.254:40913), ca2cee7752c249f68a372ef5c6a18bff (127.10.159.252:44823)
I20260925 01:50:19.722564 11690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" is_pre_election: true
I20260925 01:50:19.722620 12392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" candidate_term: 5 candidate_status { last_received { term: 4 index: 1525 } } ignore_live_leader: false dest_uuid: "ca2cee7752c249f68a372ef5c6a18bff" is_pre_election: true
I20260925 01:50:19.723456 12952 leader_election.cc:304] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec2f98d6295c4f8ead68b46f01e73d37; no voters: 17a1694989f748dfa9cdb2c10f3f1de5, ca2cee7752c249f68a372ef5c6a18bff
I20260925 01:50:19.723862 13844 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ec2f98d6295c4f8ead68b46f01e73d37 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 01:50:19.757551 11667 connection.cc:573] server connection from 127.10.159.195:44907 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:19.757663 12259 connection.cc:573] server connection from 127.10.159.195:56827 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 01:50:19.757879 11665 connection.cc:573] client connection to 127.10.159.195:45589 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260925 01:50:19.758190 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 11636
I20260925 01:50:19.765158 11711 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 01:50:20.036737 10879 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskAIg11R/build/asan/bin/kudu with pid 11636
I20260925 01:50:20.074362 10879 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskAIg11R/build/asan/bin/kudu pid 12828
I20260925 01:50:20.081084 13103 generic_service.cc:196] Checking for leaks (request via RPC)
I20260925 01:50:20.164909 13850 raft_consensus.cc:493] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17a1694989f748dfa9cdb2c10f3f1de5)
I20260925 01:50:20.165118 13850 raft_consensus.cc:515] T 00000000000000000000000000000000 P ca2cee7752c249f68a372ef5c6a18bff [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17a1694989f748dfa9cdb2c10f3f1de5" member_type: VOTER last_known_addr { host: "127.10.159.254" port: 40913 } } peers { permanent_uuid: "ec2f98d6295c4f8ead68b46f01e73d37" member_type: VOTER last_known_addr { host: "127.10.159.253" port: 42889 } } peers { permanent_uuid: "ca2cee7752c249f68a372ef5c6a18bff" member_type: VOTER last_known_addr { host: "127.10.159.252"